-- Logs begin at Sun 2022-10-09 00:10:40 UTC, end at Sun 2022-10-09 01:14:07 UTC. -- Oct 09 00:40:55.086994 dv-cinder-master-3-smb systemd[1]: Starting Devstack devstack@keystone.service... Oct 09 00:40:55.097875 dv-cinder-master-3-smb devstack@keystone.service[81514]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Oct 09 00:40:55.099848 dv-cinder-master-3-smb devstack@keystone.service[81514]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sun Oct 9 00:40:55 2022] *** Oct 09 00:40:55.099848 dv-cinder-master-3-smb devstack@keystone.service[81514]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 09 00:40:55.099848 dv-cinder-master-3-smb devstack@keystone.service[81514]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 09 00:40:55.099848 dv-cinder-master-3-smb devstack@keystone.service[81514]: nodename: dv-cinder-master-3-smb Oct 09 00:40:55.099848 dv-cinder-master-3-smb devstack@keystone.service[81514]: machine: x86_64 Oct 09 00:40:55.099848 dv-cinder-master-3-smb devstack@keystone.service[81514]: clock source: unix Oct 09 00:40:55.099848 dv-cinder-master-3-smb devstack@keystone.service[81514]: pcre jit disabled Oct 09 00:40:55.099848 dv-cinder-master-3-smb devstack@keystone.service[81514]: detected number of CPU cores: 4 Oct 09 00:40:55.099848 dv-cinder-master-3-smb devstack@keystone.service[81514]: current working directory: / Oct 09 00:40:55.099848 dv-cinder-master-3-smb devstack@keystone.service[81514]: detected binary path: /usr/bin/uwsgi-core Oct 09 00:40:55.100410 dv-cinder-master-3-smb devstack@keystone.service[81514]: your processes number limit is 47680 Oct 09 00:40:55.100410 dv-cinder-master-3-smb devstack@keystone.service[81514]: your memory page size is 4096 bytes Oct 09 00:40:55.100410 dv-cinder-master-3-smb devstack@keystone.service[81514]: detected max file descriptor number: 2048 Oct 09 00:40:55.100410 dv-cinder-master-3-smb devstack@keystone.service[81514]: lock engine: pthread robust mutexes Oct 09 00:40:55.100410 dv-cinder-master-3-smb devstack@keystone.service[81514]: thunder lock: enabled Oct 09 00:40:55.100410 dv-cinder-master-3-smb devstack@keystone.service[81514]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Oct 09 00:40:55.100410 dv-cinder-master-3-smb devstack@keystone.service[81514]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 09 00:40:55.139296 dv-cinder-master-3-smb devstack@keystone.service[81514]: Python main interpreter initialized at 0x5610a648c9c0 Oct 09 00:40:55.139296 dv-cinder-master-3-smb devstack@keystone.service[81514]: python threads support enabled Oct 09 00:40:55.139296 dv-cinder-master-3-smb devstack@keystone.service[81514]: your server socket listen backlog is limited to 100 connections Oct 09 00:40:55.139296 dv-cinder-master-3-smb devstack@keystone.service[81514]: your mercy for graceful operations on workers is 90 seconds Oct 09 00:40:55.139672 dv-cinder-master-3-smb devstack@keystone.service[81514]: mapped 403077 bytes (393 KB) for 2 cores Oct 09 00:40:55.139760 dv-cinder-master-3-smb devstack@keystone.service[81514]: *** Operational MODE: preforking *** Oct 09 00:40:55.140011 dv-cinder-master-3-smb devstack@keystone.service[81514]: *** uWSGI is running in multiple interpreter mode *** Oct 09 00:40:55.140011 dv-cinder-master-3-smb devstack@keystone.service[81514]: spawned uWSGI master process (pid: 81514) Oct 09 00:40:55.140242 dv-cinder-master-3-smb systemd[1]: Started Devstack devstack@keystone.service. Oct 09 00:40:55.142156 dv-cinder-master-3-smb devstack@keystone.service[81514]: spawned uWSGI worker 1 (pid: 81524, cores: 1) Oct 09 00:40:55.142156 dv-cinder-master-3-smb devstack@keystone.service[81514]: spawned uWSGI worker 2 (pid: 81525, cores: 1) Oct 09 00:40:55.142156 dv-cinder-master-3-smb devstack@keystone.service[81514]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 09 00:40:59.375291 dv-cinder-master-3-smb devstack@keystone.service[81524]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 09 00:40:59.375291 dv-cinder-master-3-smb devstack@keystone.service[81524]: from cryptography.utils import int_from_bytes Oct 09 00:40:59.376128 dv-cinder-master-3-smb devstack@keystone.service[81525]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 09 00:40:59.376128 dv-cinder-master-3-smb devstack@keystone.service[81525]: from cryptography.utils import int_from_bytes Oct 09 00:40:59.376128 dv-cinder-master-3-smb devstack@keystone.service[81525]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 09 00:40:59.376128 dv-cinder-master-3-smb devstack@keystone.service[81525]: from cryptography.utils import int_from_bytes Oct 09 00:40:59.376639 dv-cinder-master-3-smb devstack@keystone.service[81524]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 09 00:40:59.376639 dv-cinder-master-3-smb devstack@keystone.service[81524]: from cryptography.utils import int_from_bytes Oct 09 00:40:59.425135 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 09 00:40:59.425377 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 09 00:40:59.425377 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 09 00:40:59.425533 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 09 00:40:59.425594 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] command line args: [] {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 09 00:40:59.425650 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] command line args: [] {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 09 00:40:59.425788 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 09 00:40:59.425871 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 09 00:40:59.425942 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] ================================================================================ {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 09 00:40:59.426000 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] ================================================================================ {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 09 00:40:59.426150 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] admin_token = **** {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 09 00:40:59.426229 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] admin_token = **** {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 09 00:40:59.426426 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] config_dir = [] {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 09 00:40:59.426566 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] config_dir = [] {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 09 00:40:59.426566 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 09 00:40:59.426688 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 09 00:40:59.426746 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] config_source = [] {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 09 00:40:59.426801 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] config_source = [] {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 09 00:40:59.426936 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] debug = True {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 09 00:40:59.427028 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] debug = True {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 09 00:40:59.427095 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 09 00:40:59.428793 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 09 00:40:59.428793 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 09 00:40:59.428967 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 09 00:40:59.429027 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 09 00:40:59.429088 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 09 00:40:59.429145 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 09 00:40:59.429207 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 09 00:40:59.429263 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 09 00:40:59.429326 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 09 00:40:59.429383 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] list_limit = None {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 09 00:40:59.429438 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] list_limit = None {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 09 00:40:59.429493 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] log_config_append = None {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 09 00:40:59.429547 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] log_config_append = None {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 09 00:40:59.429607 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 09 00:40:59.429671 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 09 00:40:59.429733 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] log_dir = None {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 09 00:40:59.429790 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] log_dir = None {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 09 00:40:59.429790 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] log_file = None {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 09 00:40:59.429899 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] log_file = None {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 09 00:40:59.429955 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 09 00:40:59.430018 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 09 00:40:59.430075 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 09 00:40:59.430130 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 09 00:40:59.430185 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 09 00:40:59.430240 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 09 00:40:59.430300 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 09 00:40:59.430368 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 09 00:40:59.430433 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 09 00:40:59.430496 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 09 00:40:59.430554 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 09 00:40:59.430615 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 09 00:40:59.430682 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 09 00:40:59.430740 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 09 00:40:59.430800 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 09 00:40:59.430872 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 09 00:40:59.430943 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 09 00:40:59.431006 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 09 00:40:59.431155 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 09 00:40:59.431235 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 09 00:40:59.431421 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 09 00:40:59.431529 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 09 00:40:59.431627 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 09 00:40:59.431763 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 09 00:40:59.431913 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 09 00:40:59.431998 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 09 00:40:59.432111 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 09 00:40:59.432202 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 09 00:40:59.432409 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 09 00:40:59.432532 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 09 00:40:59.433031 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.15/identity {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 09 00:40:59.433151 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.15/identity {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 09 00:40:59.433228 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] publish_errors = False {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 09 00:40:59.433369 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] publish_errors = False {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 09 00:40:59.433454 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 09 00:40:59.433525 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 09 00:40:59.433648 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 09 00:40:59.433723 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 09 00:40:59.433800 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 09 00:40:59.433877 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 09 00:40:59.434031 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 09 00:40:59.434230 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 09 00:40:59.434230 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 09 00:40:59.434474 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 09 00:40:59.434588 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] standard_threads = False {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 09 00:40:59.434699 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] standard_threads = False {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 09 00:40:59.434803 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 09 00:40:59.434911 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 09 00:40:59.435020 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 09 00:40:59.435117 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 09 00:40:59.435117 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 09 00:40:59.435316 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 09 00:40:59.435316 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] use_journal = False {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 09 00:40:59.435512 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] use_journal = False {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 09 00:40:59.435512 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] use_json = False {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 09 00:40:59.435754 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] use_json = False {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 09 00:40:59.435854 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] use_stderr = False {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 09 00:40:59.435955 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] use_stderr = False {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 09 00:40:59.436055 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] use_syslog = False {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 09 00:40:59.436155 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] use_syslog = False {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 09 00:40:59.436257 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 09 00:40:59.436352 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 09 00:40:59.436451 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.436550 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.436664 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.437164 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.437366 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.437469 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.437565 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.437658 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.437757 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.437851 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.437953 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.438054 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.438155 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.438255 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.438349 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.438448 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.438550 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.438644 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.438749 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.438842 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.438934 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.439027 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.439132 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.439227 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.439346 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.439441 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.439559 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.439677 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.439790 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.439905 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.440017 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.440129 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.440240 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.440351 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.440469 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.440581 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.440698 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.440810 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.440916 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.441010 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.441201 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.441316 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.441434 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.441550 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.441662 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.441780 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.441892 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.442002 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.442114 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.442224 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.442330 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.442448 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.442560 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.442670 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.442780 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.442896 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.443007 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.443128 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.443241 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.443430 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.443541 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.443651 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.443761 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.443883 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.443996 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.444112 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.444229 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.444340 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.444449 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.444567 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.444684 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.444800 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.444913 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.445024 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.445133 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.445254 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.445365 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.445481 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.445597 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.445979 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.446095 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.446214 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.446329 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.446988 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.447110 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.447222 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.447431 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.447547 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.447662 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.447772 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.447881 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.447988 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.448105 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.448216 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.448324 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.448441 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.448552 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.448662 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.448778 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.448890 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.448999 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.449114 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.449225 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.449334 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.449455 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.449567 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.449676 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.449791 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.449901 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.450010 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.450117 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.450213 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.450312 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.450438 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.450541 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.450647 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.450743 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.450842 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.450937 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.451030 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.451123 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.451226 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.451384 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.451511 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.451626 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.451735 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.451856 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.451976 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.452089 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.452212 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.452315 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.452415 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.452525 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.452637 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.452747 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.452865 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.452978 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.453089 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.453199 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.453309 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.453420 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.453538 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.453649 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.453760 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.453871 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.453982 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.454092 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.454210 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.454323 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.454433 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.454551 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.454551 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.454751 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.454873 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.454986 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.455096 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.455207 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.455332 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.455443 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.455566 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.455670 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.455773 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.455883 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.455999 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.456116 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.456239 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.456352 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.456463 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.456573 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.456683 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.456794 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.456911 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.457024 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.457134 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.457236 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.457355 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.457472 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.457594 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.457706 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.457822 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.457934 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.458044 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.458155 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.458343 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.458458 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.458571 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.458687 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.458807 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.458928 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.459046 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.459165 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.459291 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.459415 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.459529 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.459639 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.459750 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.459868 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.459981 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.460091 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.460202 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.460317 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.460435 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.460558 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.460670 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.460781 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.460891 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.461002 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.461112 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.461233 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.461345 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.461456 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.461571 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.461681 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.461817 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] auth.external = None {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.461942 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.462063 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.462183 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] auth.external = None {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.462304 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.462427 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.462540 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.462659 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.462772 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] auth.password = None {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.462892 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.463005 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] auth.token = None {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.463117 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] auth.password = None {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.463228 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.463367 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] auth.token = None {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.463482 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.463601 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.463714 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.463898 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.464065 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.464182 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.464294 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.464415 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.464530 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.464647 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.464761 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.464876 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.464989 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] credential.caching = True {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.465109 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.465258 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.465371 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] credential.caching = True {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.465483 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.465483 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.465693 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.465812 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.465925 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.466036 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.466148 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.466260 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.466371 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.466490 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.466609 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.466721 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.466833 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.466950 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.467062 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.467181 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.467333 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.467333 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.467548 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.467660 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.467771 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.467771 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.467989 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.468107 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.468220 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.468332 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.468443 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.468563 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] federation.caching = True {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.468682 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.468794 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.468906 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.469017 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.469137 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] federation.caching = True {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.469258 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.469372 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.469483 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.469594 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.469705 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.469817 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.469936 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.470055 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.470174 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.470286 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.470398 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.470519 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.470633 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.470750 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.470905 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.471020 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.471132 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.471252 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.471400 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] identity.caching = True {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.471514 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.471625 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.471747 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.471860 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.472047 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] identity.caching = True {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.472164 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.472276 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.472393 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.472505 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.472618 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.472737 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.472857 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.472969 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.473087 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.473199 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.473323 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.473444 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.473558 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.473670 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.473781 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.473892 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.474003 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.474003 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.474222 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.474222 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.474441 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.474553 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.474665 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.474783 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.474899 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.475011 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.475128 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.475240 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.475399 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.475526 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.475640 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.475753 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.475865 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.475978 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.476100 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.476100 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.476401 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.476518 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.476629 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.476743 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.476854 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.476973 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.477086 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.477197 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.477308 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.477418 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.477529 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.477648 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.477761 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.477872 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.477986 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.478096 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.478207 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.478327 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.478445 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.478557 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.478668 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.478779 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.478890 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.479010 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.479122 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.479233 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.479360 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.479514 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.479627 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.479753 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.479868 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.479980 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.480092 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.480203 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.480315 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.480434 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.480547 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.480659 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.480771 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.480771 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.480988 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.481102 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.481213 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.481213 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.481422 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.481536 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.481655 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.481769 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.481880 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.481992 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.482103 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.482214 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.482333 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.482446 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.482557 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.482668 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.482780 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.482891 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.482891 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] ldap.user = None {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.483110 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.483222 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.483354 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.483466 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.483578 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.483700 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.483822 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.483935 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.484048 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] ldap.user = None {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.484158 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.484269 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.484393 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.484507 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.484619 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.484729 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.484844 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.484956 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.485076 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.485189 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.485301 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.485411 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.485521 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.485632 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.485756 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.485869 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.485981 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.486091 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.486203 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.486313 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.486432 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.486545 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.486657 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.486768 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.486878 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.486995 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.487115 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.487229 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.487429 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.487542 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.487653 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.487764 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.487888 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.488003 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.488113 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.488224 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.488336 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.488446 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.488566 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.488679 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.488790 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.488901 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.489012 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.489123 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.489245 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.489359 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.489470 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.489580 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.489690 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.489801 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.489920 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.490032 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.490144 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.490255 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.490366 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.490478 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.490597 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.490710 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.490821 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.490932 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.491044 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.491154 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.491292 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.491408 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.491520 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] resource.caching = True {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.491631 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.491743 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.491854 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.491981 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.492095 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.492242 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.492355 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.492467 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.492578 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] resource.caching = True {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.492697 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.492810 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.492913 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.493023 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.493134 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.493246 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.493365 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.493478 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.493590 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.493701 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.493819 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] role.caching = True {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.493931 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.494119 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] role.driver = sql {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.494119 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.494332 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.494332 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.494542 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.494653 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.494772 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.494890 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] role.caching = True {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.495019 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.495207 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] role.driver = sql {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.495338 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.495465 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.495580 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.495692 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.495803 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.495915 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.496027 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.496147 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.496260 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.496260 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.496468 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.496579 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.496691 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.496810 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.496924 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.497035 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.497146 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.497258 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.497369 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.497369 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.497590 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.497704 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.497815 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.497926 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.498037 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.498156 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.498268 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.498380 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.498828 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.498828 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.499040 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.499160 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.499330 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.499445 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.499557 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.499669 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.499780 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.499903 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.500016 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.500128 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.500239 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.500350 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.500468 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.500581 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.500691 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.500802 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.500913 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.501024 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.501142 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.501255 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.501366 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.501476 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.501586 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.501698 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.501816 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.501930 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.502040 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.502152 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] token.caching = True {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.502262 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.502376 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.502494 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.502607 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.502718 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.502829 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.502941 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.503053 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.503172 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.503301 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.503415 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] token.caching = True {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.503527 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.503638 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.503748 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.503870 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.503985 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.504097 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.504208 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.504318 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.504429 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.504548 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.504661 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.504772 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.504885 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.504995 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.505107 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.505226 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.505338 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.505449 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.505560 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.505679 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.505799 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.505912 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.506031 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.506145 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.506256 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] database.connection = **** {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.506367 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.506477 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.506588 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.506707 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.506820 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.506939 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.507059 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.507174 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.507174 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.507402 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.507515 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.507637 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] database.connection = **** {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.507751 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.507863 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.507974 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.508085 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.508198 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.508317 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.508429 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.508540 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.508651 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.508763 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.508873 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.508997 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.509111 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.509223 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.509334 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.509445 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.509555 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.509675 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.509788 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.509900 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.510011 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.510122 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.510233 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.510354 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.510468 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 09 00:40:59.510580 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.510580 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.510580 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.510580 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.510580 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.510580 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 09 00:40:59.510580 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 09 00:40:59.538281 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81525) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 09 00:40:59.538424 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81524) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 09 00:40:59.538552 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81525) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 09 00:40:59.538636 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81524) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 09 00:40:59.538699 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81525) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 09 00:40:59.538773 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81524) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 09 00:40:59.547094 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81525) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 09 00:40:59.547292 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81524) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 09 00:40:59.575233 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81525) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 09 00:40:59.575419 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81524) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 09 00:40:59.575559 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81524) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 09 00:40:59.575638 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81525) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 09 00:40:59.629018 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81525) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 09 00:40:59.629576 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81524) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 09 00:40:59.677151 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81525) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 09 00:40:59.677354 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81525) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 09 00:40:59.678003 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81524) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 09 00:40:59.678239 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81524) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 09 00:40:59.837530 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81524) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 09 00:40:59.837738 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81525) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 09 00:40:59.837868 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81524) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 09 00:40:59.837949 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81525) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 09 00:40:59.838011 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81524) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 09 00:40:59.838150 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81525) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 09 00:40:59.838232 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81524) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 09 00:40:59.838295 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81525) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 09 00:40:59.838411 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81524) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 09 00:40:59.838526 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81525) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 09 00:40:59.838611 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81524) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 09 00:40:59.838719 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81525) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 09 00:40:59.862677 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81524) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 09 00:40:59.862853 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81525) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 09 00:40:59.862987 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81524) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 09 00:40:59.863077 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81525) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 09 00:40:59.863165 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81524) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 09 00:40:59.863242 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81525) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 09 00:40:59.863440 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81524) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 09 00:40:59.863564 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81525) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 09 00:40:59.863702 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81524) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 09 00:40:59.863802 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81525) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 09 00:40:59.863948 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81524) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 09 00:40:59.864042 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81525) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 09 00:40:59.864105 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81524) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 09 00:40:59.864225 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81525) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 09 00:40:59.875773 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81524) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 09 00:40:59.875917 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81525) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 09 00:40:59.889010 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81524) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 09 00:40:59.889161 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81525) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 09 00:40:59.889287 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81524) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 09 00:40:59.889370 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81525) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 09 00:40:59.889450 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81524) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 09 00:40:59.889582 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81525) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 09 00:40:59.889667 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81524) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 09 00:40:59.889816 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81525) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 09 00:40:59.889942 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81524) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 09 00:40:59.890094 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81525) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 09 00:40:59.890177 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81524) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 09 00:40:59.890239 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81525) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 09 00:40:59.890305 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81524) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 09 00:40:59.890376 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81525) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 09 00:40:59.907552 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:40:59.907765 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 09 00:40:59.907970 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81525) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:40:59.908070 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:40:59.908136 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81525) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 09 00:40:59.908262 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 09 00:40:59.908502 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81525) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:40:59.908629 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:40:59.908759 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81525) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 09 00:40:59.908842 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:40:59.908937 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81525) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:40:59.909037 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:40:59.909229 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81525) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:40:59.909355 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:40:59.909492 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81525) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:40:59.909727 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81525) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:40:59.919092 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:40:59.919401 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:40:59.919525 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81525) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:40:59.919665 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:40:59.919746 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81525) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:40:59.919950 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:40:59.920095 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81525) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:40:59.920234 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81525) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:40:59.926892 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81524) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 09 00:40:59.927117 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81525) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 09 00:40:59.929819 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81524) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 09 00:40:59.929965 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81525) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 09 00:40:59.930168 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:40:59.930252 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81525) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:40:59.930359 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:40:59.930567 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81525) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:40:59.930692 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:40:59.930836 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81525) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:40:59.930921 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:40:59.931092 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81525) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:40:59.931217 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:40:59.931385 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81525) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:40:59.931527 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:40:59.931609 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81525) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:40:59.931715 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:40:59.931922 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81525) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:40:59.932046 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:40:59.932198 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81525) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:40:59.932280 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:40:59.932401 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81525) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:40:59.932479 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:40:59.932705 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81525) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:40:59.955220 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:40:59.955386 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81525) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:40:59.956698 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81525) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 09 00:40:59.956823 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81524) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 09 00:40:59.956962 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81525) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:40:59.957042 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:40:59.961611 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81525) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 09 00:40:59.961737 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81524) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 09 00:40:59.961866 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81525) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:40:59.961949 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:40:59.962165 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81525) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:40:59.962310 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:40:59.968543 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81525) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 09 00:40:59.968671 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81524) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 09 00:40:59.968801 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81525) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:40:59.968883 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:40:59.974497 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81525) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 09 00:40:59.974646 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81524) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 09 00:40:59.974785 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81525) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:40:59.974907 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:40:59.975058 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81525) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:40:59.975184 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:40:59.975355 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81525) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:40:59.975477 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:40:59.975611 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81525) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:40:59.975778 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:40:59.975904 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81525) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:40:59.976054 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:40:59.976137 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81525) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:40:59.976320 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:40:59.976445 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81525) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:40:59.976582 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:40:59.991853 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81525) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:40:59.992105 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81525) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:40:59.992240 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:40:59.992532 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:40:59.996035 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81525) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 09 00:40:59.996475 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81524) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 09 00:40:59.999593 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81525) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:40:59.999863 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81525) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:41:00.000037 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:41:00.000855 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:41:00.004073 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81525) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 09 00:41:00.005677 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81524) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 09 00:41:00.007227 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81525) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 09 00:41:00.008878 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81524) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 09 00:41:00.010432 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81525) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:41:00.010809 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81525) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:41:00.011096 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81525) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:41:00.011403 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81525) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:41:00.011681 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81525) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:41:00.011986 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81525) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:41:00.012195 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:41:00.012501 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:41:00.012788 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:41:00.013079 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:41:00.013358 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:41:00.013647 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:41:00.027712 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81525) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 09 00:41:00.027984 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81525) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:41:00.028261 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81525) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:41:00.028522 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81525) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:41:00.029558 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81524) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 09 00:41:00.029852 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:41:00.030113 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:41:00.030376 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:41:00.035313 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81525) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:41:00.036876 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81525) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:41:00.037250 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:41:00.038388 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81525) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:41:00.038661 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81525) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:41:00.038785 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:41:00.040359 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:41:00.040642 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:41:00.041400 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81525) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 09 00:41:00.041687 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81525) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:41:00.042051 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81525) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:41:00.042345 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81525) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:41:00.042736 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81525) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:41:00.043484 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81524) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 09 00:41:00.043776 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:41:00.044079 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:41:00.044348 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:41:00.044744 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:41:00.053871 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81525) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 09 00:41:00.054164 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81525) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:41:00.054442 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81525) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:41:00.054725 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81525) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:41:00.055100 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81525) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:41:00.055408 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81525) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:41:00.055699 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81525) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:41:00.055924 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81524) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 09 00:41:00.056216 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:41:00.056505 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:41:00.056789 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:41:00.057155 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:41:00.057448 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:41:00.057803 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:41:00.071099 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81525) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 09 00:41:00.073283 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81524) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 09 00:41:00.074073 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81525) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 09 00:41:00.076226 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81524) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 09 00:41:00.076976 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81525) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:41:00.078509 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81525) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:41:00.079111 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:41:00.079966 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81525) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 09 00:41:00.080274 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81525) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:41:00.080679 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81525) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:41:00.080887 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:41:00.082143 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81524) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 09 00:41:00.082429 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:41:00.082819 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:41:00.087133 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81525) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:41:00.088603 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81525) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 09 00:41:00.089259 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:41:00.090704 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81524) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 09 00:41:00.091555 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81525) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:41:00.091928 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81525) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:41:00.092233 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81525) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:41:00.092505 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81525) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:41:00.093613 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:41:00.094000 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:41:00.094302 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:41:00.094579 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:41:00.100284 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81525) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 09 00:41:00.100578 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81525) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:41:00.100864 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81525) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:41:00.102414 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81524) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 09 00:41:00.102710 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:41:00.102994 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:41:00.107867 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81525) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 09 00:41:00.108154 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81525) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:41:00.108434 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81525) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:41:00.108704 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81525) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:41:00.108975 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81525) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:41:00.109254 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81525) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:41:00.109522 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81525) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:41:00.109801 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81525) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:41:00.109938 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81524) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 09 00:41:00.110111 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81525) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:41:00.110236 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:41:00.110399 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81525) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:41:00.110525 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:41:00.110737 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81525) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:41:00.110832 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:41:00.111001 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81525) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:41:00.111086 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:41:00.111295 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81525) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:41:00.111382 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:41:00.111569 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81525) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:41:00.111654 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:41:00.111861 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:41:00.112148 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:41:00.112437 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:41:00.112718 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:41:00.112979 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:41:00.113232 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:41:00.113503 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 09 00:41:00.145943 dv-cinder-master-3-smb devstack@keystone.service[81525]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5610a648c9c0 pid: 81525 (default app) Oct 09 00:41:00.148117 dv-cinder-master-3-smb devstack@keystone.service[81524]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5610a648c9c0 pid: 81524 (default app) Oct 09 00:41:00.149372 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5abdcb2-1030-47ef-8b29-e32c5d86cf0b None None] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:41:00.149653 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5abdcb2-1030-47ef-8b29-e32c5d86cf0b None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:41:00.149925 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5abdcb2-1030-47ef-8b29-e32c5d86cf0b None None] PATH_INFO: `/v3` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:41:00.154224 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1/1] 10.222.0.15 () {50 vars in 791 bytes} [Sun Oct 9 00:41:00 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:41:06.912177 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15e8608-2a6b-4ca1-8efd-bb5cbf437aa8 None None] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:41:06.912706 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15e8608-2a6b-4ca1-8efd-bb5cbf437aa8 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:41:06.912706 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15e8608-2a6b-4ca1-8efd-bb5cbf437aa8 None None] PATH_INFO: `/` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:41:06.917036 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1/2] 10.222.0.15 () {54 vars in 927 bytes} [Sun Oct 9 00:41:06 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 09 00:41:06.922641 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb235b1-674d-44b3-a78b-81ca033cdf72 None None] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:41:06.923121 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb235b1-674d-44b3-a78b-81ca033cdf72 None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:41:06.923121 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb235b1-674d-44b3-a78b-81ca033cdf72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:41:06.992891 dv-cinder-master-3-smb devstack@keystone.service[81525]: INFO dbcounter [None req-dfb235b1-674d-44b3-a78b-81ca033cdf72 None None] Registered counter for database keystone Oct 09 00:41:07.012477 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG oslo_db.sqlalchemy.engines [None req-dfb235b1-674d-44b3-a78b-81ca033cdf72 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81525) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 09 00:41:07.019296 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writer thread running {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 09 00:41:07.197244 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG passlib.handlers.bcrypt [None req-dfb235b1-674d-44b3-a78b-81ca033cdf72 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81525) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Oct 09 00:41:07.197537 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG passlib.handlers.bcrypt [None req-dfb235b1-674d-44b3-a78b-81ca033cdf72 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81525) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Oct 09 00:41:07.255791 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.auth.core [None req-dfb235b1-674d-44b3-a78b-81ca033cdf72 None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:41:07.257399 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-dfb235b1-674d-44b3-a78b-81ca033cdf72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:41:07.390402 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 2/3] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Oct 9 00:41:06 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 469 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 09 00:41:07.855448 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15e8608-2a6b-4ca1-8efd-bb5cbf437aa8 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:41:07.925552 dv-cinder-master-3-smb devstack@keystone.service[81524]: INFO dbcounter [None req-f15e8608-2a6b-4ca1-8efd-bb5cbf437aa8 None None] Registered counter for database keystone Oct 09 00:41:07.947427 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG oslo_db.sqlalchemy.engines [None req-f15e8608-2a6b-4ca1-8efd-bb5cbf437aa8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81524) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 09 00:41:07.955050 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writer thread running {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 09 00:41:08.072970 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15e8608-2a6b-4ca1-8efd-bb5cbf437aa8 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:41:08.077717 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af43a46-2c82-46eb-8823-50ce8b641dce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:41:08.078311 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af43a46-2c82-46eb-8823-50ce8b641dce admin admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:41:08.078603 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af43a46-2c82-46eb-8823-50ce8b641dce admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:41:08.078870 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af43a46-2c82-46eb-8823-50ce8b641dce admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:41:08.088266 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af43a46-2c82-46eb-8823-50ce8b641dce admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:41:08.140836 dv-cinder-master-3-smb devstack@keystone.service[81524]: WARNING keystone.common.rbac_enforcer.enforcer [None req-0af43a46-2c82-46eb-8823-50ce8b641dce admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Oct 09 00:41:08.141175 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af43a46-2c82-46eb-8823-50ce8b641dce admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:41:08.151352 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 2/4] 10.222.0.15 () {58 vars in 1324 bytes} [Sun Oct 9 00:41:07 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 09 00:41:08.157630 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb235b1-674d-44b3-a78b-81ca033cdf72 None None] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:41:08.174935 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb235b1-674d-44b3-a78b-81ca033cdf72 None None] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:41:08.179822 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc2ade9-03df-4309-87e2-cc596d85a74e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:41:08.180938 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc2ade9-03df-4309-87e2-cc596d85a74e admin admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:41:08.181212 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc2ade9-03df-4309-87e2-cc596d85a74e admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:41:08.181475 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc2ade9-03df-4309-87e2-cc596d85a74e admin admin] PATH_INFO: `/v3/projects/4024dc4bc9484e24953f0b564215ab2a` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:41:08.183158 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc2ade9-03df-4309-87e2-cc596d85a74e admin admin] RBAC: Authorizing `identity:get_project(project_id=4024dc4bc9484e24953f0b564215ab2a)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:41:08.237280 dv-cinder-master-3-smb devstack@keystone.service[81525]: WARNING keystone.common.rbac_enforcer.enforcer [None req-9cc2ade9-03df-4309-87e2-cc596d85a74e admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Oct 09 00:41:08.237620 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc2ade9-03df-4309-87e2-cc596d85a74e admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:41:08.242254 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 3/5] 10.222.0.15 () {56 vars in 1207 bytes} [Sun Oct 9 00:41:08 2022] GET /identity/v3/projects/4024dc4bc9484e24953f0b564215ab2a => generated 344 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:41:10.349087 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745676a5-bfe1-409b-a15f-b67565c5cf66 None None] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:41:10.349675 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745676a5-bfe1-409b-a15f-b67565c5cf66 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:41:10.349675 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745676a5-bfe1-409b-a15f-b67565c5cf66 None None] PATH_INFO: `/` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:41:10.353749 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 3/6] 10.222.0.15 () {54 vars in 927 bytes} [Sun Oct 9 00:41:10 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:41:10.359857 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa1477a-6767-41bc-a4a6-c9f61642ab1a None None] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:41:10.360317 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa1477a-6767-41bc-a4a6-c9f61642ab1a None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:41:10.360408 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa1477a-6767-41bc-a4a6-c9f61642ab1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:41:10.381285 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.auth.core [None req-cfa1477a-6767-41bc-a4a6-c9f61642ab1a None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:41:10.382835 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-cfa1477a-6767-41bc-a4a6-c9f61642ab1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:41:10.391366 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 4/7] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Oct 9 00:41:10 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Oct 09 00:41:10.652497 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745676a5-bfe1-409b-a15f-b67565c5cf66 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:41:10.666578 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745676a5-bfe1-409b-a15f-b67565c5cf66 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:41:10.671616 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b14be8-e988-4b1a-9ef9-f374497a5663 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:41:10.672225 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b14be8-e988-4b1a-9ef9-f374497a5663 admin admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:41:10.672503 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b14be8-e988-4b1a-9ef9-f374497a5663 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:41:10.672768 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b14be8-e988-4b1a-9ef9-f374497a5663 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:41:10.680696 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b14be8-e988-4b1a-9ef9-f374497a5663 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:41:10.682476 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b14be8-e988-4b1a-9ef9-f374497a5663 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:41:10.691497 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 4/8] 10.222.0.15 () {58 vars in 1324 bytes} [Sun Oct 9 00:41:10 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 09 00:41:10.697443 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa1477a-6767-41bc-a4a6-c9f61642ab1a None None] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:41:10.708928 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa1477a-6767-41bc-a4a6-c9f61642ab1a None None] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:41:10.716703 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e721f2a1-4269-4a2e-bbcf-dc0ec194595a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:41:10.717347 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e721f2a1-4269-4a2e-bbcf-dc0ec194595a admin admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:41:10.717621 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e721f2a1-4269-4a2e-bbcf-dc0ec194595a admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:41:10.717884 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e721f2a1-4269-4a2e-bbcf-dc0ec194595a admin admin] PATH_INFO: `/v3/users/99441f7488cd4b83be4affd132b7c074` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:41:10.719385 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e721f2a1-4269-4a2e-bbcf-dc0ec194595a admin admin] RBAC: Authorizing `identity:get_user(user_id=99441f7488cd4b83be4affd132b7c074)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:41:10.721248 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e721f2a1-4269-4a2e-bbcf-dc0ec194595a admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:41:10.722859 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 5/9] 10.222.0.15 () {56 vars in 1198 bytes} [Sun Oct 9 00:41:10 2022] GET /identity/v3/users/99441f7488cd4b83be4affd132b7c074 => generated 247 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:41:12.945507 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14795db0-0ae1-4ecc-9be3-da88713d16b6 None None] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:41:12.946064 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e10ec1a-1336-490a-9a68-3e60fe2da68c None None] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:41:12.946412 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14795db0-0ae1-4ecc-9be3-da88713d16b6 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:41:12.946510 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e10ec1a-1336-490a-9a68-3e60fe2da68c None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:41:12.946582 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14795db0-0ae1-4ecc-9be3-da88713d16b6 None None] PATH_INFO: `/` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:41:12.946646 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e10ec1a-1336-490a-9a68-3e60fe2da68c None None] PATH_INFO: `/` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:41:12.947409 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 5/10] 10.222.0.15 () {54 vars in 927 bytes} [Sun Oct 9 00:41:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:41:12.947732 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 6/11] 10.222.0.15 () {54 vars in 927 bytes} [Sun Oct 9 00:41:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:41:12.952633 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a72298-e084-4adc-9371-dcb709848753 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:41:12.952901 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a72298-e084-4adc-9371-dcb709848753 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:41:12.953177 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a72298-e084-4adc-9371-dcb709848753 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:41:12.953313 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5965c3b-f4cb-49f5-a911-a36e1974e38e None None] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:41:12.953530 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5965c3b-f4cb-49f5-a911-a36e1974e38e None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:41:12.953802 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5965c3b-f4cb-49f5-a911-a36e1974e38e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:41:12.972490 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.auth.core [None req-d5965c3b-f4cb-49f5-a911-a36e1974e38e None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:41:12.973690 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-d5965c3b-f4cb-49f5-a911-a36e1974e38e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:41:12.995650 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG passlib.handlers.bcrypt [None req-16a72298-e084-4adc-9371-dcb709848753 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81524) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Oct 09 00:41:12.996063 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG passlib.handlers.bcrypt [None req-16a72298-e084-4adc-9371-dcb709848753 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81524) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Oct 09 00:41:13.045352 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-16a72298-e084-4adc-9371-dcb709848753 None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:41:13.047189 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-16a72298-e084-4adc-9371-dcb709848753 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:41:13.061336 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 7/12] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Oct 9 00:41:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 09 00:41:13.154496 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 6/13] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Oct 9 00:41:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 09 00:41:13.321965 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5965c3b-f4cb-49f5-a911-a36e1974e38e None None] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:41:13.349333 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:41:13.421910 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a72298-e084-4adc-9371-dcb709848753 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:41:13.443904 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5965c3b-f4cb-49f5-a911-a36e1974e38e None None] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:41:13.484314 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563fbf79-3de9-49b6-9ced-0af9602215c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:41:13.484935 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563fbf79-3de9-49b6-9ced-0af9602215c0 None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:41:13.485206 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563fbf79-3de9-49b6-9ced-0af9602215c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:41:13.485476 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563fbf79-3de9-49b6-9ced-0af9602215c0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:41:13.539276 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a72298-e084-4adc-9371-dcb709848753 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:41:13.541613 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:41:13.568859 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563fbf79-3de9-49b6-9ced-0af9602215c0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:41:13.570351 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563fbf79-3de9-49b6-9ced-0af9602215c0 None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:41:13.582426 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b582012-bb09-4e75-89bf-7cfa994b07ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:41:13.583526 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b582012-bb09-4e75-89bf-7cfa994b07ae None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:41:13.583805 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b582012-bb09-4e75-89bf-7cfa994b07ae None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:41:13.584069 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b582012-bb09-4e75-89bf-7cfa994b07ae None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:41:13.595079 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:41:13.599298 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b582012-bb09-4e75-89bf-7cfa994b07ae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 09 00:41:13.608012 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application [None req-5b582012-bb09-4e75-89bf-7cfa994b07ae None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 09 00:41:13.608012 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:41:13.608012 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:41:13.608012 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:41:13.608012 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:41:13.608012 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:41:13.608012 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:41:13.608012 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:41:13.608012 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:41:13.608012 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:41:13.608012 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:41:13.608012 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:41:13.608012 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 09 00:41:13.608012 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 09 00:41:13.608012 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 09 00:41:13.608012 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 09 00:41:13.608995 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 09 00:41:13.608995 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 09 00:41:13.608995 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 09 00:41:13.608995 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 09 00:41:13.608995 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:41:13.608995 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:41:13.608995 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:41:13.608995 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:41:13.608995 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:41:13.608995 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:41:13.608995 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:41:13.608995 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application with Lock( Oct 09 00:41:13.608995 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:41:13.608995 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:41:13.608995 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:41:13.608995 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:41:13.609876 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:41:13.609876 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:41:13.609876 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:41:13.609876 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:41:13.609876 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 09 00:41:13.609876 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 09 00:41:13.609876 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 09 00:41:13.609876 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 09 00:41:13.609876 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 09 00:41:13.609876 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 09 00:41:13.609876 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 09 00:41:13.609876 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application Oct 09 00:41:13.609876 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 7/14] 10.222.0.15 () {56 vars in 1096 bytes} [Sun Oct 9 00:41:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:41:13.618025 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b582012-bb09-4e75-89bf-7cfa994b07ae None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:41:13.674690 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 8/15] 10.222.0.15 () {58 vars in 1282 bytes} [Sun Oct 9 00:41:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 09 00:41:13.680906 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563fbf79-3de9-49b6-9ced-0af9602215c0 None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:41:13.740580 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b582012-bb09-4e75-89bf-7cfa994b07ae None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:41:13.777575 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf66e058-0427-449e-b6ba-6b86b84f4d90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:41:13.778359 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf66e058-0427-449e-b6ba-6b86b84f4d90 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:41:13.778625 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf66e058-0427-449e-b6ba-6b86b84f4d90 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:41:13.778920 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf66e058-0427-449e-b6ba-6b86b84f4d90 None admin] PATH_INFO: `/v3/roles` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:41:13.779639 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf66e058-0427-449e-b6ba-6b86b84f4d90 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:41:13.779934 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf66e058-0427-449e-b6ba-6b86b84f4d90 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:41:13.781395 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf66e058-0427-449e-b6ba-6b86b84f4d90 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:41:13.785237 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563fbf79-3de9-49b6-9ced-0af9602215c0 None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:41:13.794070 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 8/16] 10.222.0.15 () {56 vars in 1099 bytes} [Sun Oct 9 00:41:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:41:13.800075 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf66e058-0427-449e-b6ba-6b86b84f4d90 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:41:13.809651 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:41:13.822720 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2650df-2673-4853-8e11-55f80a872ed7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:41:13.823284 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2650df-2673-4853-8e11-55f80a872ed7 None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:41:13.823764 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2650df-2673-4853-8e11-55f80a872ed7 None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:41:13.823858 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2650df-2673-4853-8e11-55f80a872ed7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:41:13.834962 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2650df-2673-4853-8e11-55f80a872ed7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:41:13.836302 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:41:13.836428 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2650df-2673-4853-8e11-55f80a872ed7 None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:41:13.860933 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application [None req-ce2650df-2673-4853-8e11-55f80a872ed7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:41:13.860933 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:41:13.860933 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:41:13.860933 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:41:13.860933 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:41:13.860933 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:41:13.860933 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:41:13.860933 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:41:13.860933 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:41:13.860933 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:41:13.860933 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:41:13.860933 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:41:13.860933 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 09 00:41:13.860933 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 09 00:41:13.860933 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 09 00:41:13.860933 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 09 00:41:13.862068 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:41:13.862068 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:41:13.862068 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:41:13.862068 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:41:13.862068 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:41:13.862068 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:41:13.862068 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:41:13.862068 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application with Lock( Oct 09 00:41:13.862068 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:41:13.862068 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:41:13.862068 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:41:13.862068 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:41:13.862068 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:41:13.862068 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:41:13.862068 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:41:13.862068 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:41:13.862068 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 09 00:41:13.863105 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 09 00:41:13.863105 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:41:13.863105 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Oct 09 00:41:13.863105 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 9/17] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Oct 9 00:41:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 09 00:41:13.868241 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2650df-2673-4853-8e11-55f80a872ed7 None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:41:13.917946 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf66e058-0427-449e-b6ba-6b86b84f4d90 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:41:13.956218 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba34b3b5-5e8e-4faa-8b9d-ff0982549759 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:41:13.956876 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba34b3b5-5e8e-4faa-8b9d-ff0982549759 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:41:13.957126 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba34b3b5-5e8e-4faa-8b9d-ff0982549759 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:41:13.957390 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba34b3b5-5e8e-4faa-8b9d-ff0982549759 None admin] PATH_INFO: `/v3/users/99441f7488cd4b83be4affd132b7c074` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:41:13.958909 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba34b3b5-5e8e-4faa-8b9d-ff0982549759 None admin] RBAC: Authorizing `identity:get_user(user_id=99441f7488cd4b83be4affd132b7c074)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:41:13.960410 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba34b3b5-5e8e-4faa-8b9d-ff0982549759 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:41:13.961988 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 9/18] 10.222.0.15 () {56 vars in 1177 bytes} [Sun Oct 9 00:41:13 2022] GET /identity/v3/users/99441f7488cd4b83be4affd132b7c074 => generated 247 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:41:13.968164 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba34b3b5-5e8e-4faa-8b9d-ff0982549759 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:41:13.982061 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2650df-2673-4853-8e11-55f80a872ed7 None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:41:14.020137 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1c5c45-347e-4ca6-b5e8-87d52160348a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:41:14.020760 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1c5c45-347e-4ca6-b5e8-87d52160348a None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:41:14.021033 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1c5c45-347e-4ca6-b5e8-87d52160348a None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:41:14.021295 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1c5c45-347e-4ca6-b5e8-87d52160348a None admin] PATH_INFO: `/v3/domains` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:41:14.021944 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1c5c45-347e-4ca6-b5e8-87d52160348a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:41:14.022239 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1c5c45-347e-4ca6-b5e8-87d52160348a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:41:14.023676 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1c5c45-347e-4ca6-b5e8-87d52160348a None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:41:14.041117 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 10/19] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Oct 9 00:41:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:41:14.077086 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:41:14.085216 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba34b3b5-5e8e-4faa-8b9d-ff0982549759 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:41:14.129645 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ac9318-05a8-420e-99c0-701797beead6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:41:14.129920 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ac9318-05a8-420e-99c0-701797beead6 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:41:14.130075 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ac9318-05a8-420e-99c0-701797beead6 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:41:14.130344 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ac9318-05a8-420e-99c0-701797beead6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:41:14.131603 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ac9318-05a8-420e-99c0-701797beead6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:41:14.133118 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ac9318-05a8-420e-99c0-701797beead6 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:41:14.135034 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 10/20] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Oct 9 00:41:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:41:14.141264 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1c5c45-347e-4ca6-b5e8-87d52160348a None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:41:14.182504 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:41:14.258029 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1c5c45-347e-4ca6-b5e8-87d52160348a None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:41:14.297798 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b592063-18e4-48b7-ab45-ec8393500ab8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:41:14.298634 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b592063-18e4-48b7-ab45-ec8393500ab8 None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:41:14.298733 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b592063-18e4-48b7-ab45-ec8393500ab8 None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:41:14.298946 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b592063-18e4-48b7-ab45-ec8393500ab8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:41:14.299780 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b592063-18e4-48b7-ab45-ec8393500ab8 None admin] RBAC: Adding query filter params (role.id=f69dddf26daf4dd79d4c962beb877af5, scope.domain.id=default, user.id=99441f7488cd4b83be4affd132b7c074) {{(pid=81525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:41:14.300084 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b592063-18e4-48b7-ab45-ec8393500ab8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:41:14.301574 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b592063-18e4-48b7-ab45-ec8393500ab8 None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:41:14.309121 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 11/21] 10.222.0.15 () {56 vars in 1322 bytes} [Sun Oct 9 00:41:14 2022] GET /identity/v3/role_assignments?user.id=99441f7488cd4b83be4affd132b7c074&scope.domain.id=default&role.id=f69dddf26daf4dd79d4c962beb877af5 => generated 233 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:41:16.817587 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55ca9c0-80c4-4aa3-a467-0f7b448b6444 None None] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:41:16.818095 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55ca9c0-80c4-4aa3-a467-0f7b448b6444 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:41:16.818095 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55ca9c0-80c4-4aa3-a467-0f7b448b6444 None None] PATH_INFO: `/` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:41:16.819413 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 11/22] 10.222.0.15 () {54 vars in 927 bytes} [Sun Oct 9 00:41:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:41:16.825231 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ae8a48-2ebe-4dcc-a385-319c2eeaa2ad None None] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:41:16.825706 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ae8a48-2ebe-4dcc-a385-319c2eeaa2ad None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:41:16.825805 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ae8a48-2ebe-4dcc-a385-319c2eeaa2ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:41:16.857141 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.auth.core [None req-f7ae8a48-2ebe-4dcc-a385-319c2eeaa2ad None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:41:16.858686 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-f7ae8a48-2ebe-4dcc-a385-319c2eeaa2ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:41:16.952080 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 12/23] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Oct 9 00:41:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 09 00:41:17.119080 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20af437c-8507-4b76-b41d-5b0903b4c688 None None] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:41:17.119368 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20af437c-8507-4b76-b41d-5b0903b4c688 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:41:17.119624 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20af437c-8507-4b76-b41d-5b0903b4c688 None None] PATH_INFO: `/` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:41:17.121198 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 12/24] 10.222.0.15 () {54 vars in 927 bytes} [Sun Oct 9 00:41:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:41:17.127787 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b76392b-6053-4ea8-b7ef-f6f01d201333 None None] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:41:17.128365 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b76392b-6053-4ea8-b7ef-f6f01d201333 None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:41:17.128863 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b76392b-6053-4ea8-b7ef-f6f01d201333 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:41:17.156343 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.auth.core [None req-5b76392b-6053-4ea8-b7ef-f6f01d201333 None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:41:17.157933 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-5b76392b-6053-4ea8-b7ef-f6f01d201333 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:41:17.186087 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:41:17.240417 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 13/25] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Oct 9 00:41:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 09 00:41:17.330897 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7291e3-6d11-4b22-9c70-e3d898928f21 None None] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:41:17.331244 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7291e3-6d11-4b22-9c70-e3d898928f21 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:41:17.331476 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7291e3-6d11-4b22-9c70-e3d898928f21 None None] PATH_INFO: `/` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:41:17.332976 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 13/26] 10.222.0.15 () {54 vars in 927 bytes} [Sun Oct 9 00:41:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:41:17.338692 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac09919-3b43-4ef4-98df-29904ea68982 None None] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:41:17.339281 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac09919-3b43-4ef4-98df-29904ea68982 None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:41:17.339775 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac09919-3b43-4ef4-98df-29904ea68982 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:41:17.369361 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.auth.core [None req-1ac09919-3b43-4ef4-98df-29904ea68982 None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:41:17.371035 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-1ac09919-3b43-4ef4-98df-29904ea68982 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:41:17.409982 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7291e3-6d11-4b22-9c70-e3d898928f21 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:41:17.455441 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 14/27] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Oct 9 00:41:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 09 00:41:17.457255 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cf5d31-ec3e-4d05-9dfa-a5490a55fa37 None None] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:41:17.457871 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cf5d31-ec3e-4d05-9dfa-a5490a55fa37 None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:41:17.458358 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cf5d31-ec3e-4d05-9dfa-a5490a55fa37 None None] PATH_INFO: `/` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:41:17.462097 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 15/28] 10.222.0.15 () {54 vars in 927 bytes} [Sun Oct 9 00:41:17 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:41:17.468132 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016ef9ae-0a25-4a96-b5f1-65246e7e4840 None None] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:41:17.469191 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016ef9ae-0a25-4a96-b5f1-65246e7e4840 None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:41:17.469683 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016ef9ae-0a25-4a96-b5f1-65246e7e4840 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:41:17.500541 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.auth.core [None req-016ef9ae-0a25-4a96-b5f1-65246e7e4840 None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:41:17.502091 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-016ef9ae-0a25-4a96-b5f1-65246e7e4840 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:41:17.641335 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 16/29] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Oct 9 00:41:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 09 00:41:17.644957 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7291e3-6d11-4b22-9c70-e3d898928f21 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:41:17.694705 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c088173c-d256-4a0f-93b8-0424432b3fb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:41:17.695367 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c088173c-d256-4a0f-93b8-0424432b3fb8 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:41:17.695647 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c088173c-d256-4a0f-93b8-0424432b3fb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:41:17.695924 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c088173c-d256-4a0f-93b8-0424432b3fb8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:41:17.718985 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c088173c-d256-4a0f-93b8-0424432b3fb8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:41:17.720520 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c088173c-d256-4a0f-93b8-0424432b3fb8 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:41:17.743552 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application [None req-c088173c-d256-4a0f-93b8-0424432b3fb8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:41:17.743552 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:41:17.743552 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:41:17.743552 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:41:17.743552 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:41:17.743552 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:41:17.743552 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:41:17.743552 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:41:17.743552 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:41:17.743552 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:41:17.743552 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:41:17.743552 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:41:17.743552 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 09 00:41:17.743552 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 09 00:41:17.743552 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 09 00:41:17.743552 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 09 00:41:17.744459 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:41:17.744459 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:41:17.744459 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:41:17.744459 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:41:17.744459 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:41:17.744459 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:41:17.744459 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:41:17.744459 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application with Lock( Oct 09 00:41:17.744459 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:41:17.744459 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:41:17.744459 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:41:17.744459 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:41:17.744459 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:41:17.744459 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:41:17.744459 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:41:17.744459 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:41:17.744459 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 09 00:41:17.745342 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 09 00:41:17.745342 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:41:17.745342 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application Oct 09 00:41:17.745342 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 14/30] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Oct 9 00:41:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 335 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 09 00:41:17.756436 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016ef9ae-0a25-4a96-b5f1-65246e7e4840 None None] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:41:17.758844 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c088173c-d256-4a0f-93b8-0424432b3fb8 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:41:17.775447 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:41:17.804570 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:41:17.870847 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c088173c-d256-4a0f-93b8-0424432b3fb8 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:41:17.906273 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205b2ad0-4c0a-442c-9c0c-3732f849888e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:41:17.906818 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205b2ad0-4c0a-442c-9c0c-3732f849888e None admin] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:41:17.907093 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205b2ad0-4c0a-442c-9c0c-3732f849888e None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:41:17.907396 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205b2ad0-4c0a-442c-9c0c-3732f849888e None admin] PATH_INFO: `/v3/roles` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:41:17.908085 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205b2ad0-4c0a-442c-9c0c-3732f849888e None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:41:17.909513 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205b2ad0-4c0a-442c-9c0c-3732f849888e None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:41:18.019637 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016ef9ae-0a25-4a96-b5f1-65246e7e4840 None None] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:41:18.048686 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 15/31] 10.222.0.15 () {60 vars in 1131 bytes} [Sun Oct 9 00:41:17 2022] POST /identity/v3/roles => generated 219 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 09 00:41:18.049729 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205b2ad0-4c0a-442c-9c0c-3732f849888e None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:41:18.091848 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a7835d-868a-490c-a14a-3a2c61ee27db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:41:18.092523 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a7835d-868a-490c-a14a-3a2c61ee27db None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:41:18.092842 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a7835d-868a-490c-a14a-3a2c61ee27db None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:41:18.093116 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a7835d-868a-490c-a14a-3a2c61ee27db None admin] PATH_INFO: `/v3/domains` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:41:18.093789 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a7835d-868a-490c-a14a-3a2c61ee27db None admin] RBAC: Adding query filter params (name=Default) {{(pid=81525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:41:18.094089 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a7835d-868a-490c-a14a-3a2c61ee27db None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:41:18.095598 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a7835d-868a-490c-a14a-3a2c61ee27db None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:41:18.118719 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 17/32] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Oct 9 00:41:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 363 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:41:18.119779 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a7835d-868a-490c-a14a-3a2c61ee27db None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:41:18.138949 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:41:18.168341 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205b2ad0-4c0a-442c-9c0c-3732f849888e None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:41:18.213019 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00d9bde-c35f-4cf2-8623-e355fc094674 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:41:18.213697 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00d9bde-c35f-4cf2-8623-e355fc094674 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:41:18.214092 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00d9bde-c35f-4cf2-8623-e355fc094674 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:41:18.214369 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00d9bde-c35f-4cf2-8623-e355fc094674 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:41:18.227843 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00d9bde-c35f-4cf2-8623-e355fc094674 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 09 00:41:18.233536 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application [None req-b00d9bde-c35f-4cf2-8623-e355fc094674 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 09 00:41:18.233536 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:41:18.233536 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:41:18.233536 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:41:18.233536 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:41:18.233536 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:41:18.233536 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:41:18.233536 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:41:18.233536 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:41:18.233536 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:41:18.233536 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:41:18.233536 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:41:18.233536 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 09 00:41:18.233536 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 09 00:41:18.233536 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 09 00:41:18.233536 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 09 00:41:18.234473 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 09 00:41:18.234473 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 09 00:41:18.234473 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 09 00:41:18.234473 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 09 00:41:18.234473 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:41:18.234473 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:41:18.234473 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:41:18.234473 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:41:18.234473 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:41:18.234473 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:41:18.234473 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:41:18.234473 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application with Lock( Oct 09 00:41:18.234473 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:41:18.234473 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:41:18.234473 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:41:18.234473 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:41:18.235215 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:41:18.235215 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:41:18.235215 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:41:18.235215 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:41:18.235215 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 09 00:41:18.235215 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 09 00:41:18.235215 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 09 00:41:18.235215 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 09 00:41:18.235215 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 09 00:41:18.235215 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 09 00:41:18.235215 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 09 00:41:18.235215 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application Oct 09 00:41:18.235215 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 16/33] 10.222.0.15 () {56 vars in 1096 bytes} [Sun Oct 9 00:41:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:41:18.236669 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00d9bde-c35f-4cf2-8623-e355fc094674 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:41:18.302930 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:41:18.352161 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a7835d-868a-490c-a14a-3a2c61ee27db None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:41:18.355455 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00d9bde-c35f-4cf2-8623-e355fc094674 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:41:18.393781 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2974f5f6-fd40-4230-a0e6-338d5d3f2999 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:41:18.394429 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2974f5f6-fd40-4230-a0e6-338d5d3f2999 None admin] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:41:18.394711 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2974f5f6-fd40-4230-a0e6-338d5d3f2999 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:41:18.394983 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2974f5f6-fd40-4230-a0e6-338d5d3f2999 None admin] PATH_INFO: `/v3/projects` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:41:18.395710 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2974f5f6-fd40-4230-a0e6-338d5d3f2999 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:41:18.397416 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2974f5f6-fd40-4230-a0e6-338d5d3f2999 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:41:18.407383 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:41:18.416148 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d2f1aa-c034-4f6d-90e6-da458a7e8d51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:41:18.417213 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d2f1aa-c034-4f6d-90e6-da458a7e8d51 None admin] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:41:18.417765 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d2f1aa-c034-4f6d-90e6-da458a7e8d51 None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:41:18.418283 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d2f1aa-c034-4f6d-90e6-da458a7e8d51 None admin] PATH_INFO: `/v3/roles` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:41:18.419522 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d2f1aa-c034-4f6d-90e6-da458a7e8d51 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:41:18.421204 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d2f1aa-c034-4f6d-90e6-da458a7e8d51 None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:41:18.446759 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 17/34] 10.222.0.15 () {60 vars in 1141 bytes} [Sun Oct 9 00:41:18 2022] POST /identity/v3/projects => generated 301 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 09 00:41:18.449811 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2974f5f6-fd40-4230-a0e6-338d5d3f2999 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:41:18.563589 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 18/35] 10.222.0.15 () {60 vars in 1131 bytes} [Sun Oct 9 00:41:18 2022] POST /identity/v3/roles => generated 225 bytes in 444 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 09 00:41:18.564921 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3755d823-8569-402d-af0a-ffd5be308b54 None None] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:41:18.565213 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3755d823-8569-402d-af0a-ffd5be308b54 None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:41:18.565491 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3755d823-8569-402d-af0a-ffd5be308b54 None None] PATH_INFO: `/` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:41:18.567063 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 19/36] 10.222.0.15 () {54 vars in 927 bytes} [Sun Oct 9 00:41:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:41:18.568130 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489c6c4a-46e2-4776-99ff-7d3efcff9062 None None] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:41:18.574594 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489c6c4a-46e2-4776-99ff-7d3efcff9062 None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:41:18.574594 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489c6c4a-46e2-4776-99ff-7d3efcff9062 None None] PATH_INFO: `/` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:41:18.574594 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 20/37] 10.222.0.15 () {54 vars in 927 bytes} [Sun Oct 9 00:41:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:41:18.574594 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaa2fc5-ccdc-4897-8be0-8f483255e4c9 None None] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:41:18.574594 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaa2fc5-ccdc-4897-8be0-8f483255e4c9 None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:41:18.574594 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaa2fc5-ccdc-4897-8be0-8f483255e4c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:41:18.593841 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2974f5f6-fd40-4230-a0e6-338d5d3f2999 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:41:18.638093 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33cb0f5-f310-4ee6-b466-e5a5d6f134c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:41:18.638823 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33cb0f5-f310-4ee6-b466-e5a5d6f134c2 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:41:18.639108 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33cb0f5-f310-4ee6-b466-e5a5d6f134c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:41:18.639409 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33cb0f5-f310-4ee6-b466-e5a5d6f134c2 None admin] PATH_INFO: `/v3/roles` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:41:18.640140 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33cb0f5-f310-4ee6-b466-e5a5d6f134c2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:41:18.640447 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33cb0f5-f310-4ee6-b466-e5a5d6f134c2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:41:18.641991 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33cb0f5-f310-4ee6-b466-e5a5d6f134c2 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:41:18.654058 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 18/38] 10.222.0.15 () {56 vars in 1099 bytes} [Sun Oct 9 00:41:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:41:18.655728 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559b2391-b54e-42be-be62-68f423de2c19 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:41:18.656079 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559b2391-b54e-42be-be62-68f423de2c19 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:41:18.656363 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559b2391-b54e-42be-be62-68f423de2c19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:41:18.679085 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-559b2391-b54e-42be-be62-68f423de2c19 None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:41:18.680838 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-559b2391-b54e-42be-be62-68f423de2c19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:41:18.721995 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.auth.core [None req-4aaa2fc5-ccdc-4897-8be0-8f483255e4c9 None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:41:18.724200 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-4aaa2fc5-ccdc-4897-8be0-8f483255e4c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:41:18.745042 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:41:18.782050 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 19/39] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Oct 9 00:41:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 09 00:41:18.783397 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559b2391-b54e-42be-be62-68f423de2c19 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:41:18.821731 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 21/40] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Oct 9 00:41:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 09 00:41:18.895945 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559b2391-b54e-42be-be62-68f423de2c19 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:41:18.932298 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066e289f-af11-4451-b4c7-9cf1ad79c3c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:41:18.932943 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066e289f-af11-4451-b4c7-9cf1ad79c3c8 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:41:18.933187 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066e289f-af11-4451-b4c7-9cf1ad79c3c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:41:18.933476 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066e289f-af11-4451-b4c7-9cf1ad79c3c8 None admin] PATH_INFO: `/v3/users/99441f7488cd4b83be4affd132b7c074` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:41:18.934665 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066e289f-af11-4451-b4c7-9cf1ad79c3c8 None admin] RBAC: Authorizing `identity:get_user(user_id=99441f7488cd4b83be4affd132b7c074)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:41:18.936305 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066e289f-af11-4451-b4c7-9cf1ad79c3c8 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:41:18.938170 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 20/41] 10.222.0.15 () {56 vars in 1177 bytes} [Sun Oct 9 00:41:18 2022] GET /identity/v3/users/99441f7488cd4b83be4affd132b7c074 => generated 247 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:41:18.943888 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aaa2fc5-ccdc-4897-8be0-8f483255e4c9 None None] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:41:19.017797 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:41:19.044302 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066e289f-af11-4451-b4c7-9cf1ad79c3c8 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:41:19.054545 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aaa2fc5-ccdc-4897-8be0-8f483255e4c9 None None] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:41:19.089373 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ae59b7-f9a3-445f-a636-43e99dff59a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:41:19.090149 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ae59b7-f9a3-445f-a636-43e99dff59a7 None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:41:19.090542 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ae59b7-f9a3-445f-a636-43e99dff59a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:41:19.090830 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ae59b7-f9a3-445f-a636-43e99dff59a7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:41:19.092077 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ae59b7-f9a3-445f-a636-43e99dff59a7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:41:19.093720 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ae59b7-f9a3-445f-a636-43e99dff59a7 None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:41:19.095283 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:41:19.099931 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 22/42] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Oct 9 00:41:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:41:19.099931 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ae59b7-f9a3-445f-a636-43e99dff59a7 None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:41:19.159230 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066e289f-af11-4451-b4c7-9cf1ad79c3c8 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:41:19.194469 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f781fd9-2ddb-406f-95e8-35b3269d9234 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:41:19.195016 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f781fd9-2ddb-406f-95e8-35b3269d9234 None admin] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:41:19.195392 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f781fd9-2ddb-406f-95e8-35b3269d9234 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:41:19.195660 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f781fd9-2ddb-406f-95e8-35b3269d9234 None admin] PATH_INFO: `/v3/roles` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:41:19.196323 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f781fd9-2ddb-406f-95e8-35b3269d9234 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:41:19.197782 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f781fd9-2ddb-406f-95e8-35b3269d9234 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:41:19.204710 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ae59b7-f9a3-445f-a636-43e99dff59a7 None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:41:19.213475 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 21/43] 10.222.0.15 () {60 vars in 1131 bytes} [Sun Oct 9 00:41:19 2022] POST /identity/v3/roles => generated 223 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 09 00:41:19.214370 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f781fd9-2ddb-406f-95e8-35b3269d9234 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:41:19.250999 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288998b6-3b43-4179-ba72-9ac8747e4a25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:41:19.251931 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288998b6-3b43-4179-ba72-9ac8747e4a25 None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:41:19.252220 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288998b6-3b43-4179-ba72-9ac8747e4a25 None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:41:19.252552 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288998b6-3b43-4179-ba72-9ac8747e4a25 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:41:19.253866 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288998b6-3b43-4179-ba72-9ac8747e4a25 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:41:19.255548 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288998b6-3b43-4179-ba72-9ac8747e4a25 None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:41:19.257383 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 23/44] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Oct 9 00:41:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 09 00:41:19.263069 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288998b6-3b43-4179-ba72-9ac8747e4a25 None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:41:19.268158 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:41:19.325915 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f781fd9-2ddb-406f-95e8-35b3269d9234 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:41:19.334605 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:41:19.367950 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad156ee-fcd9-4180-aaf7-b0690d571b40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:41:19.368631 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad156ee-fcd9-4180-aaf7-b0690d571b40 None admin] REQUEST_METHOD: `PUT` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:41:19.368912 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad156ee-fcd9-4180-aaf7-b0690d571b40 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:41:19.369190 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad156ee-fcd9-4180-aaf7-b0690d571b40 None admin] PATH_INFO: `/v3/domains/default/users/99441f7488cd4b83be4affd132b7c074/roles/f69dddf26daf4dd79d4c962beb877af5` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:41:19.371682 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad156ee-fcd9-4180-aaf7-b0690d571b40 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=99441f7488cd4b83be4affd132b7c074, role_id=f69dddf26daf4dd79d4c962beb877af5)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:41:19.373157 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad156ee-fcd9-4180-aaf7-b0690d571b40 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:41:19.379114 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288998b6-3b43-4179-ba72-9ac8747e4a25 None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:41:19.390226 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 22/45] 10.222.0.15 () {58 vars in 1361 bytes} [Sun Oct 9 00:41:19 2022] PUT /identity/v3/domains/default/users/99441f7488cd4b83be4affd132b7c074/roles/f69dddf26daf4dd79d4c962beb877af5 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 00:41:19.422411 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b967e67-f853-47de-aa51-fcaa5f9add8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:41:19.423131 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b967e67-f853-47de-aa51-fcaa5f9add8c None admin] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:41:19.423450 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b967e67-f853-47de-aa51-fcaa5f9add8c None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:41:19.423730 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b967e67-f853-47de-aa51-fcaa5f9add8c None admin] PATH_INFO: `/v3/projects` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:41:19.424421 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b967e67-f853-47de-aa51-fcaa5f9add8c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:41:19.426077 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b967e67-f853-47de-aa51-fcaa5f9add8c None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:41:19.468939 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 24/46] 10.222.0.15 () {60 vars in 1141 bytes} [Sun Oct 9 00:41:19 2022] POST /identity/v3/projects => generated 312 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 09 00:41:21.555418 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebcd575-eb45-4ad8-8ec4-3d243ca4687e None None] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:41:21.555991 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebcd575-eb45-4ad8-8ec4-3d243ca4687e None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:41:21.555991 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebcd575-eb45-4ad8-8ec4-3d243ca4687e None None] PATH_INFO: `/` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:41:21.557317 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 23/47] 10.222.0.15 () {54 vars in 927 bytes} [Sun Oct 9 00:41:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:41:21.562776 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056fde1a-5b5c-405a-b2b4-554e0549271d None None] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:41:21.563182 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056fde1a-5b5c-405a-b2b4-554e0549271d None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:41:21.563399 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056fde1a-5b5c-405a-b2b4-554e0549271d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:41:21.585090 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.auth.core [None req-056fde1a-5b5c-405a-b2b4-554e0549271d None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:41:21.586309 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-056fde1a-5b5c-405a-b2b4-554e0549271d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:41:21.635722 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec69bf97-4c14-40d1-8a2b-124f53112a9b None None] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:41:21.636026 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec69bf97-4c14-40d1-8a2b-124f53112a9b None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:41:21.636306 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec69bf97-4c14-40d1-8a2b-124f53112a9b None None] PATH_INFO: `/` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:41:21.637692 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 24/48] 10.222.0.15 () {54 vars in 927 bytes} [Sun Oct 9 00:41:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 09 00:41:21.643436 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8fb639-9f6f-439a-aa0b-dbd7b9a9dfc0 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:41:21.643768 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8fb639-9f6f-439a-aa0b-dbd7b9a9dfc0 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:41:21.644067 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8fb639-9f6f-439a-aa0b-dbd7b9a9dfc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:41:21.651177 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:41:21.663320 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-af8fb639-9f6f-439a-aa0b-dbd7b9a9dfc0 None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:41:21.664566 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-af8fb639-9f6f-439a-aa0b-dbd7b9a9dfc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:41:21.671503 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 25/49] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Oct 9 00:41:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 09 00:41:21.734454 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 25/50] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Oct 9 00:41:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 09 00:41:21.930816 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056fde1a-5b5c-405a-b2b4-554e0549271d None None] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:41:21.995420 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8fb639-9f6f-439a-aa0b-dbd7b9a9dfc0 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:41:22.031270 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056fde1a-5b5c-405a-b2b4-554e0549271d None None] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:41:22.063838 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14664b43-8d61-4bba-bdad-7e979e748a3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:41:22.064469 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14664b43-8d61-4bba-bdad-7e979e748a3d None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:41:22.064743 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14664b43-8d61-4bba-bdad-7e979e748a3d None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:41:22.065012 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14664b43-8d61-4bba-bdad-7e979e748a3d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:41:22.076080 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14664b43-8d61-4bba-bdad-7e979e748a3d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 09 00:41:22.082718 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application [None req-14664b43-8d61-4bba-bdad-7e979e748a3d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 09 00:41:22.082718 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:41:22.082718 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:41:22.082718 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:41:22.082718 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:41:22.082718 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:41:22.082718 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:41:22.082718 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:41:22.082718 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:41:22.082718 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:41:22.082718 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:41:22.082718 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:41:22.082718 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 09 00:41:22.082718 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 09 00:41:22.082718 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 09 00:41:22.082718 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 09 00:41:22.083800 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 09 00:41:22.083800 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 09 00:41:22.083800 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 09 00:41:22.083800 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 09 00:41:22.083800 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:41:22.083800 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:41:22.083800 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:41:22.083800 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:41:22.083800 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:41:22.083800 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:41:22.083800 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:41:22.083800 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application with Lock( Oct 09 00:41:22.083800 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:41:22.083800 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:41:22.083800 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:41:22.083800 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:41:22.084562 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:41:22.084562 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:41:22.084562 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:41:22.084562 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:41:22.084562 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 09 00:41:22.084562 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 09 00:41:22.084562 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 09 00:41:22.084562 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 09 00:41:22.084562 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 09 00:41:22.084562 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 09 00:41:22.084562 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 09 00:41:22.084562 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Oct 09 00:41:22.084562 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 26/51] 10.222.0.15 () {56 vars in 1096 bytes} [Sun Oct 9 00:41:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 09 00:41:22.089206 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:41:22.090829 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14664b43-8d61-4bba-bdad-7e979e748a3d None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:41:22.095758 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8fb639-9f6f-439a-aa0b-dbd7b9a9dfc0 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:41:22.133300 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd6239e-586a-443b-b944-2359746b3726 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:41:22.133954 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd6239e-586a-443b-b944-2359746b3726 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:41:22.134215 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd6239e-586a-443b-b944-2359746b3726 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:41:22.134499 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd6239e-586a-443b-b944-2359746b3726 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:41:22.135762 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd6239e-586a-443b-b944-2359746b3726 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:41:22.137282 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd6239e-586a-443b-b944-2359746b3726 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:41:22.138894 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 26/52] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Oct 9 00:41:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 09 00:41:22.142316 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:41:22.144903 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd6239e-586a-443b-b944-2359746b3726 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:41:22.197460 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14664b43-8d61-4bba-bdad-7e979e748a3d None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:41:22.230298 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f134e1d8-edfd-4d69-a166-c835f9edb356 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:41:22.230923 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f134e1d8-edfd-4d69-a166-c835f9edb356 None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:41:22.231203 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f134e1d8-edfd-4d69-a166-c835f9edb356 None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:41:22.231506 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f134e1d8-edfd-4d69-a166-c835f9edb356 None admin] PATH_INFO: `/v3/roles` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:41:22.232215 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f134e1d8-edfd-4d69-a166-c835f9edb356 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:41:22.232520 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f134e1d8-edfd-4d69-a166-c835f9edb356 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:41:22.233937 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f134e1d8-edfd-4d69-a166-c835f9edb356 None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:41:22.243990 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd6239e-586a-443b-b944-2359746b3726 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:41:22.246384 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 27/53] 10.222.0.15 () {56 vars in 1099 bytes} [Sun Oct 9 00:41:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 09 00:41:22.252460 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f134e1d8-edfd-4d69-a166-c835f9edb356 None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:41:22.280149 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e57c82-3352-40e9-a45e-74720c1f4b64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:41:22.280750 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e57c82-3352-40e9-a45e-74720c1f4b64 None admin] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:41:22.281031 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e57c82-3352-40e9-a45e-74720c1f4b64 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:41:22.281303 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e57c82-3352-40e9-a45e-74720c1f4b64 None admin] PATH_INFO: `/v3/projects` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:41:22.281955 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e57c82-3352-40e9-a45e-74720c1f4b64 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:41:22.283441 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e57c82-3352-40e9-a45e-74720c1f4b64 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:41:22.311179 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 27/54] 10.222.0.15 () {60 vars in 1140 bytes} [Sun Oct 9 00:41:22 2022] POST /identity/v3/projects => generated 298 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 09 00:41:22.364841 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f134e1d8-edfd-4d69-a166-c835f9edb356 None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:41:22.376910 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:41:22.404193 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1f7632-6f5b-4a36-a730-b4baac3ec216 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:41:22.404850 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1f7632-6f5b-4a36-a730-b4baac3ec216 None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:41:22.405125 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1f7632-6f5b-4a36-a730-b4baac3ec216 None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:41:22.405392 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1f7632-6f5b-4a36-a730-b4baac3ec216 None admin] PATH_INFO: `/v3/users/99441f7488cd4b83be4affd132b7c074` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:41:22.406642 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1f7632-6f5b-4a36-a730-b4baac3ec216 None admin] RBAC: Authorizing `identity:get_user(user_id=99441f7488cd4b83be4affd132b7c074)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:41:22.408187 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1f7632-6f5b-4a36-a730-b4baac3ec216 None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:41:22.409872 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 28/55] 10.222.0.15 () {56 vars in 1177 bytes} [Sun Oct 9 00:41:22 2022] GET /identity/v3/users/99441f7488cd4b83be4affd132b7c074 => generated 247 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:41:22.415958 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e57c82-3352-40e9-a45e-74720c1f4b64 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:41:22.440344 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:41:22.524810 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e57c82-3352-40e9-a45e-74720c1f4b64 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:41:22.557453 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7223acc7-9314-41bc-b12c-7be5605160a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:41:22.558114 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7223acc7-9314-41bc-b12c-7be5605160a2 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:41:22.558380 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7223acc7-9314-41bc-b12c-7be5605160a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:41:22.558654 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7223acc7-9314-41bc-b12c-7be5605160a2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:41:22.559811 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7223acc7-9314-41bc-b12c-7be5605160a2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:41:22.561286 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7223acc7-9314-41bc-b12c-7be5605160a2 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:41:22.562866 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 28/56] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Oct 9 00:41:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:41:22.569108 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1f7632-6f5b-4a36-a730-b4baac3ec216 None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:41:22.675054 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1f7632-6f5b-4a36-a730-b4baac3ec216 None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:41:22.711982 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bce55cf-b448-4f22-aec0-5c465cfe1752 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:41:22.712600 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bce55cf-b448-4f22-aec0-5c465cfe1752 None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:41:22.712888 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bce55cf-b448-4f22-aec0-5c465cfe1752 None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:41:22.713161 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bce55cf-b448-4f22-aec0-5c465cfe1752 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:41:22.713957 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bce55cf-b448-4f22-aec0-5c465cfe1752 None admin] RBAC: Adding query filter params (role.id=f69dddf26daf4dd79d4c962beb877af5, scope.domain.id=default, user.id=99441f7488cd4b83be4affd132b7c074) {{(pid=81525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:41:22.714268 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bce55cf-b448-4f22-aec0-5c465cfe1752 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:41:22.715791 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bce55cf-b448-4f22-aec0-5c465cfe1752 None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:41:22.722082 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 29/57] 10.222.0.15 () {56 vars in 1322 bytes} [Sun Oct 9 00:41:22 2022] GET /identity/v3/role_assignments?user.id=99441f7488cd4b83be4affd132b7c074&scope.domain.id=default&role.id=f69dddf26daf4dd79d4c962beb877af5 => generated 530 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:41:24.457516 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccedd75-fe63-4550-b573-ff07764fba5d None None] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:41:24.457957 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccedd75-fe63-4550-b573-ff07764fba5d None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:41:24.458070 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccedd75-fe63-4550-b573-ff07764fba5d None None] PATH_INFO: `/` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:41:24.459491 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 29/58] 10.222.0.15 () {54 vars in 927 bytes} [Sun Oct 9 00:41:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:41:24.465092 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8c670b-c492-4685-b224-a881b88e95c9 None None] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:41:24.465482 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8c670b-c492-4685-b224-a881b88e95c9 None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:41:24.465639 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8c670b-c492-4685-b224-a881b88e95c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:41:24.485036 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.auth.core [None req-ed8c670b-c492-4685-b224-a881b88e95c9 None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:41:24.486248 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-ed8c670b-c492-4685-b224-a881b88e95c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:41:24.523698 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:41:24.559186 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 30/59] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Oct 9 00:41:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 09 00:41:24.828325 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccedd75-fe63-4550-b573-ff07764fba5d None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:41:25.024776 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:41:25.043672 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccedd75-fe63-4550-b573-ff07764fba5d None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:41:25.077328 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b345cc-d777-4813-9328-bbc2a531c969 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:41:25.077958 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b345cc-d777-4813-9328-bbc2a531c969 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:41:25.078239 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b345cc-d777-4813-9328-bbc2a531c969 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:41:25.078579 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b345cc-d777-4813-9328-bbc2a531c969 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:41:25.079717 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b345cc-d777-4813-9328-bbc2a531c969 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:41:25.081167 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b345cc-d777-4813-9328-bbc2a531c969 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:41:25.082748 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 30/60] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Oct 9 00:41:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:41:25.089211 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8c670b-c492-4685-b224-a881b88e95c9 None None] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:41:25.191375 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8c670b-c492-4685-b224-a881b88e95c9 None None] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:41:25.226580 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80421e3-112f-4c54-bddc-769a1b41d42c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:41:25.227163 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80421e3-112f-4c54-bddc-769a1b41d42c None admin] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:41:25.227505 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80421e3-112f-4c54-bddc-769a1b41d42c None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:41:25.227778 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80421e3-112f-4c54-bddc-769a1b41d42c None admin] PATH_INFO: `/v3/users` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:41:25.228446 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80421e3-112f-4c54-bddc-769a1b41d42c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:41:25.230058 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80421e3-112f-4c54-bddc-769a1b41d42c None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:41:25.259172 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 31/61] 10.222.0.15 () {60 vars in 1132 bytes} [Sun Oct 9 00:41:25 2022] POST /identity/v3/users => generated 275 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 09 00:41:28.469515 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a49692a-cee2-4e9b-85ac-d0b14b87060a None None] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:41:28.470033 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a49692a-cee2-4e9b-85ac-d0b14b87060a None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:41:28.470104 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a49692a-cee2-4e9b-85ac-d0b14b87060a None None] PATH_INFO: `/` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:41:28.471711 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 31/62] 10.222.0.15 () {54 vars in 927 bytes} [Sun Oct 9 00:41:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:41:28.485179 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84543a0-49db-4860-adf5-ae75eb931b33 None None] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:41:28.486070 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84543a0-49db-4860-adf5-ae75eb931b33 None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:41:28.486551 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84543a0-49db-4860-adf5-ae75eb931b33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:41:28.516275 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.auth.core [None req-a84543a0-49db-4860-adf5-ae75eb931b33 None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:41:28.517830 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-a84543a0-49db-4860-adf5-ae75eb931b33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:41:28.543056 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:41:28.571288 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7447784e-d92a-4fa1-a72e-24ea6a125fab None None] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:41:28.571288 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7447784e-d92a-4fa1-a72e-24ea6a125fab None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:41:28.571288 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7447784e-d92a-4fa1-a72e-24ea6a125fab None None] PATH_INFO: `/` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:41:28.572383 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 32/63] 10.222.0.15 () {54 vars in 927 bytes} [Sun Oct 9 00:41:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:41:28.578085 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f58329-358e-4b6a-ae95-3e7c4dfe41f3 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:41:28.578631 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f58329-358e-4b6a-ae95-3e7c4dfe41f3 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:41:28.579165 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f58329-358e-4b6a-ae95-3e7c4dfe41f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:41:28.604987 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-60f58329-358e-4b6a-ae95-3e7c4dfe41f3 None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:41:28.608130 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-60f58329-358e-4b6a-ae95-3e7c4dfe41f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:41:28.610379 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 32/64] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Oct 9 00:41:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 09 00:41:28.693576 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 33/65] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Oct 9 00:41:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 09 00:41:28.908607 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d59c752-1cea-4194-9396-a0753e076fbe None None] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:41:28.909306 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d59c752-1cea-4194-9396-a0753e076fbe None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:41:28.909813 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d59c752-1cea-4194-9396-a0753e076fbe None None] PATH_INFO: `/` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:41:28.911593 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 33/66] 10.222.0.15 () {54 vars in 927 bytes} [Sun Oct 9 00:41:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:41:28.917268 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e51fd9-eb8a-4b85-816f-e5ff67b34681 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:41:28.917798 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e51fd9-eb8a-4b85-816f-e5ff67b34681 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:41:28.918261 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e51fd9-eb8a-4b85-816f-e5ff67b34681 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:41:28.944409 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-51e51fd9-eb8a-4b85-816f-e5ff67b34681 None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:41:28.945545 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-51e51fd9-eb8a-4b85-816f-e5ff67b34681 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:41:29.041287 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 34/67] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Oct 9 00:41:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 09 00:41:29.042239 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d59c752-1cea-4194-9396-a0753e076fbe None None] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:41:29.056685 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e51fd9-eb8a-4b85-816f-e5ff67b34681 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:41:29.071815 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:41:29.166891 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e51fd9-eb8a-4b85-816f-e5ff67b34681 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:41:29.204427 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d59c752-1cea-4194-9396-a0753e076fbe None None] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:41:29.209243 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d97199-32d1-407a-9abb-bbd1696e9185 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:41:29.209902 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d97199-32d1-407a-9abb-bbd1696e9185 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:41:29.210185 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d97199-32d1-407a-9abb-bbd1696e9185 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:41:29.210460 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d97199-32d1-407a-9abb-bbd1696e9185 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:41:29.223522 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d97199-32d1-407a-9abb-bbd1696e9185 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 09 00:41:29.229438 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application [None req-c5d97199-32d1-407a-9abb-bbd1696e9185 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 09 00:41:29.229438 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:41:29.229438 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:41:29.229438 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:41:29.229438 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:41:29.229438 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:41:29.229438 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:41:29.229438 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:41:29.229438 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:41:29.229438 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:41:29.229438 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:41:29.229438 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:41:29.229438 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 09 00:41:29.229438 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 09 00:41:29.229438 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 09 00:41:29.229438 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 09 00:41:29.230352 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 09 00:41:29.230352 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 09 00:41:29.230352 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 09 00:41:29.230352 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 09 00:41:29.230352 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:41:29.230352 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:41:29.230352 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:41:29.230352 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:41:29.230352 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:41:29.230352 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:41:29.230352 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:41:29.230352 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application with Lock( Oct 09 00:41:29.230352 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:41:29.230352 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:41:29.230352 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:41:29.230352 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:41:29.231108 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:41:29.231108 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:41:29.231108 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:41:29.231108 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:41:29.231108 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 09 00:41:29.231108 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 09 00:41:29.231108 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 09 00:41:29.231108 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 09 00:41:29.231108 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 09 00:41:29.231108 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 09 00:41:29.231108 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 09 00:41:29.231108 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application Oct 09 00:41:29.231108 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 35/68] 10.222.0.15 () {56 vars in 1099 bytes} [Sun Oct 9 00:41:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 09 00:41:29.237176 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09254804-e444-458c-9916-8ce733a34bfd None None] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:41:29.237460 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09254804-e444-458c-9916-8ce733a34bfd None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:41:29.237742 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09254804-e444-458c-9916-8ce733a34bfd None None] PATH_INFO: `/` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:41:29.239209 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 36/69] 10.222.0.15 () {54 vars in 927 bytes} [Sun Oct 9 00:41:29 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:41:29.240017 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09254804-e444-458c-9916-8ce733a34bfd None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:41:29.257619 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6f1843-5d2f-4444-bec5-e45b3df8b3c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:41:29.259336 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6f1843-5d2f-4444-bec5-e45b3df8b3c6 None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:41:29.260161 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6f1843-5d2f-4444-bec5-e45b3df8b3c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:41:29.260715 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6f1843-5d2f-4444-bec5-e45b3df8b3c6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:41:29.278292 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6f1843-5d2f-4444-bec5-e45b3df8b3c6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 09 00:41:29.285347 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application [None req-aa6f1843-5d2f-4444-bec5-e45b3df8b3c6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 09 00:41:29.285347 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:41:29.285347 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:41:29.285347 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:41:29.285347 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:41:29.285347 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:41:29.285347 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:41:29.285347 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:41:29.285347 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:41:29.285347 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:41:29.285347 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:41:29.285347 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:41:29.285347 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 09 00:41:29.285347 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 09 00:41:29.285347 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 09 00:41:29.285347 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 09 00:41:29.286473 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 09 00:41:29.286473 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 09 00:41:29.286473 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 09 00:41:29.286473 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 09 00:41:29.286473 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:41:29.286473 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:41:29.286473 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:41:29.286473 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:41:29.286473 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:41:29.286473 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:41:29.286473 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:41:29.286473 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application with Lock( Oct 09 00:41:29.286473 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:41:29.286473 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:41:29.286473 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:41:29.286473 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:41:29.287417 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:41:29.287417 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:41:29.287417 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:41:29.287417 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:41:29.287417 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 09 00:41:29.287417 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 09 00:41:29.287417 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 09 00:41:29.287417 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 09 00:41:29.287417 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 09 00:41:29.287417 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 09 00:41:29.287417 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 09 00:41:29.287417 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Oct 09 00:41:29.289442 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 34/70] 10.222.0.15 () {56 vars in 1096 bytes} [Sun Oct 9 00:41:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 09 00:41:29.296561 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a313f0-3104-44a0-86b3-3aa05dafee98 None None] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:41:29.296561 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a313f0-3104-44a0-86b3-3aa05dafee98 None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:41:29.296561 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a313f0-3104-44a0-86b3-3aa05dafee98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:41:29.321425 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.auth.core [None req-48a313f0-3104-44a0-86b3-3aa05dafee98 None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:41:29.322646 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-48a313f0-3104-44a0-86b3-3aa05dafee98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:41:29.333650 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:41:29.334837 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:41:29.367214 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09254804-e444-458c-9916-8ce733a34bfd None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:41:29.395868 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 35/71] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Oct 9 00:41:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 09 00:41:29.396741 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a313f0-3104-44a0-86b3-3aa05dafee98 None None] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:41:29.403887 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06873773-a127-4ec7-a213-b9f6d9ccad60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:41:29.404512 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06873773-a127-4ec7-a213-b9f6d9ccad60 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:41:29.404795 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06873773-a127-4ec7-a213-b9f6d9ccad60 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:41:29.405072 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06873773-a127-4ec7-a213-b9f6d9ccad60 None admin] PATH_INFO: `/v3/roles` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:41:29.405754 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06873773-a127-4ec7-a213-b9f6d9ccad60 None admin] RBAC: Adding query filter params (name=member) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:41:29.406057 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06873773-a127-4ec7-a213-b9f6d9ccad60 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:41:29.407488 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06873773-a127-4ec7-a213-b9f6d9ccad60 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:41:29.415854 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 37/72] 10.222.0.15 () {56 vars in 1101 bytes} [Sun Oct 9 00:41:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:41:29.416670 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06873773-a127-4ec7-a213-b9f6d9ccad60 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:41:29.506732 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a313f0-3104-44a0-86b3-3aa05dafee98 None None] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:41:29.532644 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06873773-a127-4ec7-a213-b9f6d9ccad60 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:41:29.540820 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2907bbf8-3cf4-46b8-b461-7f16b93dae22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:41:29.541441 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2907bbf8-3cf4-46b8-b461-7f16b93dae22 None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:41:29.541749 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2907bbf8-3cf4-46b8-b461-7f16b93dae22 None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:41:29.542052 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2907bbf8-3cf4-46b8-b461-7f16b93dae22 None admin] PATH_INFO: `/v3/roles` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:41:29.542727 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2907bbf8-3cf4-46b8-b461-7f16b93dae22 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:41:29.543030 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2907bbf8-3cf4-46b8-b461-7f16b93dae22 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:41:29.544480 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2907bbf8-3cf4-46b8-b461-7f16b93dae22 None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:41:29.557490 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 36/73] 10.222.0.15 () {56 vars in 1099 bytes} [Sun Oct 9 00:41:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:41:29.557490 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd820e42-4cb4-4561-90ff-015c2ecaff9e None None] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:41:29.557490 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd820e42-4cb4-4561-90ff-015c2ecaff9e None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:41:29.557490 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd820e42-4cb4-4561-90ff-015c2ecaff9e None None] PATH_INFO: `/` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:41:29.557490 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 37/74] 10.222.0.15 () {54 vars in 927 bytes} [Sun Oct 9 00:41:29 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:41:29.557490 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd820e42-4cb4-4561-90ff-015c2ecaff9e None None] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:41:29.569462 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:41:29.578429 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb54057-d6b9-4775-a0a3-2c2164bf8a5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:41:29.579080 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb54057-d6b9-4775-a0a3-2c2164bf8a5e None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:41:29.579395 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb54057-d6b9-4775-a0a3-2c2164bf8a5e None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:41:29.579672 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb54057-d6b9-4775-a0a3-2c2164bf8a5e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:41:29.581574 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:41:29.592017 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb54057-d6b9-4775-a0a3-2c2164bf8a5e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 09 00:41:29.597434 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application [None req-acb54057-d6b9-4775-a0a3-2c2164bf8a5e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 09 00:41:29.597434 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:41:29.597434 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:41:29.597434 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:41:29.597434 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:41:29.597434 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:41:29.597434 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:41:29.597434 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:41:29.597434 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:41:29.597434 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:41:29.597434 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:41:29.597434 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:41:29.597434 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 09 00:41:29.597434 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 09 00:41:29.597434 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 09 00:41:29.597434 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 09 00:41:29.598277 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 09 00:41:29.598277 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 09 00:41:29.598277 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 09 00:41:29.598277 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 09 00:41:29.598277 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:41:29.598277 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:41:29.598277 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:41:29.598277 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:41:29.598277 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:41:29.598277 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:41:29.598277 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:41:29.598277 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application with Lock( Oct 09 00:41:29.598277 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:41:29.598277 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:41:29.598277 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:41:29.598277 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:41:29.599037 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:41:29.599037 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:41:29.599037 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:41:29.599037 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:41:29.599037 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 09 00:41:29.599037 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 09 00:41:29.599037 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 09 00:41:29.599037 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 09 00:41:29.599037 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 09 00:41:29.599037 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 09 00:41:29.599037 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 09 00:41:29.599037 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application Oct 09 00:41:29.599037 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 38/75] 10.222.0.15 () {56 vars in 1114 bytes} [Sun Oct 9 00:41:29 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:41:29.599701 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb54057-d6b9-4775-a0a3-2c2164bf8a5e None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:41:29.674559 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd820e42-4cb4-4561-90ff-015c2ecaff9e None None] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:41:29.708636 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca7f088-9fc8-4a7d-b7da-f1d6269b7ebb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:41:29.709271 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca7f088-9fc8-4a7d-b7da-f1d6269b7ebb None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:41:29.709365 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb54057-d6b9-4775-a0a3-2c2164bf8a5e None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:41:29.709549 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca7f088-9fc8-4a7d-b7da-f1d6269b7ebb None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:41:29.709823 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca7f088-9fc8-4a7d-b7da-f1d6269b7ebb None admin] PATH_INFO: `/v3/users/52f47c8c5b524339a22bd58a6fa05fd5` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:41:29.723111 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca7f088-9fc8-4a7d-b7da-f1d6269b7ebb None admin] RBAC: Authorizing `identity:get_user(user_id=52f47c8c5b524339a22bd58a6fa05fd5)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:41:29.724630 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca7f088-9fc8-4a7d-b7da-f1d6269b7ebb None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:41:29.726272 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 38/76] 10.222.0.15 () {56 vars in 1177 bytes} [Sun Oct 9 00:41:29 2022] GET /identity/v3/users/52f47c8c5b524339a22bd58a6fa05fd5 => generated 275 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:41:29.727448 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e12bfcd-972e-4d98-bb4c-1649ad42440d None None] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:41:29.727730 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e12bfcd-972e-4d98-bb4c-1649ad42440d None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:41:29.728053 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e12bfcd-972e-4d98-bb4c-1649ad42440d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:41:29.745351 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189de828-9a63-4df5-ae63-5a5a6bb55bee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:41:29.746017 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189de828-9a63-4df5-ae63-5a5a6bb55bee None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:41:29.746176 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.auth.core [None req-8e12bfcd-972e-4d98-bb4c-1649ad42440d None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:41:29.746266 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189de828-9a63-4df5-ae63-5a5a6bb55bee None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:41:29.746542 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189de828-9a63-4df5-ae63-5a5a6bb55bee None admin] PATH_INFO: `/v3/users/99441f7488cd4b83be4affd132b7c074` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:41:29.747335 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-8e12bfcd-972e-4d98-bb4c-1649ad42440d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:41:29.747733 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189de828-9a63-4df5-ae63-5a5a6bb55bee None admin] RBAC: Authorizing `identity:get_user(user_id=99441f7488cd4b83be4affd132b7c074)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:41:29.749513 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189de828-9a63-4df5-ae63-5a5a6bb55bee None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:41:29.751279 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 39/77] 10.222.0.15 () {56 vars in 1177 bytes} [Sun Oct 9 00:41:29 2022] GET /identity/v3/users/99441f7488cd4b83be4affd132b7c074 => generated 247 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:41:29.751939 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189de828-9a63-4df5-ae63-5a5a6bb55bee None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:41:29.809110 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:41:29.812138 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:41:29.817628 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 39/78] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Oct 9 00:41:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 09 00:41:29.818479 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e12bfcd-972e-4d98-bb4c-1649ad42440d None None] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:41:29.857270 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189de828-9a63-4df5-ae63-5a5a6bb55bee None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:41:29.893994 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93498066-edc5-4833-bd46-2852953c732a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:41:29.894935 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93498066-edc5-4833-bd46-2852953c732a None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:41:29.895221 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93498066-edc5-4833-bd46-2852953c732a None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:41:29.895539 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93498066-edc5-4833-bd46-2852953c732a None admin] PATH_INFO: `/v3/roles` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:41:29.896216 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93498066-edc5-4833-bd46-2852953c732a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:41:29.896522 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93498066-edc5-4833-bd46-2852953c732a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:41:29.897916 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93498066-edc5-4833-bd46-2852953c732a None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:41:29.906531 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 40/79] 10.222.0.15 () {56 vars in 1111 bytes} [Sun Oct 9 00:41:29 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:41:29.907360 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93498066-edc5-4833-bd46-2852953c732a None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:41:29.951479 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e12bfcd-972e-4d98-bb4c-1649ad42440d None None] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:41:29.985758 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae47a12-3594-49bb-8bb9-fe4799942ae9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:41:29.986413 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae47a12-3594-49bb-8bb9-fe4799942ae9 None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:41:29.986695 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae47a12-3594-49bb-8bb9-fe4799942ae9 None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:41:29.986969 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae47a12-3594-49bb-8bb9-fe4799942ae9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:41:29.988135 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae47a12-3594-49bb-8bb9-fe4799942ae9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:41:29.989676 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae47a12-3594-49bb-8bb9-fe4799942ae9 None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:41:29.995500 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 40/80] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Oct 9 00:41:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:41:29.995500 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae47a12-3594-49bb-8bb9-fe4799942ae9 None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:41:30.016694 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93498066-edc5-4833-bd46-2852953c732a None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:41:30.040760 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:41:30.053699 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6c8254-3e7c-4370-af32-c45ead5551e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:41:30.054326 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6c8254-3e7c-4370-af32-c45ead5551e6 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:41:30.054607 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6c8254-3e7c-4370-af32-c45ead5551e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:41:30.054881 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6c8254-3e7c-4370-af32-c45ead5551e6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:41:30.059883 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:41:30.102413 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae47a12-3594-49bb-8bb9-fe4799942ae9 None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:41:30.127373 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6c8254-3e7c-4370-af32-c45ead5551e6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:41:30.128888 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6c8254-3e7c-4370-af32-c45ead5551e6 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:41:30.136152 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba64534-ac59-43cd-86cf-8829d5d12e50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:41:30.136778 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba64534-ac59-43cd-86cf-8829d5d12e50 None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:41:30.137050 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba64534-ac59-43cd-86cf-8829d5d12e50 None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:41:30.137317 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba64534-ac59-43cd-86cf-8829d5d12e50 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:41:30.203072 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba64534-ac59-43cd-86cf-8829d5d12e50 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:41:30.204601 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba64534-ac59-43cd-86cf-8829d5d12e50 None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:41:30.226602 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 41/81] 10.222.0.15 () {58 vars in 1282 bytes} [Sun Oct 9 00:41:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 09 00:41:30.227493 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6c8254-3e7c-4370-af32-c45ead5551e6 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:41:30.256788 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:41:30.267388 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:41:30.304378 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 41/82] 10.222.0.15 () {58 vars in 1282 bytes} [Sun Oct 9 00:41:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 09 00:41:30.305299 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba64534-ac59-43cd-86cf-8829d5d12e50 None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:41:30.335503 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6c8254-3e7c-4370-af32-c45ead5551e6 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:41:30.373409 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361de5bf-f044-4aed-a64d-92917cfbc62e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:41:30.374391 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361de5bf-f044-4aed-a64d-92917cfbc62e None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:41:30.374670 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361de5bf-f044-4aed-a64d-92917cfbc62e None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:41:30.374943 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361de5bf-f044-4aed-a64d-92917cfbc62e None admin] PATH_INFO: `/v3/users/52f47c8c5b524339a22bd58a6fa05fd5` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:41:30.376118 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361de5bf-f044-4aed-a64d-92917cfbc62e None admin] RBAC: Authorizing `identity:get_user(user_id=52f47c8c5b524339a22bd58a6fa05fd5)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:41:30.377594 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361de5bf-f044-4aed-a64d-92917cfbc62e None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:41:30.379171 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 42/83] 10.222.0.15 () {56 vars in 1177 bytes} [Sun Oct 9 00:41:30 2022] GET /identity/v3/users/52f47c8c5b524339a22bd58a6fa05fd5 => generated 275 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:41:30.379962 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361de5bf-f044-4aed-a64d-92917cfbc62e None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:41:30.405328 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba64534-ac59-43cd-86cf-8829d5d12e50 None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:41:30.441110 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993dd3bf-a628-46e6-8053-539adb5d0e57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:41:30.442010 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993dd3bf-a628-46e6-8053-539adb5d0e57 None admin] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:41:30.442297 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993dd3bf-a628-46e6-8053-539adb5d0e57 None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:41:30.442570 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993dd3bf-a628-46e6-8053-539adb5d0e57 None admin] PATH_INFO: `/v3/users` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:41:30.443427 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993dd3bf-a628-46e6-8053-539adb5d0e57 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:41:30.445194 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993dd3bf-a628-46e6-8053-539adb5d0e57 None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:41:30.467220 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 42/84] 10.222.0.15 () {60 vars in 1132 bytes} [Sun Oct 9 00:41:30 2022] POST /identity/v3/users => generated 289 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 09 00:41:30.468229 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993dd3bf-a628-46e6-8053-539adb5d0e57 None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:41:30.473866 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:41:30.485412 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361de5bf-f044-4aed-a64d-92917cfbc62e None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:41:30.494296 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:41:30.525684 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcaa1cc-178b-472a-aae4-4d5ac37a4350 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:41:30.526381 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcaa1cc-178b-472a-aae4-4d5ac37a4350 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:41:30.526660 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcaa1cc-178b-472a-aae4-4d5ac37a4350 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:41:30.526933 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcaa1cc-178b-472a-aae4-4d5ac37a4350 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:41:30.539120 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcaa1cc-178b-472a-aae4-4d5ac37a4350 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 09 00:41:30.544238 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application [None req-cdcaa1cc-178b-472a-aae4-4d5ac37a4350 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 09 00:41:30.544238 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:41:30.544238 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:41:30.544238 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:41:30.544238 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:41:30.544238 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:41:30.544238 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:41:30.544238 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:41:30.544238 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:41:30.544238 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:41:30.544238 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:41:30.544238 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:41:30.544238 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 09 00:41:30.544238 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 09 00:41:30.544238 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 09 00:41:30.544238 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 09 00:41:30.545157 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 09 00:41:30.545157 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 09 00:41:30.545157 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 09 00:41:30.545157 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 09 00:41:30.545157 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:41:30.545157 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:41:30.545157 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:41:30.545157 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:41:30.545157 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:41:30.545157 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:41:30.545157 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:41:30.545157 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application with Lock( Oct 09 00:41:30.545157 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:41:30.545157 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:41:30.545157 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:41:30.545157 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:41:30.545920 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:41:30.545920 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:41:30.545920 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:41:30.545920 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:41:30.545920 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 09 00:41:30.545920 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 09 00:41:30.545920 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 09 00:41:30.545920 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 09 00:41:30.545920 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 09 00:41:30.545920 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 09 00:41:30.545920 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 09 00:41:30.545920 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application Oct 09 00:41:30.545920 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 43/85] 10.222.0.15 () {56 vars in 1099 bytes} [Sun Oct 9 00:41:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:41:30.546589 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcaa1cc-178b-472a-aae4-4d5ac37a4350 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:41:30.590856 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993dd3bf-a628-46e6-8053-539adb5d0e57 None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:41:30.629216 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99722501-d903-4469-af07-54c5bcb4035f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:41:30.630148 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99722501-d903-4469-af07-54c5bcb4035f None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:41:30.630424 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99722501-d903-4469-af07-54c5bcb4035f None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:41:30.630712 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99722501-d903-4469-af07-54c5bcb4035f None admin] PATH_INFO: `/v3/projects/3fcf2f5182c445929c38948df6235040` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:41:30.631942 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99722501-d903-4469-af07-54c5bcb4035f None admin] RBAC: Authorizing `identity:get_project(project_id=3fcf2f5182c445929c38948df6235040)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:41:30.633490 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99722501-d903-4469-af07-54c5bcb4035f None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:41:30.635235 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 43/86] 10.222.0.15 () {56 vars in 1186 bytes} [Sun Oct 9 00:41:30 2022] GET /identity/v3/projects/3fcf2f5182c445929c38948df6235040 => generated 298 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:41:30.636140 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99722501-d903-4469-af07-54c5bcb4035f None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:41:30.670277 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcaa1cc-178b-472a-aae4-4d5ac37a4350 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:41:30.711817 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cba220-ef45-48a6-889f-9165e6064cd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:41:30.712671 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cba220-ef45-48a6-889f-9165e6064cd1 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:41:30.712949 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cba220-ef45-48a6-889f-9165e6064cd1 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:41:30.713226 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cba220-ef45-48a6-889f-9165e6064cd1 None admin] PATH_INFO: `/v3/projects/3fcf2f5182c445929c38948df6235040` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:41:30.714476 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cba220-ef45-48a6-889f-9165e6064cd1 None admin] RBAC: Authorizing `identity:get_project(project_id=3fcf2f5182c445929c38948df6235040)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:41:30.716328 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cba220-ef45-48a6-889f-9165e6064cd1 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:41:30.717639 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 44/87] 10.222.0.15 () {56 vars in 1186 bytes} [Sun Oct 9 00:41:30 2022] GET /identity/v3/projects/3fcf2f5182c445929c38948df6235040 => generated 298 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:41:30.718424 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cba220-ef45-48a6-889f-9165e6064cd1 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:41:30.739765 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:41:30.744702 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:41:30.754950 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99722501-d903-4469-af07-54c5bcb4035f None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:41:30.798772 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14ab0ef-c2f4-4db5-b260-a6cac40b491b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:41:30.799385 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14ab0ef-c2f4-4db5-b260-a6cac40b491b None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:41:30.799664 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14ab0ef-c2f4-4db5-b260-a6cac40b491b None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:41:30.799933 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14ab0ef-c2f4-4db5-b260-a6cac40b491b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:41:30.853655 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cba220-ef45-48a6-889f-9165e6064cd1 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:41:30.879913 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14ab0ef-c2f4-4db5-b260-a6cac40b491b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:41:30.882651 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14ab0ef-c2f4-4db5-b260-a6cac40b491b None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:41:30.898561 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431437ad-54bd-4f73-a1f8-ba61d05a5544 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:41:30.899189 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431437ad-54bd-4f73-a1f8-ba61d05a5544 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:41:30.899500 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431437ad-54bd-4f73-a1f8-ba61d05a5544 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:41:30.899770 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431437ad-54bd-4f73-a1f8-ba61d05a5544 None admin] PATH_INFO: `/v3/roles` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:41:30.900450 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431437ad-54bd-4f73-a1f8-ba61d05a5544 None admin] RBAC: Adding query filter params (name=member) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:41:30.900756 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431437ad-54bd-4f73-a1f8-ba61d05a5544 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:41:30.902231 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431437ad-54bd-4f73-a1f8-ba61d05a5544 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:41:30.912263 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 45/88] 10.222.0.15 () {56 vars in 1101 bytes} [Sun Oct 9 00:41:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:41:30.913117 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431437ad-54bd-4f73-a1f8-ba61d05a5544 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:41:30.995793 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:41:31.010696 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 44/89] 10.222.0.15 () {58 vars in 1282 bytes} [Sun Oct 9 00:41:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 09 00:41:31.011122 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:41:31.011607 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14ab0ef-c2f4-4db5-b260-a6cac40b491b None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:41:31.033077 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431437ad-54bd-4f73-a1f8-ba61d05a5544 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:41:31.073142 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e707e482-28b8-4ce9-a065-b942b7eea28a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:41:31.074850 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e707e482-28b8-4ce9-a065-b942b7eea28a None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:41:31.075393 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e707e482-28b8-4ce9-a065-b942b7eea28a None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:41:31.075955 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e707e482-28b8-4ce9-a065-b942b7eea28a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:41:31.076986 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e707e482-28b8-4ce9-a065-b942b7eea28a None admin] RBAC: Adding query filter params (role.id=afb0a01183d9497795eaa4fa1a4046ae, scope.project.id=3fcf2f5182c445929c38948df6235040, user.id=52f47c8c5b524339a22bd58a6fa05fd5) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:41:31.077505 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e707e482-28b8-4ce9-a065-b942b7eea28a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:41:31.079981 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e707e482-28b8-4ce9-a065-b942b7eea28a None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:41:31.090893 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 46/90] 10.222.0.15 () {56 vars in 1374 bytes} [Sun Oct 9 00:41:30 2022] GET /identity/v3/role_assignments?user.id=52f47c8c5b524339a22bd58a6fa05fd5&scope.project.id=3fcf2f5182c445929c38948df6235040&role.id=afb0a01183d9497795eaa4fa1a4046ae => generated 259 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:41:31.098743 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e707e482-28b8-4ce9-a065-b942b7eea28a None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:41:31.151712 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14ab0ef-c2f4-4db5-b260-a6cac40b491b None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:41:31.226858 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb993d63-7619-4bac-8413-eeb2872cf5e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:41:31.227527 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb993d63-7619-4bac-8413-eeb2872cf5e1 None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:41:31.227809 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb993d63-7619-4bac-8413-eeb2872cf5e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:41:31.228081 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb993d63-7619-4bac-8413-eeb2872cf5e1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:41:31.228844 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb993d63-7619-4bac-8413-eeb2872cf5e1 None admin] RBAC: Adding query filter params (role.id=f69dddf26daf4dd79d4c962beb877af5, scope.project.id=3fcf2f5182c445929c38948df6235040, user.id=99441f7488cd4b83be4affd132b7c074) {{(pid=81525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:41:31.229155 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb993d63-7619-4bac-8413-eeb2872cf5e1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:41:31.235790 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb993d63-7619-4bac-8413-eeb2872cf5e1 None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:41:31.246252 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 45/91] 10.222.0.15 () {56 vars in 1374 bytes} [Sun Oct 9 00:41:31 2022] GET /identity/v3/role_assignments?user.id=99441f7488cd4b83be4affd132b7c074&scope.project.id=3fcf2f5182c445929c38948df6235040&role.id=f69dddf26daf4dd79d4c962beb877af5 => generated 259 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:41:31.247220 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb993d63-7619-4bac-8413-eeb2872cf5e1 None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:41:31.321642 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e707e482-28b8-4ce9-a065-b942b7eea28a None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:41:31.359774 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:41:31.396497 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466a551d-0239-4712-89cb-6b37de57df47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:41:31.397174 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466a551d-0239-4712-89cb-6b37de57df47 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:41:31.397450 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466a551d-0239-4712-89cb-6b37de57df47 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:41:31.397729 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466a551d-0239-4712-89cb-6b37de57df47 None admin] PATH_INFO: `/v3/users/52f47c8c5b524339a22bd58a6fa05fd5` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:41:31.400431 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466a551d-0239-4712-89cb-6b37de57df47 None admin] RBAC: Authorizing `identity:get_user(user_id=52f47c8c5b524339a22bd58a6fa05fd5)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:41:31.402044 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466a551d-0239-4712-89cb-6b37de57df47 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:41:31.403763 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 47/92] 10.222.0.15 () {56 vars in 1177 bytes} [Sun Oct 9 00:41:31 2022] GET /identity/v3/users/52f47c8c5b524339a22bd58a6fa05fd5 => generated 275 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:41:31.410815 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466a551d-0239-4712-89cb-6b37de57df47 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:41:31.451830 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:41:31.463297 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb993d63-7619-4bac-8413-eeb2872cf5e1 None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:41:31.503953 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea312f39-94f7-4058-aea6-4a8472717af2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:41:31.504672 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea312f39-94f7-4058-aea6-4a8472717af2 None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:41:31.504956 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea312f39-94f7-4058-aea6-4a8472717af2 None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:41:31.505227 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea312f39-94f7-4058-aea6-4a8472717af2 None admin] PATH_INFO: `/v3/projects/3fcf2f5182c445929c38948df6235040` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:41:31.506591 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea312f39-94f7-4058-aea6-4a8472717af2 None admin] RBAC: Authorizing `identity:get_project(project_id=3fcf2f5182c445929c38948df6235040)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:41:31.508157 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea312f39-94f7-4058-aea6-4a8472717af2 None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:41:31.510385 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 46/93] 10.222.0.15 () {56 vars in 1186 bytes} [Sun Oct 9 00:41:31 2022] GET /identity/v3/projects/3fcf2f5182c445929c38948df6235040 => generated 298 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:41:31.516779 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea312f39-94f7-4058-aea6-4a8472717af2 None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:41:31.553149 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466a551d-0239-4712-89cb-6b37de57df47 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:41:31.592938 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce496b37-d3fe-4fc1-aee9-e10bd9fa5b87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:41:31.593974 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce496b37-d3fe-4fc1-aee9-e10bd9fa5b87 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:41:31.594492 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce496b37-d3fe-4fc1-aee9-e10bd9fa5b87 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:41:31.595058 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce496b37-d3fe-4fc1-aee9-e10bd9fa5b87 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:41:31.629618 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea312f39-94f7-4058-aea6-4a8472717af2 None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:41:31.651440 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:41:31.666546 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e612738-ba16-4a84-af84-e7f95840f2df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:41:31.667156 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e612738-ba16-4a84-af84-e7f95840f2df None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:41:31.667481 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e612738-ba16-4a84-af84-e7f95840f2df None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:41:31.667819 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e612738-ba16-4a84-af84-e7f95840f2df None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:41:31.668827 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e612738-ba16-4a84-af84-e7f95840f2df None admin] RBAC: Adding query filter params (role.id=93f141c2a808407dae6f9704941d0cb2, scope.project.id=3fcf2f5182c445929c38948df6235040, user.id=52f47c8c5b524339a22bd58a6fa05fd5) {{(pid=81525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:41:31.669134 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e612738-ba16-4a84-af84-e7f95840f2df None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:41:31.671444 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e612738-ba16-4a84-af84-e7f95840f2df None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:41:31.672717 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce496b37-d3fe-4fc1-aee9-e10bd9fa5b87 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:41:31.674608 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce496b37-d3fe-4fc1-aee9-e10bd9fa5b87 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:41:31.679249 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 47/94] 10.222.0.15 () {56 vars in 1374 bytes} [Sun Oct 9 00:41:31 2022] GET /identity/v3/role_assignments?user.id=52f47c8c5b524339a22bd58a6fa05fd5&scope.project.id=3fcf2f5182c445929c38948df6235040&role.id=93f141c2a808407dae6f9704941d0cb2 => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:41:31.692238 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:41:31.799756 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 48/95] 10.222.0.15 () {58 vars in 1282 bytes} [Sun Oct 9 00:41:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 09 00:41:31.805361 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e612738-ba16-4a84-af84-e7f95840f2df None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:41:31.929535 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e612738-ba16-4a84-af84-e7f95840f2df None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:41:31.967047 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56644c7-3145-40cd-826c-5d80c21f4f1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:41:31.967802 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56644c7-3145-40cd-826c-5d80c21f4f1c None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:41:31.968081 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56644c7-3145-40cd-826c-5d80c21f4f1c None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:41:31.968348 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56644c7-3145-40cd-826c-5d80c21f4f1c None admin] PATH_INFO: `/v3/projects/48e7ff122cb7468dbacb2726fd2bd965` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:41:31.969493 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56644c7-3145-40cd-826c-5d80c21f4f1c None admin] RBAC: Authorizing `identity:get_project(project_id=48e7ff122cb7468dbacb2726fd2bd965)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:41:31.970973 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56644c7-3145-40cd-826c-5d80c21f4f1c None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:41:31.972829 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 48/96] 10.222.0.15 () {56 vars in 1186 bytes} [Sun Oct 9 00:41:31 2022] GET /identity/v3/projects/48e7ff122cb7468dbacb2726fd2bd965 => generated 312 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:41:31.978729 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce496b37-d3fe-4fc1-aee9-e10bd9fa5b87 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:41:32.117425 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce496b37-d3fe-4fc1-aee9-e10bd9fa5b87 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:41:32.140500 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:41:32.166335 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c15e84-67f0-4438-9fdd-280aca972245 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:41:32.167020 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c15e84-67f0-4438-9fdd-280aca972245 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:41:32.167322 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c15e84-67f0-4438-9fdd-280aca972245 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:41:32.167605 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c15e84-67f0-4438-9fdd-280aca972245 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:41:32.168352 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c15e84-67f0-4438-9fdd-280aca972245 None admin] RBAC: Adding query filter params (role.id=afb0a01183d9497795eaa4fa1a4046ae, scope.project.id=48e7ff122cb7468dbacb2726fd2bd965, user.id=52f47c8c5b524339a22bd58a6fa05fd5) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:41:32.168662 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c15e84-67f0-4438-9fdd-280aca972245 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:41:32.170122 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c15e84-67f0-4438-9fdd-280aca972245 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:41:32.179888 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 49/97] 10.222.0.15 () {56 vars in 1374 bytes} [Sun Oct 9 00:41:31 2022] GET /identity/v3/role_assignments?user.id=52f47c8c5b524339a22bd58a6fa05fd5&scope.project.id=48e7ff122cb7468dbacb2726fd2bd965&role.id=afb0a01183d9497795eaa4fa1a4046ae => generated 259 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:41:33.462317 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c68e488-e8f2-4ed7-899d-97bbb3b76bee None None] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:41:33.462826 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c68e488-e8f2-4ed7-899d-97bbb3b76bee None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:41:33.462826 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c68e488-e8f2-4ed7-899d-97bbb3b76bee None None] PATH_INFO: `/` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:41:33.464605 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 49/98] 10.222.0.15 () {54 vars in 927 bytes} [Sun Oct 9 00:41:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:41:33.470080 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71f281b-9ee6-40f3-9aa0-855840f08611 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:41:33.470900 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71f281b-9ee6-40f3-9aa0-855840f08611 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:41:33.471376 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71f281b-9ee6-40f3-9aa0-855840f08611 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:41:33.500336 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-d71f281b-9ee6-40f3-9aa0-855840f08611 None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:41:33.501881 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-d71f281b-9ee6-40f3-9aa0-855840f08611 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:41:33.507783 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5114288-d1f4-4146-8e14-808b421724f7 None None] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:41:33.508064 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5114288-d1f4-4146-8e14-808b421724f7 None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:41:33.508340 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5114288-d1f4-4146-8e14-808b421724f7 None None] PATH_INFO: `/` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:41:33.509753 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 50/99] 10.222.0.15 () {54 vars in 927 bytes} [Sun Oct 9 00:41:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 09 00:41:33.518209 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ca7a53-1f0f-40a2-af35-3492de891451 None None] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:41:33.518209 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ca7a53-1f0f-40a2-af35-3492de891451 None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:41:33.518209 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ca7a53-1f0f-40a2-af35-3492de891451 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:41:33.546259 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.auth.core [None req-a3ca7a53-1f0f-40a2-af35-3492de891451 None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:41:33.547503 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-a3ca7a53-1f0f-40a2-af35-3492de891451 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:41:33.624950 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 50/100] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Oct 9 00:41:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 09 00:41:33.654264 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:41:33.678195 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 51/101] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Oct 9 00:41:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 09 00:41:34.182145 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71f281b-9ee6-40f3-9aa0-855840f08611 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:41:34.189884 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ca7a53-1f0f-40a2-af35-3492de891451 None None] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:41:34.361096 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ca7a53-1f0f-40a2-af35-3492de891451 None None] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:41:34.366571 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71f281b-9ee6-40f3-9aa0-855840f08611 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:41:34.383807 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:41:34.427394 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2029711c-f32f-4f83-af4f-9c97ee9efc46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:41:34.428058 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2029711c-f32f-4f83-af4f-9c97ee9efc46 None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:41:34.428339 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2029711c-f32f-4f83-af4f-9c97ee9efc46 None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:41:34.428669 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2029711c-f32f-4f83-af4f-9c97ee9efc46 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:41:34.432835 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc588a7-c009-4731-9274-c5766d37308a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:41:34.433431 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc588a7-c009-4731-9274-c5766d37308a None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:41:34.433710 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc588a7-c009-4731-9274-c5766d37308a None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:41:34.433982 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc588a7-c009-4731-9274-c5766d37308a None admin] PATH_INFO: `/v3/domains/default` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:41:34.446072 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc588a7-c009-4731-9274-c5766d37308a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:41:34.447696 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc588a7-c009-4731-9274-c5766d37308a None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:41:34.449501 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 51/102] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Oct 9 00:41:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:41:34.450933 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9410a9b1-b6ba-4e4e-aa7f-54d62dedae43 None None] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:41:34.451561 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9410a9b1-b6ba-4e4e-aa7f-54d62dedae43 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:41:34.452073 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9410a9b1-b6ba-4e4e-aa7f-54d62dedae43 None None] PATH_INFO: `/` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:41:34.453489 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 52/103] 10.222.0.15 () {54 vars in 927 bytes} [Sun Oct 9 00:41:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:41:34.460625 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a9da2f-21d1-40ff-83f5-14320bd1035d None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:41:34.461083 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a9da2f-21d1-40ff-83f5-14320bd1035d None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:41:34.462282 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a9da2f-21d1-40ff-83f5-14320bd1035d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:41:34.468481 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2029711c-f32f-4f83-af4f-9c97ee9efc46 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 09 00:41:34.477383 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application [None req-2029711c-f32f-4f83-af4f-9c97ee9efc46 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 09 00:41:34.477383 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:41:34.477383 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:41:34.477383 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:41:34.477383 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:41:34.477383 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:41:34.477383 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:41:34.477383 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:41:34.477383 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:41:34.477383 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:41:34.477383 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:41:34.477383 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:41:34.477383 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 09 00:41:34.477383 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 09 00:41:34.477383 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 09 00:41:34.477383 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 09 00:41:34.478586 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 09 00:41:34.478586 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 09 00:41:34.478586 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 09 00:41:34.478586 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 09 00:41:34.478586 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:41:34.478586 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:41:34.478586 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:41:34.478586 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:41:34.478586 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:41:34.478586 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:41:34.478586 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:41:34.478586 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application with Lock( Oct 09 00:41:34.478586 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:41:34.478586 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:41:34.478586 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:41:34.478586 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:41:34.479597 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:41:34.479597 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:41:34.479597 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:41:34.479597 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:41:34.479597 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 09 00:41:34.479597 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 09 00:41:34.479597 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 09 00:41:34.479597 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 09 00:41:34.479597 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 09 00:41:34.479597 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 09 00:41:34.479597 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 09 00:41:34.479597 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Oct 09 00:41:34.492673 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 52/104] 10.222.0.15 () {56 vars in 1099 bytes} [Sun Oct 9 00:41:34 2022] GET /identity/v3/roles/reader => generated 84 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 09 00:41:34.493879 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2029711c-f32f-4f83-af4f-9c97ee9efc46 None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:41:34.508549 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-41a9da2f-21d1-40ff-83f5-14320bd1035d None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:41:34.511089 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-41a9da2f-21d1-40ff-83f5-14320bd1035d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:41:34.570327 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:41:34.652734 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 53/105] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Oct 9 00:41:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 09 00:41:34.654281 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a9da2f-21d1-40ff-83f5-14320bd1035d None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:41:34.656835 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2029711c-f32f-4f83-af4f-9c97ee9efc46 None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:41:34.717908 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba8dda6-e12e-4987-a09c-29d60de41d9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:41:34.718754 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba8dda6-e12e-4987-a09c-29d60de41d9d None admin] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:41:34.719363 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba8dda6-e12e-4987-a09c-29d60de41d9d None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:41:34.719768 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba8dda6-e12e-4987-a09c-29d60de41d9d None admin] PATH_INFO: `/v3/projects` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:41:34.720823 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba8dda6-e12e-4987-a09c-29d60de41d9d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:41:34.722665 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba8dda6-e12e-4987-a09c-29d60de41d9d None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:41:34.767421 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 53/106] 10.222.0.15 () {60 vars in 1141 bytes} [Sun Oct 9 00:41:34 2022] POST /identity/v3/projects => generated 302 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 09 00:41:34.769014 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734b3eac-4911-4c9d-bb94-c036a3a304c9 None None] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:41:34.769524 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734b3eac-4911-4c9d-bb94-c036a3a304c9 None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:41:34.769986 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734b3eac-4911-4c9d-bb94-c036a3a304c9 None None] PATH_INFO: `/` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:41:34.772633 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 54/107] 10.222.0.15 () {54 vars in 927 bytes} [Sun Oct 9 00:41:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:41:34.781036 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35cf4e0-80ae-4acf-9aae-a1f20ecb5e69 None None] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:41:34.781534 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35cf4e0-80ae-4acf-9aae-a1f20ecb5e69 None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:41:34.781968 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35cf4e0-80ae-4acf-9aae-a1f20ecb5e69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:41:34.805671 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a9da2f-21d1-40ff-83f5-14320bd1035d None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:41:34.813911 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:41:34.817021 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.auth.core [None req-a35cf4e0-80ae-4acf-9aae-a1f20ecb5e69 None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:41:34.818313 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-a35cf4e0-80ae-4acf-9aae-a1f20ecb5e69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:41:34.869513 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b84b0c0-3975-4e02-a363-045baca4b8a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:41:34.870478 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b84b0c0-3975-4e02-a363-045baca4b8a3 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:41:34.870888 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b84b0c0-3975-4e02-a363-045baca4b8a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:41:34.871320 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b84b0c0-3975-4e02-a363-045baca4b8a3 None admin] PATH_INFO: `/v3/roles` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:41:34.872140 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b84b0c0-3975-4e02-a363-045baca4b8a3 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:41:34.872611 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b84b0c0-3975-4e02-a363-045baca4b8a3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:41:34.874510 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b84b0c0-3975-4e02-a363-045baca4b8a3 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:41:34.892460 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 54/108] 10.222.0.15 () {56 vars in 1101 bytes} [Sun Oct 9 00:41:34 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:41:34.910188 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b84b0c0-3975-4e02-a363-045baca4b8a3 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:41:34.954287 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 55/109] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Oct 9 00:41:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 09 00:41:34.991893 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35cf4e0-80ae-4acf-9aae-a1f20ecb5e69 None None] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:41:35.041943 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b84b0c0-3975-4e02-a363-045baca4b8a3 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:41:35.044298 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:41:35.129786 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c147ae4-0ac7-40e7-9ab9-aa795ed68dd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:41:35.130637 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c147ae4-0ac7-40e7-9ab9-aa795ed68dd3 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:41:35.131010 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c147ae4-0ac7-40e7-9ab9-aa795ed68dd3 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:41:35.131491 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c147ae4-0ac7-40e7-9ab9-aa795ed68dd3 None admin] PATH_INFO: `/v3/users/dad78f63674a4c108c90af4c08cee5ba` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:41:35.153006 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c147ae4-0ac7-40e7-9ab9-aa795ed68dd3 None admin] RBAC: Authorizing `identity:get_user(user_id=dad78f63674a4c108c90af4c08cee5ba)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:41:35.154587 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c147ae4-0ac7-40e7-9ab9-aa795ed68dd3 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:41:35.156389 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 55/110] 10.222.0.15 () {56 vars in 1177 bytes} [Sun Oct 9 00:41:34 2022] GET /identity/v3/users/dad78f63674a4c108c90af4c08cee5ba => generated 289 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:41:35.162993 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c147ae4-0ac7-40e7-9ab9-aa795ed68dd3 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:41:35.199792 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:41:35.243686 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35cf4e0-80ae-4acf-9aae-a1f20ecb5e69 None None] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:41:35.288048 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cfa24a-509c-4327-9584-54f4354ee1cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:41:35.288939 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cfa24a-509c-4327-9584-54f4354ee1cc None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:41:35.289439 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cfa24a-509c-4327-9584-54f4354ee1cc None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:41:35.289950 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cfa24a-509c-4327-9584-54f4354ee1cc None admin] PATH_INFO: `/v3/roles/member` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:41:35.296094 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c147ae4-0ac7-40e7-9ab9-aa795ed68dd3 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:41:35.302039 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cfa24a-509c-4327-9584-54f4354ee1cc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 09 00:41:35.307775 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application [None req-09cfa24a-509c-4327-9584-54f4354ee1cc None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 09 00:41:35.307775 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:41:35.307775 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:41:35.307775 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:41:35.307775 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:41:35.307775 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:41:35.307775 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:41:35.307775 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:41:35.307775 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:41:35.307775 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:41:35.307775 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:41:35.307775 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:41:35.307775 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 09 00:41:35.307775 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 09 00:41:35.307775 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 09 00:41:35.307775 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 09 00:41:35.308843 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 09 00:41:35.308843 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 09 00:41:35.308843 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 09 00:41:35.308843 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 09 00:41:35.308843 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:41:35.308843 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:41:35.308843 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:41:35.308843 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:41:35.308843 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:41:35.308843 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:41:35.308843 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:41:35.308843 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application with Lock( Oct 09 00:41:35.308843 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:41:35.308843 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:41:35.308843 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:41:35.308843 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:41:35.309778 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:41:35.309778 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:41:35.309778 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:41:35.309778 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:41:35.309778 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 09 00:41:35.309778 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 09 00:41:35.309778 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 09 00:41:35.309778 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 09 00:41:35.309778 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 09 00:41:35.309778 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 09 00:41:35.309778 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 09 00:41:35.309778 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Oct 09 00:41:35.311986 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 56/111] 10.222.0.15 () {56 vars in 1099 bytes} [Sun Oct 9 00:41:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 321 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 09 00:41:35.314000 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa272fc-1fff-456a-80a6-bdab698bad29 None None] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:41:35.314564 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa272fc-1fff-456a-80a6-bdab698bad29 None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:41:35.314982 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa272fc-1fff-456a-80a6-bdab698bad29 None None] PATH_INFO: `/` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:41:35.317339 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 57/112] 10.222.0.15 () {54 vars in 927 bytes} [Sun Oct 9 00:41:35 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:41:35.318899 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d988e771-33d2-4cb0-b357-4566b7addba0 None None] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:41:35.319413 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d988e771-33d2-4cb0-b357-4566b7addba0 None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:41:35.319821 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d988e771-33d2-4cb0-b357-4566b7addba0 None None] PATH_INFO: `/` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:41:35.321291 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 58/113] 10.222.0.15 () {54 vars in 927 bytes} [Sun Oct 9 00:41:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:41:35.322326 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d988e771-33d2-4cb0-b357-4566b7addba0 None None] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:41:35.333424 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9076b0-f604-40c8-993f-97f20823da07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:41:35.333903 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9076b0-f604-40c8-993f-97f20823da07 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:41:35.334240 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9076b0-f604-40c8-993f-97f20823da07 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:41:35.334512 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9076b0-f604-40c8-993f-97f20823da07 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:41:35.405413 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9076b0-f604-40c8-993f-97f20823da07 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:41:35.406924 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9076b0-f604-40c8-993f-97f20823da07 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:41:35.418456 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:41:35.437915 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d988e771-33d2-4cb0-b357-4566b7addba0 None None] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:41:35.440636 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:41:35.471506 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10977fd5-6d04-4b7f-b760-7a53d0fc0a3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:41:35.472855 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10977fd5-6d04-4b7f-b760-7a53d0fc0a3b None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:41:35.473329 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10977fd5-6d04-4b7f-b760-7a53d0fc0a3b None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:41:35.473792 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10977fd5-6d04-4b7f-b760-7a53d0fc0a3b None admin] PATH_INFO: `/v3/roles` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:41:35.474669 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10977fd5-6d04-4b7f-b760-7a53d0fc0a3b None admin] RBAC: Adding query filter params (name=member) {{(pid=81525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:41:35.475075 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10977fd5-6d04-4b7f-b760-7a53d0fc0a3b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:41:35.476524 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10977fd5-6d04-4b7f-b760-7a53d0fc0a3b None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:41:35.489462 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 59/114] 10.222.0.15 () {56 vars in 1101 bytes} [Sun Oct 9 00:41:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:41:35.489462 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10977fd5-6d04-4b7f-b760-7a53d0fc0a3b None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:41:35.528421 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 56/115] 10.222.0.15 () {58 vars in 1282 bytes} [Sun Oct 9 00:41:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 09 00:41:35.529514 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e33371-db2f-4077-85fc-3ab70039dfc1 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:41:35.529960 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e33371-db2f-4077-85fc-3ab70039dfc1 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:41:35.530397 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e33371-db2f-4077-85fc-3ab70039dfc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:41:35.550722 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-a2e33371-db2f-4077-85fc-3ab70039dfc1 None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:41:35.552063 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-a2e33371-db2f-4077-85fc-3ab70039dfc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:41:35.594975 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10977fd5-6d04-4b7f-b760-7a53d0fc0a3b None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:41:35.626596 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 57/116] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Oct 9 00:41:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 09 00:41:35.626596 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6055b7-e42e-455b-976c-6c366fb1f9cd None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:41:35.626596 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6055b7-e42e-455b-976c-6c366fb1f9cd None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:41:35.626596 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6055b7-e42e-455b-976c-6c366fb1f9cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:41:35.639490 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8a2483-e76d-4926-8282-77216f3b997a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:41:35.640267 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8a2483-e76d-4926-8282-77216f3b997a None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:41:35.640607 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8a2483-e76d-4926-8282-77216f3b997a None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:41:35.640950 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8a2483-e76d-4926-8282-77216f3b997a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:41:35.653128 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-bd6055b7-e42e-455b-976c-6c366fb1f9cd None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:41:35.654054 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8a2483-e76d-4926-8282-77216f3b997a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 09 00:41:35.654642 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-bd6055b7-e42e-455b-976c-6c366fb1f9cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:41:35.660031 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application [None req-bf8a2483-e76d-4926-8282-77216f3b997a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 09 00:41:35.660031 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:41:35.660031 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:41:35.660031 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:41:35.660031 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:41:35.660031 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:41:35.660031 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:41:35.660031 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:41:35.660031 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:41:35.660031 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:41:35.660031 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:41:35.660031 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:41:35.660031 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 09 00:41:35.660031 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 09 00:41:35.660031 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 09 00:41:35.660031 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 09 00:41:35.660876 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 09 00:41:35.660876 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 09 00:41:35.660876 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 09 00:41:35.660876 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 09 00:41:35.660876 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:41:35.660876 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:41:35.660876 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:41:35.660876 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:41:35.660876 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:41:35.660876 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:41:35.660876 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:41:35.660876 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application with Lock( Oct 09 00:41:35.660876 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:41:35.660876 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:41:35.660876 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:41:35.660876 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:41:35.661677 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:41:35.661677 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:41:35.661677 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:41:35.661677 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:41:35.661677 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 09 00:41:35.661677 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 09 00:41:35.661677 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 09 00:41:35.661677 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 09 00:41:35.661677 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 09 00:41:35.661677 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 09 00:41:35.661677 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 09 00:41:35.661677 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Oct 09 00:41:35.663966 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 60/117] 10.222.0.15 () {56 vars in 1096 bytes} [Sun Oct 9 00:41:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:41:35.664936 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8a2483-e76d-4926-8282-77216f3b997a None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:41:35.674347 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:41:35.717185 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:41:35.739905 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 58/118] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Oct 9 00:41:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 09 00:41:35.744211 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6055b7-e42e-455b-976c-6c366fb1f9cd None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:41:35.822977 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8a2483-e76d-4926-8282-77216f3b997a None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:41:35.884386 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950abf90-5f8f-4c62-9e6d-db70ff7067b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:41:35.886492 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950abf90-5f8f-4c62-9e6d-db70ff7067b8 None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:41:35.888576 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950abf90-5f8f-4c62-9e6d-db70ff7067b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:41:35.889048 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950abf90-5f8f-4c62-9e6d-db70ff7067b8 None admin] PATH_INFO: `/v3/users/52f47c8c5b524339a22bd58a6fa05fd5` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:41:35.892190 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950abf90-5f8f-4c62-9e6d-db70ff7067b8 None admin] RBAC: Authorizing `identity:get_user(user_id=52f47c8c5b524339a22bd58a6fa05fd5)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:41:35.894846 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950abf90-5f8f-4c62-9e6d-db70ff7067b8 None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:41:35.899895 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 61/119] 10.222.0.15 () {56 vars in 1177 bytes} [Sun Oct 9 00:41:35 2022] GET /identity/v3/users/52f47c8c5b524339a22bd58a6fa05fd5 => generated 275 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:41:35.901358 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950abf90-5f8f-4c62-9e6d-db70ff7067b8 None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:41:35.940268 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6055b7-e42e-455b-976c-6c366fb1f9cd None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:41:35.986154 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccd3316-3d2c-4924-b1f2-98f807699bee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:41:35.986809 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccd3316-3d2c-4924-b1f2-98f807699bee None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:41:35.987091 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccd3316-3d2c-4924-b1f2-98f807699bee None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:41:35.987396 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccd3316-3d2c-4924-b1f2-98f807699bee None admin] PATH_INFO: `/v3/projects/3fcf2f5182c445929c38948df6235040` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:41:35.988652 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccd3316-3d2c-4924-b1f2-98f807699bee None admin] RBAC: Authorizing `identity:get_project(project_id=3fcf2f5182c445929c38948df6235040)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:41:35.990233 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccd3316-3d2c-4924-b1f2-98f807699bee None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:41:35.991944 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 59/120] 10.222.0.15 () {56 vars in 1186 bytes} [Sun Oct 9 00:41:35 2022] GET /identity/v3/projects/3fcf2f5182c445929c38948df6235040 => generated 298 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:41:35.992721 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccd3316-3d2c-4924-b1f2-98f807699bee None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:41:35.996056 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:41:36.023420 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950abf90-5f8f-4c62-9e6d-db70ff7067b8 None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:41:36.055561 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:41:36.057328 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c1c608-e93a-4a99-92b7-e12a7202f080 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:41:36.058264 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c1c608-e93a-4a99-92b7-e12a7202f080 None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:41:36.058600 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c1c608-e93a-4a99-92b7-e12a7202f080 None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:41:36.058878 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c1c608-e93a-4a99-92b7-e12a7202f080 None admin] PATH_INFO: `/v3/roles` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:41:36.059653 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c1c608-e93a-4a99-92b7-e12a7202f080 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:41:36.059955 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c1c608-e93a-4a99-92b7-e12a7202f080 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:41:36.061369 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c1c608-e93a-4a99-92b7-e12a7202f080 None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:41:36.069756 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 62/121] 10.222.0.15 () {56 vars in 1099 bytes} [Sun Oct 9 00:41:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:41:36.074503 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c1c608-e93a-4a99-92b7-e12a7202f080 None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:41:36.104509 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccd3316-3d2c-4924-b1f2-98f807699bee None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:41:36.139402 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b4780a-b9b6-46a6-887a-399d6019e06c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:41:36.140050 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b4780a-b9b6-46a6-887a-399d6019e06c None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:41:36.140338 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b4780a-b9b6-46a6-887a-399d6019e06c None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:41:36.140615 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b4780a-b9b6-46a6-887a-399d6019e06c None admin] PATH_INFO: `/v3/projects/3fcf2f5182c445929c38948df6235040` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:41:36.141747 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b4780a-b9b6-46a6-887a-399d6019e06c None admin] RBAC: Authorizing `identity:get_project(project_id=3fcf2f5182c445929c38948df6235040)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:41:36.143231 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b4780a-b9b6-46a6-887a-399d6019e06c None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:41:36.144905 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 60/122] 10.222.0.15 () {56 vars in 1186 bytes} [Sun Oct 9 00:41:35 2022] GET /identity/v3/projects/3fcf2f5182c445929c38948df6235040 => generated 298 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:41:36.149784 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b4780a-b9b6-46a6-887a-399d6019e06c None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:41:36.180561 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c1c608-e93a-4a99-92b7-e12a7202f080 None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:41:36.214332 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d768e867-1149-4aa1-878d-54b42c90a6ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:41:36.214986 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d768e867-1149-4aa1-878d-54b42c90a6ca None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:41:36.215290 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d768e867-1149-4aa1-878d-54b42c90a6ca None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:41:36.215652 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d768e867-1149-4aa1-878d-54b42c90a6ca None admin] PATH_INFO: `/v3/roles/member` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:41:36.218494 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:41:36.229160 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d768e867-1149-4aa1-878d-54b42c90a6ca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 09 00:41:36.234621 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application [None req-d768e867-1149-4aa1-878d-54b42c90a6ca None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 09 00:41:36.234621 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:41:36.234621 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:41:36.234621 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:41:36.234621 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:41:36.234621 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:41:36.234621 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:41:36.234621 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:41:36.234621 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:41:36.234621 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:41:36.234621 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:41:36.234621 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:41:36.234621 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 09 00:41:36.234621 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 09 00:41:36.234621 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 09 00:41:36.234621 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 09 00:41:36.235517 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 09 00:41:36.235517 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 09 00:41:36.235517 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 09 00:41:36.235517 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 09 00:41:36.235517 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:41:36.235517 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:41:36.235517 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:41:36.235517 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:41:36.235517 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:41:36.235517 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:41:36.235517 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:41:36.235517 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application with Lock( Oct 09 00:41:36.235517 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:41:36.235517 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:41:36.235517 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:41:36.235517 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:41:36.236267 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:41:36.236267 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:41:36.236267 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:41:36.236267 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:41:36.236267 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 09 00:41:36.236267 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 09 00:41:36.236267 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 09 00:41:36.236267 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 09 00:41:36.236267 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 09 00:41:36.236267 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 09 00:41:36.236267 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 09 00:41:36.236267 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Oct 09 00:41:36.236267 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 63/123] 10.222.0.15 () {56 vars in 1099 bytes} [Sun Oct 9 00:41:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:41:36.236966 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d768e867-1149-4aa1-878d-54b42c90a6ca None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:41:36.256624 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b4780a-b9b6-46a6-887a-399d6019e06c None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:41:36.279866 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:41:36.292598 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161bd5c9-5cbe-4e5a-bfb9-4b66d3ccae26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:41:36.293218 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161bd5c9-5cbe-4e5a-bfb9-4b66d3ccae26 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:41:36.293502 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161bd5c9-5cbe-4e5a-bfb9-4b66d3ccae26 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:41:36.293945 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161bd5c9-5cbe-4e5a-bfb9-4b66d3ccae26 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:41:36.294691 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161bd5c9-5cbe-4e5a-bfb9-4b66d3ccae26 None admin] RBAC: Adding query filter params (role.id=9da5e6c99f594f149e3f29f97cf55e7e, scope.project.id=3fcf2f5182c445929c38948df6235040, user.id=dad78f63674a4c108c90af4c08cee5ba) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:41:36.294998 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161bd5c9-5cbe-4e5a-bfb9-4b66d3ccae26 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:41:36.296508 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161bd5c9-5cbe-4e5a-bfb9-4b66d3ccae26 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:41:36.302327 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 61/124] 10.222.0.15 () {56 vars in 1374 bytes} [Sun Oct 9 00:41:36 2022] GET /identity/v3/role_assignments?user.id=dad78f63674a4c108c90af4c08cee5ba&scope.project.id=3fcf2f5182c445929c38948df6235040&role.id=9da5e6c99f594f149e3f29f97cf55e7e => generated 259 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:41:36.303135 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161bd5c9-5cbe-4e5a-bfb9-4b66d3ccae26 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:41:36.372040 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d768e867-1149-4aa1-878d-54b42c90a6ca None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:41:36.420057 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161bd5c9-5cbe-4e5a-bfb9-4b66d3ccae26 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:41:36.423972 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4211070-0097-45e3-902e-f85057a82891 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:41:36.424654 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4211070-0097-45e3-902e-f85057a82891 None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:41:36.424942 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4211070-0097-45e3-902e-f85057a82891 None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:41:36.425276 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4211070-0097-45e3-902e-f85057a82891 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:41:36.445895 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4211070-0097-45e3-902e-f85057a82891 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 09 00:41:36.452018 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application [None req-c4211070-0097-45e3-902e-f85057a82891 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 09 00:41:36.452018 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:41:36.452018 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:41:36.452018 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:41:36.452018 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:41:36.452018 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:41:36.452018 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:41:36.452018 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:41:36.452018 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:41:36.452018 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:41:36.452018 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:41:36.452018 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:41:36.452018 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 09 00:41:36.452018 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 09 00:41:36.452018 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 09 00:41:36.452018 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 09 00:41:36.452944 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 09 00:41:36.452944 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 09 00:41:36.452944 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 09 00:41:36.452944 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 09 00:41:36.452944 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:41:36.452944 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:41:36.452944 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:41:36.452944 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:41:36.452944 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:41:36.452944 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:41:36.452944 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:41:36.452944 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application with Lock( Oct 09 00:41:36.452944 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:41:36.452944 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:41:36.452944 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:41:36.452944 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:41:36.453699 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:41:36.453699 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:41:36.453699 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:41:36.453699 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:41:36.453699 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 09 00:41:36.453699 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 09 00:41:36.453699 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 09 00:41:36.453699 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 09 00:41:36.453699 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 09 00:41:36.453699 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 09 00:41:36.453699 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 09 00:41:36.453699 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Oct 09 00:41:36.453699 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 64/125] 10.222.0.15 () {56 vars in 1114 bytes} [Sun Oct 9 00:41:36 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:41:36.454354 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4211070-0097-45e3-902e-f85057a82891 None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:41:36.472436 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7fdd45-7f20-4150-82f2-0c6a14799ff0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:41:36.473070 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7fdd45-7f20-4150-82f2-0c6a14799ff0 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:41:36.473357 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7fdd45-7f20-4150-82f2-0c6a14799ff0 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:41:36.473646 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7fdd45-7f20-4150-82f2-0c6a14799ff0 None admin] PATH_INFO: `/v3/users/99441f7488cd4b83be4affd132b7c074` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:41:36.474896 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7fdd45-7f20-4150-82f2-0c6a14799ff0 None admin] RBAC: Authorizing `identity:get_user(user_id=99441f7488cd4b83be4affd132b7c074)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:41:36.476529 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7fdd45-7f20-4150-82f2-0c6a14799ff0 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:41:36.478535 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 62/126] 10.222.0.15 () {56 vars in 1177 bytes} [Sun Oct 9 00:41:36 2022] GET /identity/v3/users/99441f7488cd4b83be4affd132b7c074 => generated 247 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:41:36.479407 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7fdd45-7f20-4150-82f2-0c6a14799ff0 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:41:36.539124 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:41:36.545715 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:41:36.589942 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7fdd45-7f20-4150-82f2-0c6a14799ff0 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:41:36.598340 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4211070-0097-45e3-902e-f85057a82891 None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:41:36.625021 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cbc811-405e-4fa9-8d92-1d5d524873a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:41:36.625564 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cbc811-405e-4fa9-8d92-1d5d524873a2 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:41:36.625859 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cbc811-405e-4fa9-8d92-1d5d524873a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:41:36.626342 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cbc811-405e-4fa9-8d92-1d5d524873a2 None admin] PATH_INFO: `/v3/roles` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:41:36.627359 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cbc811-405e-4fa9-8d92-1d5d524873a2 None admin] RBAC: Adding query filter params (name=member) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:41:36.627712 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cbc811-405e-4fa9-8d92-1d5d524873a2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:41:36.631251 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cbc811-405e-4fa9-8d92-1d5d524873a2 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:41:36.641984 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 63/127] 10.222.0.15 () {56 vars in 1101 bytes} [Sun Oct 9 00:41:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:41:36.642903 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cbc811-405e-4fa9-8d92-1d5d524873a2 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:41:36.643186 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e0b3b7-520d-42b7-b6aa-35b951e0532a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:41:36.644099 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e0b3b7-520d-42b7-b6aa-35b951e0532a None admin] REQUEST_METHOD: `PUT` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:41:36.644583 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e0b3b7-520d-42b7-b6aa-35b951e0532a None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:41:36.645040 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e0b3b7-520d-42b7-b6aa-35b951e0532a None admin] PATH_INFO: `/v3/projects/3fcf2f5182c445929c38948df6235040/users/52f47c8c5b524339a22bd58a6fa05fd5/roles/afb0a01183d9497795eaa4fa1a4046ae` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:41:36.652227 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e0b3b7-520d-42b7-b6aa-35b951e0532a None admin] RBAC: Authorizing `identity:create_grant(project_id=3fcf2f5182c445929c38948df6235040, user_id=52f47c8c5b524339a22bd58a6fa05fd5, role_id=afb0a01183d9497795eaa4fa1a4046ae)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:41:36.654350 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e0b3b7-520d-42b7-b6aa-35b951e0532a None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:41:36.676558 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 65/128] 10.222.0.15 () {58 vars in 1439 bytes} [Sun Oct 9 00:41:36 2022] PUT /identity/v3/projects/3fcf2f5182c445929c38948df6235040/users/52f47c8c5b524339a22bd58a6fa05fd5/roles/afb0a01183d9497795eaa4fa1a4046ae => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 00:41:36.677418 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e0b3b7-520d-42b7-b6aa-35b951e0532a None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:41:36.827741 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cbc811-405e-4fa9-8d92-1d5d524873a2 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:41:36.854966 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e0b3b7-520d-42b7-b6aa-35b951e0532a None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:41:36.869434 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:41:36.886765 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:41:36.902678 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10b4f2e-fa83-4d3a-8a4c-8a3559ad062d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:41:36.904408 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10b4f2e-fa83-4d3a-8a4c-8a3559ad062d None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:41:36.904839 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10b4f2e-fa83-4d3a-8a4c-8a3559ad062d None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:41:36.905546 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10b4f2e-fa83-4d3a-8a4c-8a3559ad062d None admin] PATH_INFO: `/v3/projects/3fcf2f5182c445929c38948df6235040` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:41:36.907685 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10b4f2e-fa83-4d3a-8a4c-8a3559ad062d None admin] RBAC: Authorizing `identity:get_project(project_id=3fcf2f5182c445929c38948df6235040)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:41:36.911866 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10b4f2e-fa83-4d3a-8a4c-8a3559ad062d None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:41:36.914760 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 66/129] 10.222.0.15 () {56 vars in 1186 bytes} [Sun Oct 9 00:41:36 2022] GET /identity/v3/projects/3fcf2f5182c445929c38948df6235040 => generated 298 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:41:36.915851 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10b4f2e-fa83-4d3a-8a4c-8a3559ad062d None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:41:36.921046 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633931e5-4905-41f2-8ea2-ca3d3720b968 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:41:36.924149 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633931e5-4905-41f2-8ea2-ca3d3720b968 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:41:36.924341 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633931e5-4905-41f2-8ea2-ca3d3720b968 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:41:36.924587 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633931e5-4905-41f2-8ea2-ca3d3720b968 None admin] PATH_INFO: `/v3/roles` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:41:36.925284 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633931e5-4905-41f2-8ea2-ca3d3720b968 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:41:36.925592 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633931e5-4905-41f2-8ea2-ca3d3720b968 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:41:36.927072 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633931e5-4905-41f2-8ea2-ca3d3720b968 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:41:36.937171 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 64/130] 10.222.0.15 () {56 vars in 1111 bytes} [Sun Oct 9 00:41:36 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:41:36.937847 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633931e5-4905-41f2-8ea2-ca3d3720b968 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:41:37.048793 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10b4f2e-fa83-4d3a-8a4c-8a3559ad062d None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:41:37.058362 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633931e5-4905-41f2-8ea2-ca3d3720b968 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:41:37.100986 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf02f9c-a057-4b28-b4b0-15a699415cc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:41:37.103236 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf02f9c-a057-4b28-b4b0-15a699415cc9 None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:41:37.104575 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf02f9c-a057-4b28-b4b0-15a699415cc9 None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:41:37.105438 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf02f9c-a057-4b28-b4b0-15a699415cc9 None admin] PATH_INFO: `/v3/users/52f47c8c5b524339a22bd58a6fa05fd5` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:41:37.108282 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf02f9c-a057-4b28-b4b0-15a699415cc9 None admin] RBAC: Authorizing `identity:get_user(user_id=52f47c8c5b524339a22bd58a6fa05fd5)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:41:37.110529 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf02f9c-a057-4b28-b4b0-15a699415cc9 None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:41:37.113103 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 67/131] 10.222.0.15 () {56 vars in 1177 bytes} [Sun Oct 9 00:41:36 2022] GET /identity/v3/users/52f47c8c5b524339a22bd58a6fa05fd5 => generated 275 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:41:37.114019 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0562f551-a77e-4cc6-b4be-1ebd9b9d1a1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:41:37.114926 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0562f551-a77e-4cc6-b4be-1ebd9b9d1a1d None admin] REQUEST_METHOD: `PUT` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:41:37.119514 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0562f551-a77e-4cc6-b4be-1ebd9b9d1a1d None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:41:37.120084 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0562f551-a77e-4cc6-b4be-1ebd9b9d1a1d None admin] PATH_INFO: `/v3/projects/3fcf2f5182c445929c38948df6235040/users/99441f7488cd4b83be4affd132b7c074/roles/f69dddf26daf4dd79d4c962beb877af5` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:41:37.122092 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf02f9c-a057-4b28-b4b0-15a699415cc9 None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:41:37.123836 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0562f551-a77e-4cc6-b4be-1ebd9b9d1a1d None admin] RBAC: Authorizing `identity:create_grant(project_id=3fcf2f5182c445929c38948df6235040, user_id=99441f7488cd4b83be4affd132b7c074, role_id=f69dddf26daf4dd79d4c962beb877af5)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:41:37.126255 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0562f551-a77e-4cc6-b4be-1ebd9b9d1a1d None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:41:37.159983 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 65/132] 10.222.0.15 () {58 vars in 1439 bytes} [Sun Oct 9 00:41:36 2022] PUT /identity/v3/projects/3fcf2f5182c445929c38948df6235040/users/99441f7488cd4b83be4affd132b7c074/roles/f69dddf26daf4dd79d4c962beb877af5 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 00:41:37.161261 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0562f551-a77e-4cc6-b4be-1ebd9b9d1a1d None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:41:37.223753 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:41:37.252834 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:41:37.311346 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf02f9c-a057-4b28-b4b0-15a699415cc9 None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:41:37.353333 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21156e0-fa92-44f5-8be3-d87d01181736 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:41:37.354471 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21156e0-fa92-44f5-8be3-d87d01181736 None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:41:37.354949 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21156e0-fa92-44f5-8be3-d87d01181736 None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:41:37.355634 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21156e0-fa92-44f5-8be3-d87d01181736 None admin] PATH_INFO: `/v3/users/52f47c8c5b524339a22bd58a6fa05fd5` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:41:37.357153 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21156e0-fa92-44f5-8be3-d87d01181736 None admin] RBAC: Authorizing `identity:get_user(user_id=52f47c8c5b524339a22bd58a6fa05fd5)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:41:37.358954 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21156e0-fa92-44f5-8be3-d87d01181736 None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:41:37.360927 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 68/133] 10.222.0.15 () {56 vars in 1177 bytes} [Sun Oct 9 00:41:37 2022] GET /identity/v3/users/52f47c8c5b524339a22bd58a6fa05fd5 => generated 275 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:41:37.368362 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21156e0-fa92-44f5-8be3-d87d01181736 None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:41:37.407294 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0562f551-a77e-4cc6-b4be-1ebd9b9d1a1d None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:41:37.471041 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d169d8e-6902-4421-98e9-9ec6ed2c7a4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:41:37.471732 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d169d8e-6902-4421-98e9-9ec6ed2c7a4c None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:41:37.472459 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d169d8e-6902-4421-98e9-9ec6ed2c7a4c None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:41:37.472459 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d169d8e-6902-4421-98e9-9ec6ed2c7a4c None admin] PATH_INFO: `/v3/projects/48e7ff122cb7468dbacb2726fd2bd965` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:41:37.474282 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d169d8e-6902-4421-98e9-9ec6ed2c7a4c None admin] RBAC: Authorizing `identity:get_project(project_id=48e7ff122cb7468dbacb2726fd2bd965)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:41:37.475994 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d169d8e-6902-4421-98e9-9ec6ed2c7a4c None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:41:37.477640 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 66/134] 10.222.0.15 () {56 vars in 1186 bytes} [Sun Oct 9 00:41:37 2022] GET /identity/v3/projects/48e7ff122cb7468dbacb2726fd2bd965 => generated 312 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:41:37.478999 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9986d599-908b-4b7e-8c79-90ecff0792ca None None] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:41:37.479427 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9986d599-908b-4b7e-8c79-90ecff0792ca None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:41:37.479698 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9986d599-908b-4b7e-8c79-90ecff0792ca None None] PATH_INFO: `/` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:41:37.485790 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 67/135] 10.222.0.15 () {54 vars in 927 bytes} [Sun Oct 9 00:41:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:41:37.487011 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9986d599-908b-4b7e-8c79-90ecff0792ca None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:41:37.530866 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21156e0-fa92-44f5-8be3-d87d01181736 None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:41:37.555319 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:41:37.571873 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9964ccec-d6bc-4f78-8beb-84cc565409a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:41:37.572839 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9964ccec-d6bc-4f78-8beb-84cc565409a5 None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:41:37.573186 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9964ccec-d6bc-4f78-8beb-84cc565409a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:41:37.573742 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9964ccec-d6bc-4f78-8beb-84cc565409a5 None admin] PATH_INFO: `/v3/projects/3fcf2f5182c445929c38948df6235040` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:41:37.574954 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9964ccec-d6bc-4f78-8beb-84cc565409a5 None admin] RBAC: Authorizing `identity:get_project(project_id=3fcf2f5182c445929c38948df6235040)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:41:37.576468 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9964ccec-d6bc-4f78-8beb-84cc565409a5 None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:41:37.578344 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 69/136] 10.222.0.15 () {56 vars in 1186 bytes} [Sun Oct 9 00:41:37 2022] GET /identity/v3/projects/3fcf2f5182c445929c38948df6235040 => generated 298 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:41:37.579901 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1407e9-374f-4877-be50-bbcd19bbc95a None None] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:41:37.580485 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1407e9-374f-4877-be50-bbcd19bbc95a None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:41:37.580893 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1407e9-374f-4877-be50-bbcd19bbc95a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:41:37.602703 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.auth.core [None req-ba1407e9-374f-4877-be50-bbcd19bbc95a None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:41:37.604345 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-ba1407e9-374f-4877-be50-bbcd19bbc95a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:41:37.684988 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9986d599-908b-4b7e-8c79-90ecff0792ca None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:41:37.689183 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 70/137] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Oct 9 00:41:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 09 00:41:37.695356 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1407e9-374f-4877-be50-bbcd19bbc95a None None] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:41:37.696307 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:41:37.754495 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14882244-fcb6-47e8-95ea-7a9f50e2421e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:41:37.755167 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14882244-fcb6-47e8-95ea-7a9f50e2421e None admin] REQUEST_METHOD: `PUT` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:41:37.755479 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14882244-fcb6-47e8-95ea-7a9f50e2421e None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:41:37.755746 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14882244-fcb6-47e8-95ea-7a9f50e2421e None admin] PATH_INFO: `/v3/projects/48e7ff122cb7468dbacb2726fd2bd965/users/52f47c8c5b524339a22bd58a6fa05fd5/roles/afb0a01183d9497795eaa4fa1a4046ae` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:41:37.757657 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14882244-fcb6-47e8-95ea-7a9f50e2421e None admin] RBAC: Authorizing `identity:create_grant(project_id=48e7ff122cb7468dbacb2726fd2bd965, user_id=52f47c8c5b524339a22bd58a6fa05fd5, role_id=afb0a01183d9497795eaa4fa1a4046ae)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:41:37.759131 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14882244-fcb6-47e8-95ea-7a9f50e2421e None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:41:37.785895 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 68/138] 10.222.0.15 () {58 vars in 1439 bytes} [Sun Oct 9 00:41:37 2022] PUT /identity/v3/projects/48e7ff122cb7468dbacb2726fd2bd965/users/52f47c8c5b524339a22bd58a6fa05fd5/roles/afb0a01183d9497795eaa4fa1a4046ae => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 00:41:37.872108 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1407e9-374f-4877-be50-bbcd19bbc95a None None] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:41:37.897369 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:41:37.920177 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b03eb5-1762-4885-a6fa-5d00cb98d6c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:41:37.920883 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b03eb5-1762-4885-a6fa-5d00cb98d6c4 None admin] REQUEST_METHOD: `PUT` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:41:37.921216 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b03eb5-1762-4885-a6fa-5d00cb98d6c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:41:37.921496 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b03eb5-1762-4885-a6fa-5d00cb98d6c4 None admin] PATH_INFO: `/v3/projects/3fcf2f5182c445929c38948df6235040/users/52f47c8c5b524339a22bd58a6fa05fd5/roles/93f141c2a808407dae6f9704941d0cb2` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:41:37.928455 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b03eb5-1762-4885-a6fa-5d00cb98d6c4 None admin] RBAC: Authorizing `identity:create_grant(project_id=3fcf2f5182c445929c38948df6235040, user_id=52f47c8c5b524339a22bd58a6fa05fd5, role_id=93f141c2a808407dae6f9704941d0cb2)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:41:37.930060 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b03eb5-1762-4885-a6fa-5d00cb98d6c4 None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:41:37.957595 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 71/139] 10.222.0.15 () {58 vars in 1439 bytes} [Sun Oct 9 00:41:37 2022] PUT /identity/v3/projects/3fcf2f5182c445929c38948df6235040/users/52f47c8c5b524339a22bd58a6fa05fd5/roles/93f141c2a808407dae6f9704941d0cb2 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 00:41:38.097195 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14882244-fcb6-47e8-95ea-7a9f50e2421e None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:41:38.224016 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14882244-fcb6-47e8-95ea-7a9f50e2421e None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:41:38.264299 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0361d22-5f25-4d17-973a-73f6d76fbb72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:41:38.265334 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0361d22-5f25-4d17-973a-73f6d76fbb72 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:41:38.265822 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0361d22-5f25-4d17-973a-73f6d76fbb72 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:41:38.266300 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0361d22-5f25-4d17-973a-73f6d76fbb72 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:41:38.267656 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0361d22-5f25-4d17-973a-73f6d76fbb72 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:41:38.269416 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0361d22-5f25-4d17-973a-73f6d76fbb72 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:41:38.271547 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 69/140] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Oct 9 00:41:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:41:38.277359 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b03eb5-1762-4885-a6fa-5d00cb98d6c4 None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:41:38.415400 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b03eb5-1762-4885-a6fa-5d00cb98d6c4 None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:41:38.469159 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b920fac-113d-4231-bd76-7d1a697d09f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:41:38.469784 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b920fac-113d-4231-bd76-7d1a697d09f4 None admin] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:41:38.470065 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b920fac-113d-4231-bd76-7d1a697d09f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:41:38.470332 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b920fac-113d-4231-bd76-7d1a697d09f4 None admin] PATH_INFO: `/v3/users` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:41:38.471005 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b920fac-113d-4231-bd76-7d1a697d09f4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:41:38.472498 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b920fac-113d-4231-bd76-7d1a697d09f4 None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:41:38.511844 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 72/141] 10.222.0.15 () {60 vars in 1132 bytes} [Sun Oct 9 00:41:38 2022] POST /identity/v3/users => generated 283 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 09 00:41:39.372549 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f3c4a3-edf9-44bc-9f8c-b60ac2aa3f2d None None] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:41:39.372549 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f3c4a3-edf9-44bc-9f8c-b60ac2aa3f2d None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:41:39.372549 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f3c4a3-edf9-44bc-9f8c-b60ac2aa3f2d None None] PATH_INFO: `/` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:41:39.374305 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 70/142] 10.222.0.15 () {54 vars in 927 bytes} [Sun Oct 9 00:41:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:41:39.390432 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc6f1c6-0921-418d-8ff1-0de085afdeb8 None None] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:41:39.390945 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc6f1c6-0921-418d-8ff1-0de085afdeb8 None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:41:39.390945 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc6f1c6-0921-418d-8ff1-0de085afdeb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:41:39.416665 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.auth.core [None req-9fc6f1c6-0921-418d-8ff1-0de085afdeb8 None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:41:39.417870 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-9fc6f1c6-0921-418d-8ff1-0de085afdeb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:41:39.470354 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:41:39.524035 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 73/143] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Oct 9 00:41:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 09 00:41:39.694205 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9d0d48-db37-464a-b726-1ff389450f17 None None] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:41:39.694205 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9d0d48-db37-464a-b726-1ff389450f17 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:41:39.694205 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9d0d48-db37-464a-b726-1ff389450f17 None None] PATH_INFO: `/` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:41:39.694205 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 71/144] 10.222.0.15 () {54 vars in 927 bytes} [Sun Oct 9 00:41:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:41:39.701375 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbdd528-5df0-4eef-a817-6a065debea7d None None] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:41:39.701697 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbdd528-5df0-4eef-a817-6a065debea7d None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:41:39.701924 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbdd528-5df0-4eef-a817-6a065debea7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:41:39.724728 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.auth.core [None req-abbdd528-5df0-4eef-a817-6a065debea7d None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:41:39.725929 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-abbdd528-5df0-4eef-a817-6a065debea7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:41:39.813866 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 74/145] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Oct 9 00:41:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 09 00:41:40.043673 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9d0d48-db37-464a-b726-1ff389450f17 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:41:40.090070 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:41:40.181042 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9d0d48-db37-464a-b726-1ff389450f17 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:41:40.224072 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b117c7-7ccb-40c7-ac9d-d41752024da5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:41:40.225072 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b117c7-7ccb-40c7-ac9d-d41752024da5 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:41:40.225619 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b117c7-7ccb-40c7-ac9d-d41752024da5 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:41:40.226117 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b117c7-7ccb-40c7-ac9d-d41752024da5 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:41:40.236895 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b15a36-f4f9-4c17-ad66-2dd34d2a0beb None None] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:41:40.237233 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b15a36-f4f9-4c17-ad66-2dd34d2a0beb None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:41:40.237458 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b15a36-f4f9-4c17-ad66-2dd34d2a0beb None None] PATH_INFO: `/` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:41:40.239060 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 75/146] 10.222.0.15 () {54 vars in 927 bytes} [Sun Oct 9 00:41:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:41:40.242713 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b117c7-7ccb-40c7-ac9d-d41752024da5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 09 00:41:40.247306 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a021481-edfd-4277-90b2-989a45518244 None None] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:41:40.247306 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a021481-edfd-4277-90b2-989a45518244 None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:41:40.247306 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a021481-edfd-4277-90b2-989a45518244 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:41:40.248569 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application [None req-04b117c7-7ccb-40c7-ac9d-d41752024da5 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 09 00:41:40.248569 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:41:40.248569 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:41:40.248569 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:41:40.248569 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:41:40.248569 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:41:40.248569 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:41:40.248569 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:41:40.248569 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:41:40.248569 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:41:40.248569 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:41:40.248569 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:41:40.248569 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 09 00:41:40.248569 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 09 00:41:40.248569 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 09 00:41:40.248569 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 09 00:41:40.249779 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 09 00:41:40.249779 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 09 00:41:40.249779 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 09 00:41:40.249779 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 09 00:41:40.249779 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:41:40.249779 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:41:40.249779 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:41:40.249779 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:41:40.249779 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:41:40.249779 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:41:40.249779 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:41:40.249779 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application with Lock( Oct 09 00:41:40.249779 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:41:40.249779 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:41:40.249779 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:41:40.249779 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:41:40.250916 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:41:40.250916 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:41:40.250916 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:41:40.250916 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:41:40.250916 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 09 00:41:40.250916 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 09 00:41:40.250916 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 09 00:41:40.250916 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 09 00:41:40.250916 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 09 00:41:40.250916 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 09 00:41:40.250916 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 09 00:41:40.250916 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application Oct 09 00:41:40.250916 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 72/147] 10.222.0.15 () {56 vars in 1099 bytes} [Sun Oct 9 00:41:40 2022] GET /identity/v3/roles/reader => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:41:40.256308 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b117c7-7ccb-40c7-ac9d-d41752024da5 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:41:40.277966 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.auth.core [None req-2a021481-edfd-4277-90b2-989a45518244 None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:41:40.279574 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-2a021481-edfd-4277-90b2-989a45518244 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:41:40.370803 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 76/148] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Oct 9 00:41:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 09 00:41:40.374763 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a021481-edfd-4277-90b2-989a45518244 None None] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:41:40.390892 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:41:40.399774 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:41:40.408120 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b117c7-7ccb-40c7-ac9d-d41752024da5 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:41:40.464628 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9be38ce-f3c1-4061-9099-06faf4787411 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:41:40.465466 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9be38ce-f3c1-4061-9099-06faf4787411 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:41:40.465835 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9be38ce-f3c1-4061-9099-06faf4787411 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:41:40.466197 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9be38ce-f3c1-4061-9099-06faf4787411 None admin] PATH_INFO: `/v3/roles` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:41:40.467079 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9be38ce-f3c1-4061-9099-06faf4787411 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:41:40.467555 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9be38ce-f3c1-4061-9099-06faf4787411 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:41:40.469122 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9be38ce-f3c1-4061-9099-06faf4787411 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:41:40.483500 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 73/149] 10.222.0.15 () {56 vars in 1101 bytes} [Sun Oct 9 00:41:40 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 09 00:41:40.484378 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a021481-edfd-4277-90b2-989a45518244 None None] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:41:40.491827 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9be38ce-f3c1-4061-9099-06faf4787411 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:41:40.527767 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e3a218-c662-4155-8bd2-7e742c757c4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:41:40.528859 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e3a218-c662-4155-8bd2-7e742c757c4d None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:41:40.529346 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e3a218-c662-4155-8bd2-7e742c757c4d None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:41:40.529816 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e3a218-c662-4155-8bd2-7e742c757c4d None admin] PATH_INFO: `/v3/roles/member` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:41:40.544250 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e3a218-c662-4155-8bd2-7e742c757c4d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 09 00:41:40.550104 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application [None req-05e3a218-c662-4155-8bd2-7e742c757c4d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 09 00:41:40.550104 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:41:40.550104 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:41:40.550104 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:41:40.550104 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:41:40.550104 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:41:40.550104 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:41:40.550104 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:41:40.550104 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:41:40.550104 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:41:40.550104 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:41:40.550104 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:41:40.550104 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 09 00:41:40.550104 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 09 00:41:40.550104 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 09 00:41:40.550104 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 09 00:41:40.550996 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 09 00:41:40.550996 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 09 00:41:40.550996 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 09 00:41:40.550996 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 09 00:41:40.550996 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:41:40.550996 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:41:40.550996 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:41:40.550996 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:41:40.550996 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:41:40.550996 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:41:40.550996 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:41:40.550996 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application with Lock( Oct 09 00:41:40.550996 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:41:40.550996 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:41:40.550996 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:41:40.550996 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:41:40.551811 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:41:40.551811 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:41:40.551811 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:41:40.551811 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:41:40.551811 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 09 00:41:40.551811 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 09 00:41:40.551811 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 09 00:41:40.551811 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 09 00:41:40.551811 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 09 00:41:40.551811 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 09 00:41:40.551811 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 09 00:41:40.551811 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Oct 09 00:41:40.554257 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 77/150] 10.222.0.15 () {56 vars in 1099 bytes} [Sun Oct 9 00:41:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:41:40.560507 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e3a218-c662-4155-8bd2-7e742c757c4d None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:41:40.615796 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9be38ce-f3c1-4061-9099-06faf4787411 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:41:40.653111 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1cf734-3b24-4787-b75e-cedcdf8c22f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:41:40.653786 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1cf734-3b24-4787-b75e-cedcdf8c22f6 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:41:40.654062 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1cf734-3b24-4787-b75e-cedcdf8c22f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:41:40.654329 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1cf734-3b24-4787-b75e-cedcdf8c22f6 None admin] PATH_INFO: `/v3/users/dad78f63674a4c108c90af4c08cee5ba` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:41:40.655689 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1cf734-3b24-4787-b75e-cedcdf8c22f6 None admin] RBAC: Authorizing `identity:get_user(user_id=dad78f63674a4c108c90af4c08cee5ba)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:41:40.657301 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1cf734-3b24-4787-b75e-cedcdf8c22f6 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:41:40.659011 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 74/151] 10.222.0.15 () {56 vars in 1177 bytes} [Sun Oct 9 00:41:40 2022] GET /identity/v3/users/dad78f63674a4c108c90af4c08cee5ba => generated 289 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 09 00:41:40.664079 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:41:40.665846 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1cf734-3b24-4787-b75e-cedcdf8c22f6 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:41:40.683847 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e3a218-c662-4155-8bd2-7e742c757c4d None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:41:40.694779 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:41:40.736436 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d23aaf3-1dd5-4cb2-bcfe-ed626a10dc86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:41:40.737487 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d23aaf3-1dd5-4cb2-bcfe-ed626a10dc86 None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:41:40.737968 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d23aaf3-1dd5-4cb2-bcfe-ed626a10dc86 None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:41:40.738455 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d23aaf3-1dd5-4cb2-bcfe-ed626a10dc86 None admin] PATH_INFO: `/v3/roles` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:41:40.739624 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d23aaf3-1dd5-4cb2-bcfe-ed626a10dc86 None admin] RBAC: Adding query filter params (name=member) {{(pid=81525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:41:40.740139 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d23aaf3-1dd5-4cb2-bcfe-ed626a10dc86 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:41:40.741949 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d23aaf3-1dd5-4cb2-bcfe-ed626a10dc86 None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:41:40.752272 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 78/152] 10.222.0.15 () {56 vars in 1101 bytes} [Sun Oct 9 00:41:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:41:40.758613 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d23aaf3-1dd5-4cb2-bcfe-ed626a10dc86 None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:41:40.789314 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1cf734-3b24-4787-b75e-cedcdf8c22f6 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:41:40.828348 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf62dda2-a857-4a8f-94aa-8e7f5a84db5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:41:40.829157 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf62dda2-a857-4a8f-94aa-8e7f5a84db5e None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:41:40.829528 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf62dda2-a857-4a8f-94aa-8e7f5a84db5e None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:41:40.829891 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf62dda2-a857-4a8f-94aa-8e7f5a84db5e None admin] PATH_INFO: `/v3/projects/3fcf2f5182c445929c38948df6235040` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:41:40.831464 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf62dda2-a857-4a8f-94aa-8e7f5a84db5e None admin] RBAC: Authorizing `identity:get_project(project_id=3fcf2f5182c445929c38948df6235040)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:41:40.833163 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf62dda2-a857-4a8f-94aa-8e7f5a84db5e None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:41:40.834951 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 75/153] 10.222.0.15 () {56 vars in 1186 bytes} [Sun Oct 9 00:41:40 2022] GET /identity/v3/projects/3fcf2f5182c445929c38948df6235040 => generated 298 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 09 00:41:40.844038 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf62dda2-a857-4a8f-94aa-8e7f5a84db5e None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:41:40.934003 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d23aaf3-1dd5-4cb2-bcfe-ed626a10dc86 None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:41:41.003719 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:41:41.004992 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb4b777-4279-48b0-b22e-90c82fb09f61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:41:41.005838 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb4b777-4279-48b0-b22e-90c82fb09f61 None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:41:41.005954 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb4b777-4279-48b0-b22e-90c82fb09f61 None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:41:41.006157 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb4b777-4279-48b0-b22e-90c82fb09f61 None admin] PATH_INFO: `/v3/users/52f47c8c5b524339a22bd58a6fa05fd5` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:41:41.007542 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb4b777-4279-48b0-b22e-90c82fb09f61 None admin] RBAC: Authorizing `identity:get_user(user_id=52f47c8c5b524339a22bd58a6fa05fd5)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:41:41.010641 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb4b777-4279-48b0-b22e-90c82fb09f61 None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:41:41.016066 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 79/154] 10.222.0.15 () {56 vars in 1177 bytes} [Sun Oct 9 00:41:40 2022] GET /identity/v3/users/52f47c8c5b524339a22bd58a6fa05fd5 => generated 275 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:41:41.016193 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf62dda2-a857-4a8f-94aa-8e7f5a84db5e None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:41:41.022856 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb4b777-4279-48b0-b22e-90c82fb09f61 None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:41:41.056561 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:41:41.109754 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebec7ad-2805-4b16-88fe-f21b58bf2a8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:41:41.111731 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebec7ad-2805-4b16-88fe-f21b58bf2a8c None admin] REQUEST_METHOD: `PUT` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:41:41.117537 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebec7ad-2805-4b16-88fe-f21b58bf2a8c None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:41:41.118110 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebec7ad-2805-4b16-88fe-f21b58bf2a8c None admin] PATH_INFO: `/v3/projects/3fcf2f5182c445929c38948df6235040/users/dad78f63674a4c108c90af4c08cee5ba/roles/9da5e6c99f594f149e3f29f97cf55e7e` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:41:41.120615 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebec7ad-2805-4b16-88fe-f21b58bf2a8c None admin] RBAC: Authorizing `identity:create_grant(project_id=3fcf2f5182c445929c38948df6235040, user_id=dad78f63674a4c108c90af4c08cee5ba, role_id=9da5e6c99f594f149e3f29f97cf55e7e)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:41:41.122317 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebec7ad-2805-4b16-88fe-f21b58bf2a8c None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:41:41.159914 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 76/155] 10.222.0.15 () {58 vars in 1439 bytes} [Sun Oct 9 00:41:40 2022] PUT /identity/v3/projects/3fcf2f5182c445929c38948df6235040/users/dad78f63674a4c108c90af4c08cee5ba/roles/9da5e6c99f594f149e3f29f97cf55e7e => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 00:41:41.161309 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebec7ad-2805-4b16-88fe-f21b58bf2a8c None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:41:41.269243 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb4b777-4279-48b0-b22e-90c82fb09f61 None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:41:41.322317 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388d6251-55da-4469-9dfa-5b44f32f9728 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:41:41.323414 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388d6251-55da-4469-9dfa-5b44f32f9728 None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:41:41.323935 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388d6251-55da-4469-9dfa-5b44f32f9728 None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:41:41.324404 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388d6251-55da-4469-9dfa-5b44f32f9728 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:41:41.386708 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebec7ad-2805-4b16-88fe-f21b58bf2a8c None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:41:41.441706 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001eb7b9-b381-439d-ac20-037b5ed5bd42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:41:41.442365 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001eb7b9-b381-439d-ac20-037b5ed5bd42 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:41:41.442636 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001eb7b9-b381-439d-ac20-037b5ed5bd42 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:41:41.442905 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001eb7b9-b381-439d-ac20-037b5ed5bd42 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:41:41.457776 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388d6251-55da-4469-9dfa-5b44f32f9728 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:41:41.459301 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388d6251-55da-4469-9dfa-5b44f32f9728 None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:41:41.466197 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001eb7b9-b381-439d-ac20-037b5ed5bd42 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 09 00:41:41.471193 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application [None req-001eb7b9-b381-439d-ac20-037b5ed5bd42 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 09 00:41:41.471193 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:41:41.471193 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:41:41.471193 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:41:41.471193 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:41:41.471193 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:41:41.471193 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:41:41.471193 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:41:41.471193 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:41:41.471193 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:41:41.471193 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:41:41.471193 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:41:41.471193 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 09 00:41:41.471193 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 09 00:41:41.471193 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 09 00:41:41.471193 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 09 00:41:41.472293 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 09 00:41:41.472293 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 09 00:41:41.472293 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 09 00:41:41.472293 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 09 00:41:41.472293 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:41:41.472293 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:41:41.472293 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:41:41.472293 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:41:41.472293 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:41:41.472293 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:41:41.472293 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:41:41.472293 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application with Lock( Oct 09 00:41:41.472293 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:41:41.472293 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:41:41.472293 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:41:41.472293 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:41:41.473130 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:41:41.473130 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:41:41.473130 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:41:41.473130 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:41:41.473130 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 09 00:41:41.473130 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 09 00:41:41.473130 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 09 00:41:41.473130 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 09 00:41:41.473130 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 09 00:41:41.473130 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 09 00:41:41.473130 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 09 00:41:41.473130 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application Oct 09 00:41:41.477828 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 77/156] 10.222.0.15 () {56 vars in 1096 bytes} [Sun Oct 9 00:41:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 317 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:41:41.481180 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6b9bd3-fa72-4345-9971-3e50a7cf9a84 None None] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:41:41.481445 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6b9bd3-fa72-4345-9971-3e50a7cf9a84 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:41:41.483107 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6b9bd3-fa72-4345-9971-3e50a7cf9a84 None None] PATH_INFO: `/` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:41:41.489324 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 78/157] 10.222.0.15 () {54 vars in 927 bytes} [Sun Oct 9 00:41:41 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:41:41.490092 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6b9bd3-fa72-4345-9971-3e50a7cf9a84 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:41:41.495620 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:41:41.522381 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:41:41.624415 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 80/158] 10.222.0.15 () {58 vars in 1282 bytes} [Sun Oct 9 00:41:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 602 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 09 00:41:41.626393 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468e3c3c-7fe4-441e-82ea-1d3e6842b77d None None] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:41:41.626926 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468e3c3c-7fe4-441e-82ea-1d3e6842b77d None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:41:41.633704 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468e3c3c-7fe4-441e-82ea-1d3e6842b77d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:41:41.665400 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.auth.core [None req-468e3c3c-7fe4-441e-82ea-1d3e6842b77d None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:41:41.666675 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-468e3c3c-7fe4-441e-82ea-1d3e6842b77d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:41:41.733147 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6b9bd3-fa72-4345-9971-3e50a7cf9a84 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:41:41.749396 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 81/159] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Oct 9 00:41:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 09 00:41:41.751215 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b6d15d-82b4-4c56-835f-4eb6bf7e18e5 None None] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:41:41.751737 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b6d15d-82b4-4c56-835f-4eb6bf7e18e5 None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:41:41.752215 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b6d15d-82b4-4c56-835f-4eb6bf7e18e5 None None] PATH_INFO: `/` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:41:41.753795 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 82/160] 10.222.0.15 () {54 vars in 927 bytes} [Sun Oct 9 00:41:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:41:41.754699 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b6d15d-82b4-4c56-835f-4eb6bf7e18e5 None None] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:41:41.780307 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966e636c-039e-4693-97c9-981add521157 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:41:41.780837 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966e636c-039e-4693-97c9-981add521157 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:41:41.781122 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966e636c-039e-4693-97c9-981add521157 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:41:41.781378 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966e636c-039e-4693-97c9-981add521157 None admin] PATH_INFO: `/v3/roles` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:41:41.782047 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966e636c-039e-4693-97c9-981add521157 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:41:41.782549 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966e636c-039e-4693-97c9-981add521157 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:41:41.783772 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966e636c-039e-4693-97c9-981add521157 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:41:41.797845 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 79/161] 10.222.0.15 () {56 vars in 1099 bytes} [Sun Oct 9 00:41:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:41:41.799505 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d6115c-1559-408e-84a8-467dfe1dfca9 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:41:41.799789 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d6115c-1559-408e-84a8-467dfe1dfca9 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:41:41.800053 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d6115c-1559-408e-84a8-467dfe1dfca9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:41:41.815775 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:41:41.829719 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-41d6115c-1559-408e-84a8-467dfe1dfca9 None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:41:41.830917 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-41d6115c-1559-408e-84a8-467dfe1dfca9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:41:41.924017 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b6d15d-82b4-4c56-835f-4eb6bf7e18e5 None None] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:41:41.938055 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 80/162] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Oct 9 00:41:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 09 00:41:41.938929 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d6115c-1559-408e-84a8-467dfe1dfca9 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:41:41.943175 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:41:41.979126 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f06002-2571-4165-aeff-044cfd77839e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:41:41.979801 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f06002-2571-4165-aeff-044cfd77839e None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:41:41.980069 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f06002-2571-4165-aeff-044cfd77839e None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:41:41.980329 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f06002-2571-4165-aeff-044cfd77839e None admin] PATH_INFO: `/v3/projects/3fcf2f5182c445929c38948df6235040` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:41:41.983996 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f06002-2571-4165-aeff-044cfd77839e None admin] RBAC: Authorizing `identity:get_project(project_id=3fcf2f5182c445929c38948df6235040)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:41:41.985503 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f06002-2571-4165-aeff-044cfd77839e None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:41:41.987525 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 83/163] 10.222.0.15 () {56 vars in 1186 bytes} [Sun Oct 9 00:41:41 2022] GET /identity/v3/projects/3fcf2f5182c445929c38948df6235040 => generated 298 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:41:41.993550 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f06002-2571-4165-aeff-044cfd77839e None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:41:42.136464 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f06002-2571-4165-aeff-044cfd77839e None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:41:42.157548 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:41:42.183961 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1b2a88-f594-4936-ba7a-43eb374c4206 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:41:42.184584 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1b2a88-f594-4936-ba7a-43eb374c4206 None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:41:42.184859 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1b2a88-f594-4936-ba7a-43eb374c4206 None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:41:42.185123 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1b2a88-f594-4936-ba7a-43eb374c4206 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:41:42.185859 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1b2a88-f594-4936-ba7a-43eb374c4206 None admin] RBAC: Adding query filter params (role.id=afb0a01183d9497795eaa4fa1a4046ae, scope.project.id=3fcf2f5182c445929c38948df6235040, user.id=52f47c8c5b524339a22bd58a6fa05fd5) {{(pid=81525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:41:42.186178 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1b2a88-f594-4936-ba7a-43eb374c4206 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:41:42.187654 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1b2a88-f594-4936-ba7a-43eb374c4206 None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:41:42.194164 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 84/164] 10.222.0.15 () {56 vars in 1374 bytes} [Sun Oct 9 00:41:41 2022] GET /identity/v3/role_assignments?user.id=52f47c8c5b524339a22bd58a6fa05fd5&scope.project.id=3fcf2f5182c445929c38948df6235040&role.id=afb0a01183d9497795eaa4fa1a4046ae => generated 608 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:41:42.195003 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1b2a88-f594-4936-ba7a-43eb374c4206 None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:41:42.198096 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d6115c-1559-408e-84a8-467dfe1dfca9 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:41:42.296048 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cfb994-6d06-4571-bae6-6d71af8c8546 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:41:42.296735 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cfb994-6d06-4571-bae6-6d71af8c8546 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:41:42.297008 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cfb994-6d06-4571-bae6-6d71af8c8546 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:41:42.297288 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cfb994-6d06-4571-bae6-6d71af8c8546 None admin] PATH_INFO: `/v3/users/99441f7488cd4b83be4affd132b7c074` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:41:42.298566 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cfb994-6d06-4571-bae6-6d71af8c8546 None admin] RBAC: Authorizing `identity:get_user(user_id=99441f7488cd4b83be4affd132b7c074)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:41:42.300103 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cfb994-6d06-4571-bae6-6d71af8c8546 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:41:42.301751 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 81/165] 10.222.0.15 () {56 vars in 1177 bytes} [Sun Oct 9 00:41:41 2022] GET /identity/v3/users/99441f7488cd4b83be4affd132b7c074 => generated 247 bytes in 363 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:41:42.307507 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cfb994-6d06-4571-bae6-6d71af8c8546 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:41:42.336746 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1b2a88-f594-4936-ba7a-43eb374c4206 None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:41:42.372443 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9938aaf3-59df-4ef6-950a-5b9397d7c0ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:41:42.373077 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9938aaf3-59df-4ef6-950a-5b9397d7c0ac None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:41:42.373342 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9938aaf3-59df-4ef6-950a-5b9397d7c0ac None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:41:42.373643 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9938aaf3-59df-4ef6-950a-5b9397d7c0ac None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:41:42.384771 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9938aaf3-59df-4ef6-950a-5b9397d7c0ac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 09 00:41:42.390521 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application [None req-9938aaf3-59df-4ef6-950a-5b9397d7c0ac None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 09 00:41:42.390521 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:41:42.390521 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:41:42.390521 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:41:42.390521 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:41:42.390521 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:41:42.390521 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:41:42.390521 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:41:42.390521 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:41:42.390521 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:41:42.390521 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:41:42.390521 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:41:42.390521 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 09 00:41:42.390521 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 09 00:41:42.390521 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 09 00:41:42.390521 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 09 00:41:42.391599 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 09 00:41:42.391599 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 09 00:41:42.391599 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 09 00:41:42.391599 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 09 00:41:42.391599 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:41:42.391599 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:41:42.391599 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:41:42.391599 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:41:42.391599 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:41:42.391599 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:41:42.391599 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:41:42.391599 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application with Lock( Oct 09 00:41:42.391599 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:41:42.391599 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:41:42.391599 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:41:42.391599 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:41:42.392645 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:41:42.392645 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:41:42.392645 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:41:42.392645 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:41:42.392645 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 09 00:41:42.392645 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 09 00:41:42.392645 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 09 00:41:42.392645 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 09 00:41:42.392645 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 09 00:41:42.392645 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 09 00:41:42.392645 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 09 00:41:42.392645 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Oct 09 00:41:42.392645 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 85/166] 10.222.0.15 () {56 vars in 1114 bytes} [Sun Oct 9 00:41:42 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:41:42.399637 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9938aaf3-59df-4ef6-950a-5b9397d7c0ac None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:41:42.467727 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:41:42.495727 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:41:42.551434 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cfb994-6d06-4571-bae6-6d71af8c8546 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:41:42.572681 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9938aaf3-59df-4ef6-950a-5b9397d7c0ac None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:41:42.658823 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de47e05-ea30-4905-b2cd-254101ddbb4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:41:42.659486 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de47e05-ea30-4905-b2cd-254101ddbb4d None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:41:42.659761 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de47e05-ea30-4905-b2cd-254101ddbb4d None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:41:42.659961 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4259bb4e-3ae3-4d51-9ae2-2666b11fbca7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:41:42.660081 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de47e05-ea30-4905-b2cd-254101ddbb4d None admin] PATH_INFO: `/v3/roles` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:41:42.660584 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4259bb4e-3ae3-4d51-9ae2-2666b11fbca7 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:41:42.660681 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de47e05-ea30-4905-b2cd-254101ddbb4d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:41:42.660861 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4259bb4e-3ae3-4d51-9ae2-2666b11fbca7 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:41:42.660962 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de47e05-ea30-4905-b2cd-254101ddbb4d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:41:42.661120 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4259bb4e-3ae3-4d51-9ae2-2666b11fbca7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:41:42.662443 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de47e05-ea30-4905-b2cd-254101ddbb4d None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:41:42.676244 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 86/167] 10.222.0.15 () {56 vars in 1111 bytes} [Sun Oct 9 00:41:42 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:41:42.677140 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de47e05-ea30-4905-b2cd-254101ddbb4d None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:41:42.841815 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:41:42.847017 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de47e05-ea30-4905-b2cd-254101ddbb4d None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:41:42.868300 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4259bb4e-3ae3-4d51-9ae2-2666b11fbca7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:41:42.869965 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4259bb4e-3ae3-4d51-9ae2-2666b11fbca7 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:41:42.897958 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b23b30a-6ec4-42d7-be96-c25e66d0e70e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:41:42.898618 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b23b30a-6ec4-42d7-be96-c25e66d0e70e None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:41:42.898895 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b23b30a-6ec4-42d7-be96-c25e66d0e70e None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:41:42.899229 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b23b30a-6ec4-42d7-be96-c25e66d0e70e None admin] PATH_INFO: `/v3/roles/member` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:41:42.915957 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b23b30a-6ec4-42d7-be96-c25e66d0e70e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 09 00:41:42.922315 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application [None req-3b23b30a-6ec4-42d7-be96-c25e66d0e70e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 09 00:41:42.922315 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:41:42.922315 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:41:42.922315 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:41:42.922315 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:41:42.922315 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:41:42.922315 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:41:42.922315 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:41:42.922315 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:41:42.922315 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:41:42.922315 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:41:42.922315 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:41:42.922315 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 09 00:41:42.922315 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 09 00:41:42.922315 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 09 00:41:42.922315 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 09 00:41:42.923317 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 09 00:41:42.923317 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 09 00:41:42.923317 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 09 00:41:42.923317 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 09 00:41:42.923317 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:41:42.923317 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:41:42.923317 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:41:42.923317 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:41:42.923317 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:41:42.923317 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:41:42.923317 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:41:42.923317 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application with Lock( Oct 09 00:41:42.923317 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:41:42.923317 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:41:42.923317 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:41:42.923317 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:41:42.924111 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:41:42.924111 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:41:42.924111 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:41:42.924111 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:41:42.924111 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 09 00:41:42.924111 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 09 00:41:42.924111 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 09 00:41:42.924111 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 09 00:41:42.924111 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 09 00:41:42.924111 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 09 00:41:42.924111 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 09 00:41:42.924111 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Oct 09 00:41:42.924111 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 87/168] 10.222.0.15 () {56 vars in 1099 bytes} [Sun Oct 9 00:41:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:41:42.924747 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b23b30a-6ec4-42d7-be96-c25e66d0e70e None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:41:43.011107 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:41:43.046274 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 82/169] 10.222.0.15 () {58 vars in 1282 bytes} [Sun Oct 9 00:41:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 739 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 09 00:41:43.047293 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4259bb4e-3ae3-4d51-9ae2-2666b11fbca7 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:41:43.091959 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b23b30a-6ec4-42d7-be96-c25e66d0e70e None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:41:43.151729 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eccdae7-9da1-4cac-b9cd-76755e5fd2f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:41:43.152473 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eccdae7-9da1-4cac-b9cd-76755e5fd2f0 None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:41:43.152755 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eccdae7-9da1-4cac-b9cd-76755e5fd2f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:41:43.153028 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eccdae7-9da1-4cac-b9cd-76755e5fd2f0 None admin] PATH_INFO: `/v3/users/52f47c8c5b524339a22bd58a6fa05fd5` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:41:43.154773 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4259bb4e-3ae3-4d51-9ae2-2666b11fbca7 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:41:43.156851 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eccdae7-9da1-4cac-b9cd-76755e5fd2f0 None admin] RBAC: Authorizing `identity:get_user(user_id=52f47c8c5b524339a22bd58a6fa05fd5)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:41:43.158430 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eccdae7-9da1-4cac-b9cd-76755e5fd2f0 None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:41:43.160254 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 88/170] 10.222.0.15 () {56 vars in 1177 bytes} [Sun Oct 9 00:41:42 2022] GET /identity/v3/users/52f47c8c5b524339a22bd58a6fa05fd5 => generated 275 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:41:43.160880 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eccdae7-9da1-4cac-b9cd-76755e5fd2f0 None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:41:43.195040 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e03676-1a80-480b-826f-0f318c53568e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:41:43.195623 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e03676-1a80-480b-826f-0f318c53568e None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:41:43.195894 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e03676-1a80-480b-826f-0f318c53568e None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:41:43.196157 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e03676-1a80-480b-826f-0f318c53568e None admin] PATH_INFO: `/v3/roles` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:41:43.196823 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e03676-1a80-480b-826f-0f318c53568e None admin] RBAC: Adding query filter params (name=member) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:41:43.197115 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e03676-1a80-480b-826f-0f318c53568e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:41:43.198597 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e03676-1a80-480b-826f-0f318c53568e None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:41:43.207239 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 83/171] 10.222.0.15 () {56 vars in 1101 bytes} [Sun Oct 9 00:41:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:41:43.212097 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e03676-1a80-480b-826f-0f318c53568e None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:41:43.215397 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:41:43.247326 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:41:43.319446 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e03676-1a80-480b-826f-0f318c53568e None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:41:43.355930 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4255544-c302-47d0-b134-31c381208d13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:41:43.356552 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4255544-c302-47d0-b134-31c381208d13 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:41:43.356827 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4255544-c302-47d0-b134-31c381208d13 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:41:43.357098 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4255544-c302-47d0-b134-31c381208d13 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:41:43.395452 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eccdae7-9da1-4cac-b9cd-76755e5fd2f0 None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:41:43.424961 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4255544-c302-47d0-b134-31c381208d13 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:41:43.426445 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4255544-c302-47d0-b134-31c381208d13 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:41:43.456512 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65e5121-c624-4305-b983-d6322e3c5604 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:41:43.457400 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65e5121-c624-4305-b983-d6322e3c5604 None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:41:43.457946 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65e5121-c624-4305-b983-d6322e3c5604 None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:41:43.458230 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65e5121-c624-4305-b983-d6322e3c5604 None admin] PATH_INFO: `/v3/projects/3fcf2f5182c445929c38948df6235040` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:41:43.459437 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65e5121-c624-4305-b983-d6322e3c5604 None admin] RBAC: Authorizing `identity:get_project(project_id=3fcf2f5182c445929c38948df6235040)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:41:43.461895 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65e5121-c624-4305-b983-d6322e3c5604 None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:41:43.463809 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 89/172] 10.222.0.15 () {56 vars in 1186 bytes} [Sun Oct 9 00:41:43 2022] GET /identity/v3/projects/3fcf2f5182c445929c38948df6235040 => generated 298 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:41:43.464479 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65e5121-c624-4305-b983-d6322e3c5604 None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:41:43.468181 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:41:43.565567 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 84/173] 10.222.0.15 () {58 vars in 1282 bytes} [Sun Oct 9 00:41:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 09 00:41:43.566942 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba42d49-ad95-4b3f-b816-af7b671b457a None None] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:41:43.567225 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba42d49-ad95-4b3f-b816-af7b671b457a None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:41:43.567524 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba42d49-ad95-4b3f-b816-af7b671b457a None None] PATH_INFO: `/` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:41:43.569019 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 85/174] 10.222.0.15 () {54 vars in 927 bytes} [Sun Oct 9 00:41:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:41:43.569733 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba42d49-ad95-4b3f-b816-af7b671b457a None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:41:43.600289 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:41:43.609455 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65e5121-c624-4305-b983-d6322e3c5604 None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:41:43.660287 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55d06f3-162e-451f-b207-13e703eaf2f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:41:43.660929 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55d06f3-162e-451f-b207-13e703eaf2f7 None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:41:43.661200 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55d06f3-162e-451f-b207-13e703eaf2f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:41:43.661467 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55d06f3-162e-451f-b207-13e703eaf2f7 None admin] PATH_INFO: `/v3/users/52f47c8c5b524339a22bd58a6fa05fd5` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:41:43.664032 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55d06f3-162e-451f-b207-13e703eaf2f7 None admin] RBAC: Authorizing `identity:get_user(user_id=52f47c8c5b524339a22bd58a6fa05fd5)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:41:43.665702 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55d06f3-162e-451f-b207-13e703eaf2f7 None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:41:43.667367 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 90/175] 10.222.0.15 () {56 vars in 1177 bytes} [Sun Oct 9 00:41:43 2022] GET /identity/v3/users/52f47c8c5b524339a22bd58a6fa05fd5 => generated 275 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:41:43.671223 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a096fe0f-057b-4d09-9bdb-1a3a79c70152 None None] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:41:43.671514 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a096fe0f-057b-4d09-9bdb-1a3a79c70152 None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:41:43.671777 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a096fe0f-057b-4d09-9bdb-1a3a79c70152 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:41:43.705437 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.auth.core [None req-a096fe0f-057b-4d09-9bdb-1a3a79c70152 None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:41:43.707713 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-a096fe0f-057b-4d09-9bdb-1a3a79c70152 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:41:43.736898 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba42d49-ad95-4b3f-b816-af7b671b457a None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:41:43.795434 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f7eae0-1c40-497f-8904-11b43972c941 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:41:43.796044 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f7eae0-1c40-497f-8904-11b43972c941 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:41:43.796532 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f7eae0-1c40-497f-8904-11b43972c941 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:41:43.798347 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f7eae0-1c40-497f-8904-11b43972c941 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:41:43.799088 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f7eae0-1c40-497f-8904-11b43972c941 None admin] RBAC: Adding query filter params (role.id=f69dddf26daf4dd79d4c962beb877af5, scope.project.id=3fcf2f5182c445929c38948df6235040, user.id=99441f7488cd4b83be4affd132b7c074) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:41:43.800254 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f7eae0-1c40-497f-8904-11b43972c941 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:41:43.803874 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f7eae0-1c40-497f-8904-11b43972c941 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:41:43.805922 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:41:43.817314 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 86/176] 10.222.0.15 () {56 vars in 1374 bytes} [Sun Oct 9 00:41:43 2022] GET /identity/v3/role_assignments?user.id=99441f7488cd4b83be4affd132b7c074&scope.project.id=3fcf2f5182c445929c38948df6235040&role.id=f69dddf26daf4dd79d4c962beb877af5 => generated 608 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:41:43.817314 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f7eae0-1c40-497f-8904-11b43972c941 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:41:43.842656 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 91/177] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Oct 9 00:41:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 09 00:41:43.843369 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a096fe0f-057b-4d09-9bdb-1a3a79c70152 None None] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:41:43.981282 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:41:43.993119 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a096fe0f-057b-4d09-9bdb-1a3a79c70152 None None] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:41:44.026214 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f7eae0-1c40-497f-8904-11b43972c941 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:41:44.048230 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b661df-9e3d-4f25-bd2c-eb2bcf07309d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:41:44.049208 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b661df-9e3d-4f25-bd2c-eb2bcf07309d None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:41:44.049650 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b661df-9e3d-4f25-bd2c-eb2bcf07309d None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:41:44.050060 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b661df-9e3d-4f25-bd2c-eb2bcf07309d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:41:44.089380 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d62479-eb1a-44c7-8edf-60fc1a3de801 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:41:44.090122 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d62479-eb1a-44c7-8edf-60fc1a3de801 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:41:44.090433 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d62479-eb1a-44c7-8edf-60fc1a3de801 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:41:44.090833 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d62479-eb1a-44c7-8edf-60fc1a3de801 None admin] PATH_INFO: `/v3/projects/3fcf2f5182c445929c38948df6235040` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:41:44.092129 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d62479-eb1a-44c7-8edf-60fc1a3de801 None admin] RBAC: Authorizing `identity:get_project(project_id=3fcf2f5182c445929c38948df6235040)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:41:44.099294 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d62479-eb1a-44c7-8edf-60fc1a3de801 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:41:44.100872 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 87/178] 10.222.0.15 () {56 vars in 1186 bytes} [Sun Oct 9 00:41:43 2022] GET /identity/v3/projects/3fcf2f5182c445929c38948df6235040 => generated 298 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:41:44.107370 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d62479-eb1a-44c7-8edf-60fc1a3de801 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:41:44.159234 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b661df-9e3d-4f25-bd2c-eb2bcf07309d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:41:44.161037 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b661df-9e3d-4f25-bd2c-eb2bcf07309d None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:41:44.274444 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:41:44.343911 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:41:44.348468 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d62479-eb1a-44c7-8edf-60fc1a3de801 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:41:44.369419 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 92/179] 10.222.0.15 () {58 vars in 1282 bytes} [Sun Oct 9 00:41:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 522 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 09 00:41:44.371097 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c561f2-5cca-4dca-81a3-82f312f45861 None None] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:41:44.372165 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c561f2-5cca-4dca-81a3-82f312f45861 None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:41:44.372445 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c561f2-5cca-4dca-81a3-82f312f45861 None None] PATH_INFO: `/` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:41:44.374360 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 93/180] 10.222.0.15 () {54 vars in 927 bytes} [Sun Oct 9 00:41:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:41:44.374948 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c561f2-5cca-4dca-81a3-82f312f45861 None None] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:41:44.393491 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5785c35-0c5d-4edb-96ad-c79a7f71c54f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:41:44.394124 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5785c35-0c5d-4edb-96ad-c79a7f71c54f None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:41:44.394400 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5785c35-0c5d-4edb-96ad-c79a7f71c54f None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:41:44.394672 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5785c35-0c5d-4edb-96ad-c79a7f71c54f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:41:44.395509 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5785c35-0c5d-4edb-96ad-c79a7f71c54f None admin] RBAC: Adding query filter params (role.id=93f141c2a808407dae6f9704941d0cb2, scope.project.id=3fcf2f5182c445929c38948df6235040, user.id=52f47c8c5b524339a22bd58a6fa05fd5) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:41:44.395818 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5785c35-0c5d-4edb-96ad-c79a7f71c54f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:41:44.397534 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5785c35-0c5d-4edb-96ad-c79a7f71c54f None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:41:44.404216 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 88/181] 10.222.0.15 () {56 vars in 1374 bytes} [Sun Oct 9 00:41:44 2022] GET /identity/v3/role_assignments?user.id=52f47c8c5b524339a22bd58a6fa05fd5&scope.project.id=3fcf2f5182c445929c38948df6235040&role.id=93f141c2a808407dae6f9704941d0cb2 => generated 608 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:41:44.405216 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5785c35-0c5d-4edb-96ad-c79a7f71c54f None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:41:44.511777 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c561f2-5cca-4dca-81a3-82f312f45861 None None] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:41:44.597885 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5785c35-0c5d-4edb-96ad-c79a7f71c54f None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:41:44.600602 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b9887d-f1d2-4c8e-9b67-9b29e6970e5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:41:44.601984 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b9887d-f1d2-4c8e-9b67-9b29e6970e5b None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:41:44.602501 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b9887d-f1d2-4c8e-9b67-9b29e6970e5b None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:41:44.602971 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b9887d-f1d2-4c8e-9b67-9b29e6970e5b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:41:44.629664 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b9887d-f1d2-4c8e-9b67-9b29e6970e5b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 09 00:41:44.639504 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application [None req-21b9887d-f1d2-4c8e-9b67-9b29e6970e5b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 09 00:41:44.639504 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:41:44.639504 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:41:44.639504 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:41:44.639504 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:41:44.639504 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:41:44.639504 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:41:44.639504 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:41:44.639504 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:41:44.639504 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:41:44.639504 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:41:44.639504 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:41:44.639504 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 09 00:41:44.639504 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 09 00:41:44.639504 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 09 00:41:44.639504 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 09 00:41:44.640482 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 09 00:41:44.640482 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 09 00:41:44.640482 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 09 00:41:44.640482 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 09 00:41:44.640482 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:41:44.640482 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:41:44.640482 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:41:44.640482 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:41:44.640482 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:41:44.640482 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:41:44.640482 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:41:44.640482 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application with Lock( Oct 09 00:41:44.640482 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:41:44.640482 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:41:44.640482 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:41:44.640482 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:41:44.641256 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:41:44.641256 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:41:44.641256 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:41:44.641256 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:41:44.641256 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 09 00:41:44.641256 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 09 00:41:44.641256 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 09 00:41:44.641256 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 09 00:41:44.641256 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 09 00:41:44.641256 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 09 00:41:44.641256 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 09 00:41:44.641256 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Oct 09 00:41:44.644106 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 94/182] 10.222.0.15 () {56 vars in 1096 bytes} [Sun Oct 9 00:41:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:41:44.644459 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:41:44.645462 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2049a5-9399-4b74-b33a-20b0336a2264 None None] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:41:44.645744 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2049a5-9399-4b74-b33a-20b0336a2264 None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:41:44.646019 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2049a5-9399-4b74-b33a-20b0336a2264 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:41:44.651317 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7c4432-b01b-4927-a18d-21c60c5cfe0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:41:44.651994 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7c4432-b01b-4927-a18d-21c60c5cfe0e None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:41:44.652283 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7c4432-b01b-4927-a18d-21c60c5cfe0e None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:41:44.652628 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7c4432-b01b-4927-a18d-21c60c5cfe0e None admin] PATH_INFO: `/v3/projects/48e7ff122cb7468dbacb2726fd2bd965` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:41:44.653966 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7c4432-b01b-4927-a18d-21c60c5cfe0e None admin] RBAC: Authorizing `identity:get_project(project_id=48e7ff122cb7468dbacb2726fd2bd965)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:41:44.655612 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7c4432-b01b-4927-a18d-21c60c5cfe0e None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:41:44.657878 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 89/183] 10.222.0.15 () {56 vars in 1186 bytes} [Sun Oct 9 00:41:44 2022] GET /identity/v3/projects/48e7ff122cb7468dbacb2726fd2bd965 => generated 312 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:41:44.659278 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7c4432-b01b-4927-a18d-21c60c5cfe0e None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:41:44.683290 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.auth.core [None req-5b2049a5-9399-4b74-b33a-20b0336a2264 None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:41:44.683290 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-5b2049a5-9399-4b74-b33a-20b0336a2264 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:41:44.752914 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:41:44.777188 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 95/184] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Oct 9 00:41:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 09 00:41:44.778938 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2049a5-9399-4b74-b33a-20b0336a2264 None None] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:41:44.832217 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7c4432-b01b-4927-a18d-21c60c5cfe0e None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:41:44.882222 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475b35a4-a57f-4972-b539-b91127f23b91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:41:44.883207 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475b35a4-a57f-4972-b539-b91127f23b91 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:41:44.883819 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475b35a4-a57f-4972-b539-b91127f23b91 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:41:44.884864 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475b35a4-a57f-4972-b539-b91127f23b91 None admin] PATH_INFO: `/v3/roles` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:41:44.885874 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475b35a4-a57f-4972-b539-b91127f23b91 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:41:44.886660 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475b35a4-a57f-4972-b539-b91127f23b91 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:41:44.888657 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475b35a4-a57f-4972-b539-b91127f23b91 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:41:44.899922 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 90/185] 10.222.0.15 () {56 vars in 1099 bytes} [Sun Oct 9 00:41:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:41:44.903210 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2049a5-9399-4b74-b33a-20b0336a2264 None None] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:41:44.907201 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e0a7a0-0199-4ac0-ad03-a92b5b021e9d None None] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:41:44.907400 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e0a7a0-0199-4ac0-ad03-a92b5b021e9d None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:41:44.907657 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e0a7a0-0199-4ac0-ad03-a92b5b021e9d None None] PATH_INFO: `/` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:41:44.909067 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 91/186] 10.222.0.15 () {54 vars in 927 bytes} [Sun Oct 9 00:41:44 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:41:44.911689 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e0a7a0-0199-4ac0-ad03-a92b5b021e9d None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:41:44.951393 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c92a4d-790c-4144-a3b8-0c9fdb83f300 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:41:44.952030 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c92a4d-790c-4144-a3b8-0c9fdb83f300 None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:41:44.952307 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c92a4d-790c-4144-a3b8-0c9fdb83f300 None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:41:44.952576 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c92a4d-790c-4144-a3b8-0c9fdb83f300 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:41:44.953350 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c92a4d-790c-4144-a3b8-0c9fdb83f300 None admin] RBAC: Adding query filter params (role.id=afb0a01183d9497795eaa4fa1a4046ae, scope.project.id=48e7ff122cb7468dbacb2726fd2bd965, user.id=52f47c8c5b524339a22bd58a6fa05fd5) {{(pid=81525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:41:44.953668 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c92a4d-790c-4144-a3b8-0c9fdb83f300 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:41:44.955210 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c92a4d-790c-4144-a3b8-0c9fdb83f300 None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:41:44.962695 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 96/187] 10.222.0.15 () {56 vars in 1374 bytes} [Sun Oct 9 00:41:44 2022] GET /identity/v3/role_assignments?user.id=52f47c8c5b524339a22bd58a6fa05fd5&scope.project.id=48e7ff122cb7468dbacb2726fd2bd965&role.id=afb0a01183d9497795eaa4fa1a4046ae => generated 608 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:41:44.968509 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c79e2d-f31c-4a2e-9ec7-90bfddfb87a9 None None] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:41:44.968845 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c79e2d-f31c-4a2e-9ec7-90bfddfb87a9 None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:41:44.969058 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c79e2d-f31c-4a2e-9ec7-90bfddfb87a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:41:45.001417 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.auth.core [None req-63c79e2d-f31c-4a2e-9ec7-90bfddfb87a9 None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:41:45.002643 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-63c79e2d-f31c-4a2e-9ec7-90bfddfb87a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:41:45.006391 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:41:45.068280 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e0a7a0-0199-4ac0-ad03-a92b5b021e9d None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:41:45.106815 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:41:45.116776 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423030c3-2cbc-4a96-bb88-62f029b8e4db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:41:45.118223 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423030c3-2cbc-4a96-bb88-62f029b8e4db None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:41:45.118715 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423030c3-2cbc-4a96-bb88-62f029b8e4db None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:41:45.119159 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423030c3-2cbc-4a96-bb88-62f029b8e4db None admin] PATH_INFO: `/v3/users/e6e20d4c68324c8080bd81996ada970d` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:41:45.142370 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 97/188] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Oct 9 00:41:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 09 00:41:45.142370 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3917dcf2-85cf-40ee-965c-c49d6735d605 None None] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:41:45.142370 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3917dcf2-85cf-40ee-965c-c49d6735d605 None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:41:45.142370 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3917dcf2-85cf-40ee-965c-c49d6735d605 None None] PATH_INFO: `/` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:41:45.142370 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 98/189] 10.222.0.15 () {54 vars in 927 bytes} [Sun Oct 9 00:41:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:41:45.143293 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3917dcf2-85cf-40ee-965c-c49d6735d605 None None] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:41:45.148135 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423030c3-2cbc-4a96-bb88-62f029b8e4db None admin] RBAC: Authorizing `identity:get_user(user_id=e6e20d4c68324c8080bd81996ada970d)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:41:45.149327 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423030c3-2cbc-4a96-bb88-62f029b8e4db None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:41:45.151539 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 92/190] 10.222.0.15 () {56 vars in 1177 bytes} [Sun Oct 9 00:41:44 2022] GET /identity/v3/users/e6e20d4c68324c8080bd81996ada970d => generated 283 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:41:45.152903 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70065e9-d2e7-44a7-89f9-1283d2fb081c None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:41:45.153183 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70065e9-d2e7-44a7-89f9-1283d2fb081c None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:41:45.153992 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70065e9-d2e7-44a7-89f9-1283d2fb081c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:41:45.172677 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-f70065e9-d2e7-44a7-89f9-1283d2fb081c None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:41:45.173915 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-f70065e9-d2e7-44a7-89f9-1283d2fb081c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:41:45.255561 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 93/191] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Oct 9 00:41:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 09 00:41:45.256497 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70065e9-d2e7-44a7-89f9-1283d2fb081c None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:41:45.276161 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3917dcf2-85cf-40ee-965c-c49d6735d605 None None] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:41:45.309393 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:41:45.323219 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd19bfa-7863-4dd6-8c66-38484d910676 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:41:45.324380 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd19bfa-7863-4dd6-8c66-38484d910676 None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:41:45.325031 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd19bfa-7863-4dd6-8c66-38484d910676 None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:41:45.325439 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd19bfa-7863-4dd6-8c66-38484d910676 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:41:45.339182 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd19bfa-7863-4dd6-8c66-38484d910676 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 09 00:41:45.346262 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application [None req-7cd19bfa-7863-4dd6-8c66-38484d910676 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 09 00:41:45.346262 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:41:45.346262 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:41:45.346262 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:41:45.346262 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:41:45.346262 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:41:45.346262 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:41:45.346262 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:41:45.346262 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:41:45.346262 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:41:45.346262 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:41:45.346262 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:41:45.346262 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 09 00:41:45.346262 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 09 00:41:45.346262 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 09 00:41:45.346262 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 09 00:41:45.347327 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 09 00:41:45.347327 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 09 00:41:45.347327 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 09 00:41:45.347327 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 09 00:41:45.347327 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:41:45.347327 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:41:45.347327 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:41:45.347327 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:41:45.347327 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:41:45.347327 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:41:45.347327 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:41:45.347327 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application with Lock( Oct 09 00:41:45.347327 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:41:45.347327 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:41:45.347327 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:41:45.347327 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:41:45.348319 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:41:45.348319 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:41:45.348319 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:41:45.348319 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:41:45.348319 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 09 00:41:45.348319 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 09 00:41:45.348319 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 09 00:41:45.348319 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 09 00:41:45.348319 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 09 00:41:45.348319 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 09 00:41:45.348319 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 09 00:41:45.348319 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Oct 09 00:41:45.350948 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 99/192] 10.222.0.15 () {56 vars in 1114 bytes} [Sun Oct 9 00:41:45 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:41:45.357009 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd19bfa-7863-4dd6-8c66-38484d910676 None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:41:45.369145 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70065e9-d2e7-44a7-89f9-1283d2fb081c None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:41:45.397298 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:41:45.406723 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7143510-68ef-4972-b718-3f25cf9bf423 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:41:45.407372 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7143510-68ef-4972-b718-3f25cf9bf423 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:41:45.407648 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7143510-68ef-4972-b718-3f25cf9bf423 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:41:45.407916 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7143510-68ef-4972-b718-3f25cf9bf423 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:41:45.484100 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7143510-68ef-4972-b718-3f25cf9bf423 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:41:45.485957 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7143510-68ef-4972-b718-3f25cf9bf423 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:41:45.489108 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd19bfa-7863-4dd6-8c66-38484d910676 None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:41:45.522047 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa244dc-d220-470f-92a9-7a98d5d532e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:41:45.522657 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa244dc-d220-470f-92a9-7a98d5d532e2 None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:41:45.522931 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa244dc-d220-470f-92a9-7a98d5d532e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:41:45.523197 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa244dc-d220-470f-92a9-7a98d5d532e2 None admin] PATH_INFO: `/v3/roles` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:41:45.523972 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa244dc-d220-470f-92a9-7a98d5d532e2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:41:45.524272 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa244dc-d220-470f-92a9-7a98d5d532e2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:41:45.525669 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa244dc-d220-470f-92a9-7a98d5d532e2 None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:41:45.538301 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 100/193] 10.222.0.15 () {56 vars in 1111 bytes} [Sun Oct 9 00:41:45 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 09 00:41:45.538301 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa244dc-d220-470f-92a9-7a98d5d532e2 None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:41:45.540689 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:41:45.591952 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 94/194] 10.222.0.15 () {58 vars in 1282 bytes} [Sun Oct 9 00:41:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 09 00:41:45.593117 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7143510-68ef-4972-b718-3f25cf9bf423 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:41:45.629581 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:41:45.633224 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa244dc-d220-470f-92a9-7a98d5d532e2 None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:41:45.668048 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee168457-145b-4672-acf6-10accf5845d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:41:45.668984 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee168457-145b-4672-acf6-10accf5845d6 None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:41:45.669274 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee168457-145b-4672-acf6-10accf5845d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:41:45.669550 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee168457-145b-4672-acf6-10accf5845d6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:41:45.671009 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee168457-145b-4672-acf6-10accf5845d6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:41:45.672847 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee168457-145b-4672-acf6-10accf5845d6 None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:41:45.674942 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 101/195] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Oct 9 00:41:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:41:45.675170 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee168457-145b-4672-acf6-10accf5845d6 None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:41:45.695745 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7143510-68ef-4972-b718-3f25cf9bf423 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:41:45.730328 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890053b6-1908-4b4d-8d1f-d1a14cc57c14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:41:45.730966 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890053b6-1908-4b4d-8d1f-d1a14cc57c14 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:41:45.731242 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890053b6-1908-4b4d-8d1f-d1a14cc57c14 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:41:45.731567 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890053b6-1908-4b4d-8d1f-d1a14cc57c14 None admin] PATH_INFO: `/v3/users/e6e20d4c68324c8080bd81996ada970d` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:41:45.732708 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890053b6-1908-4b4d-8d1f-d1a14cc57c14 None admin] RBAC: Authorizing `identity:get_user(user_id=e6e20d4c68324c8080bd81996ada970d)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:41:45.734156 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890053b6-1908-4b4d-8d1f-d1a14cc57c14 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:41:45.735798 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 95/196] 10.222.0.15 () {56 vars in 1177 bytes} [Sun Oct 9 00:41:45 2022] GET /identity/v3/users/e6e20d4c68324c8080bd81996ada970d => generated 283 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:41:45.736569 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890053b6-1908-4b4d-8d1f-d1a14cc57c14 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:41:45.753800 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:41:45.777931 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee168457-145b-4672-acf6-10accf5845d6 None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:41:45.811474 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcee16e-8b0f-4ca9-9181-3fe8097f473d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:41:45.812071 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcee16e-8b0f-4ca9-9181-3fe8097f473d None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:41:45.812353 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcee16e-8b0f-4ca9-9181-3fe8097f473d None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:41:45.812624 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcee16e-8b0f-4ca9-9181-3fe8097f473d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:41:45.822993 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcee16e-8b0f-4ca9-9181-3fe8097f473d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 09 00:41:45.828369 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application [None req-cbcee16e-8b0f-4ca9-9181-3fe8097f473d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 09 00:41:45.828369 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:41:45.828369 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:41:45.828369 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:41:45.828369 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:41:45.828369 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:41:45.828369 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:41:45.828369 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:41:45.828369 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:41:45.828369 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:41:45.828369 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:41:45.828369 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:41:45.828369 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 09 00:41:45.828369 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 09 00:41:45.828369 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 09 00:41:45.828369 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 09 00:41:45.829359 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 09 00:41:45.829359 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 09 00:41:45.829359 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 09 00:41:45.829359 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 09 00:41:45.829359 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:41:45.829359 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:41:45.829359 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:41:45.829359 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:41:45.829359 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:41:45.829359 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:41:45.829359 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:41:45.829359 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application with Lock( Oct 09 00:41:45.829359 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:41:45.829359 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:41:45.829359 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:41:45.829359 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:41:45.835659 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:41:45.835659 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:41:45.835659 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:41:45.835659 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:41:45.835659 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 09 00:41:45.835659 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 09 00:41:45.835659 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 09 00:41:45.835659 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 09 00:41:45.835659 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 09 00:41:45.835659 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 09 00:41:45.835659 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 09 00:41:45.835659 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Oct 09 00:41:45.835659 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 102/197] 10.222.0.15 () {56 vars in 1099 bytes} [Sun Oct 9 00:41:45 2022] GET /identity/v3/roles/reader => generated 84 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:41:45.835659 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcee16e-8b0f-4ca9-9181-3fe8097f473d None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:41:45.840500 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890053b6-1908-4b4d-8d1f-d1a14cc57c14 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:41:45.861782 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:41:45.876602 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d5d788-4daf-4bf4-a3d7-770320f371dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:41:45.877238 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d5d788-4daf-4bf4-a3d7-770320f371dd None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:41:45.877509 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d5d788-4daf-4bf4-a3d7-770320f371dd None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:41:45.877779 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d5d788-4daf-4bf4-a3d7-770320f371dd None admin] PATH_INFO: `/v3/projects/01e5c679ba5842a3830c8b9335e2cb07` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:41:45.878902 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d5d788-4daf-4bf4-a3d7-770320f371dd None admin] RBAC: Authorizing `identity:get_project(project_id=01e5c679ba5842a3830c8b9335e2cb07)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:41:45.880390 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d5d788-4daf-4bf4-a3d7-770320f371dd None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:41:45.882013 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 96/198] 10.222.0.15 () {56 vars in 1186 bytes} [Sun Oct 9 00:41:45 2022] GET /identity/v3/projects/01e5c679ba5842a3830c8b9335e2cb07 => generated 302 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:41:45.882778 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d5d788-4daf-4bf4-a3d7-770320f371dd None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:41:45.938100 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcee16e-8b0f-4ca9-9181-3fe8097f473d None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:41:45.963994 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:41:45.970566 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6cdc48-04e2-49e8-8d3b-f2121e2a4196 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:41:45.971181 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6cdc48-04e2-49e8-8d3b-f2121e2a4196 None admin] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:41:45.971483 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6cdc48-04e2-49e8-8d3b-f2121e2a4196 None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:41:45.971807 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6cdc48-04e2-49e8-8d3b-f2121e2a4196 None admin] PATH_INFO: `/v3/users` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:41:45.972610 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6cdc48-04e2-49e8-8d3b-f2121e2a4196 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:41:45.974084 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6cdc48-04e2-49e8-8d3b-f2121e2a4196 None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:41:45.979924 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d5d788-4daf-4bf4-a3d7-770320f371dd None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:41:45.996460 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 103/199] 10.222.0.15 () {60 vars in 1132 bytes} [Sun Oct 9 00:41:45 2022] POST /identity/v3/users => generated 297 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 09 00:41:45.997340 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6cdc48-04e2-49e8-8d3b-f2121e2a4196 None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:41:46.033009 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad66cae4-7192-490b-aefd-bcd0d1da4cb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:41:46.033719 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad66cae4-7192-490b-aefd-bcd0d1da4cb3 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:41:46.034001 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad66cae4-7192-490b-aefd-bcd0d1da4cb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:41:46.034269 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad66cae4-7192-490b-aefd-bcd0d1da4cb3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:41:46.098573 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:41:46.122763 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6cdc48-04e2-49e8-8d3b-f2121e2a4196 None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:41:46.123476 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad66cae4-7192-490b-aefd-bcd0d1da4cb3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:41:46.125421 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad66cae4-7192-490b-aefd-bcd0d1da4cb3 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:41:46.161701 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664e960e-7ddf-4f32-8a78-751d6f81172b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:41:46.162334 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664e960e-7ddf-4f32-8a78-751d6f81172b None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:41:46.162607 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664e960e-7ddf-4f32-8a78-751d6f81172b None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:41:46.162881 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664e960e-7ddf-4f32-8a78-751d6f81172b None admin] PATH_INFO: `/v3/roles` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:41:46.163758 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664e960e-7ddf-4f32-8a78-751d6f81172b None admin] RBAC: Adding query filter params (name=reader) {{(pid=81525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:41:46.164962 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664e960e-7ddf-4f32-8a78-751d6f81172b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:41:46.166451 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664e960e-7ddf-4f32-8a78-751d6f81172b None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:41:46.176161 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 104/200] 10.222.0.15 () {56 vars in 1101 bytes} [Sun Oct 9 00:41:45 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:41:46.176956 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664e960e-7ddf-4f32-8a78-751d6f81172b None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:41:46.220447 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:41:46.241611 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 97/201] 10.222.0.15 () {58 vars in 1282 bytes} [Sun Oct 9 00:41:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 09 00:41:46.244339 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad66cae4-7192-490b-aefd-bcd0d1da4cb3 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:41:46.295189 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664e960e-7ddf-4f32-8a78-751d6f81172b None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:41:46.338453 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75c9054-1b8d-4e82-ae53-e895639972ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:41:46.339082 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75c9054-1b8d-4e82-ae53-e895639972ce None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:41:46.340344 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75c9054-1b8d-4e82-ae53-e895639972ce None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:41:46.340344 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75c9054-1b8d-4e82-ae53-e895639972ce None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:41:46.340564 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75c9054-1b8d-4e82-ae53-e895639972ce None admin] RBAC: Adding query filter params (role.id=f69dddf26daf4dd79d4c962beb877af5, scope.project.id=01e5c679ba5842a3830c8b9335e2cb07, user.id=e6e20d4c68324c8080bd81996ada970d) {{(pid=81525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:41:46.340835 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75c9054-1b8d-4e82-ae53-e895639972ce None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:41:46.343305 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75c9054-1b8d-4e82-ae53-e895639972ce None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:41:46.350276 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 105/202] 10.222.0.15 () {56 vars in 1374 bytes} [Sun Oct 9 00:41:46 2022] GET /identity/v3/role_assignments?user.id=e6e20d4c68324c8080bd81996ada970d&scope.project.id=01e5c679ba5842a3830c8b9335e2cb07&role.id=f69dddf26daf4dd79d4c962beb877af5 => generated 259 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:41:46.351142 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75c9054-1b8d-4e82-ae53-e895639972ce None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:41:46.364684 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:41:46.370508 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad66cae4-7192-490b-aefd-bcd0d1da4cb3 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:41:46.425239 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a60863b-a5af-4a41-8877-3f62dcc80f34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:41:46.426419 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a60863b-a5af-4a41-8877-3f62dcc80f34 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:41:46.426901 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a60863b-a5af-4a41-8877-3f62dcc80f34 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:41:46.427491 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a60863b-a5af-4a41-8877-3f62dcc80f34 None admin] PATH_INFO: `/v3/users/dad78f63674a4c108c90af4c08cee5ba` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:41:46.429123 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a60863b-a5af-4a41-8877-3f62dcc80f34 None admin] RBAC: Authorizing `identity:get_user(user_id=dad78f63674a4c108c90af4c08cee5ba)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:41:46.431117 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a60863b-a5af-4a41-8877-3f62dcc80f34 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:41:46.435338 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 98/203] 10.222.0.15 () {56 vars in 1177 bytes} [Sun Oct 9 00:41:46 2022] GET /identity/v3/users/dad78f63674a4c108c90af4c08cee5ba => generated 289 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:41:46.439965 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a60863b-a5af-4a41-8877-3f62dcc80f34 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:41:46.493795 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75c9054-1b8d-4e82-ae53-e895639972ce None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:41:46.514154 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:41:46.532429 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d34324b-34b6-4621-871d-0a3176da2b34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:41:46.533099 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d34324b-34b6-4621-871d-0a3176da2b34 None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:41:46.533380 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d34324b-34b6-4621-871d-0a3176da2b34 None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:41:46.533653 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d34324b-34b6-4621-871d-0a3176da2b34 None admin] PATH_INFO: `/v3/projects/01e5c679ba5842a3830c8b9335e2cb07` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:41:46.534944 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d34324b-34b6-4621-871d-0a3176da2b34 None admin] RBAC: Authorizing `identity:get_project(project_id=01e5c679ba5842a3830c8b9335e2cb07)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:41:46.536584 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d34324b-34b6-4621-871d-0a3176da2b34 None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:41:46.538633 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 106/204] 10.222.0.15 () {56 vars in 1186 bytes} [Sun Oct 9 00:41:46 2022] GET /identity/v3/projects/01e5c679ba5842a3830c8b9335e2cb07 => generated 302 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:41:46.544540 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d34324b-34b6-4621-871d-0a3176da2b34 None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:41:46.578949 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a60863b-a5af-4a41-8877-3f62dcc80f34 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:41:46.622264 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0d381d-f827-4c59-b266-25f3e0317df9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:41:46.622900 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0d381d-f827-4c59-b266-25f3e0317df9 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:41:46.623178 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0d381d-f827-4c59-b266-25f3e0317df9 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:41:46.623492 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0d381d-f827-4c59-b266-25f3e0317df9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:41:46.674023 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:41:46.707518 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0d381d-f827-4c59-b266-25f3e0317df9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:41:46.709813 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0d381d-f827-4c59-b266-25f3e0317df9 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:41:46.720559 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d34324b-34b6-4621-871d-0a3176da2b34 None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:41:46.792235 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b095f7-8d31-4aff-851d-cadfc473c57e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:41:46.792776 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b095f7-8d31-4aff-851d-cadfc473c57e None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:41:46.793048 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b095f7-8d31-4aff-851d-cadfc473c57e None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:41:46.793311 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b095f7-8d31-4aff-851d-cadfc473c57e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:41:46.794050 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b095f7-8d31-4aff-851d-cadfc473c57e None admin] RBAC: Adding query filter params (role.id=93f141c2a808407dae6f9704941d0cb2, scope.project.id=01e5c679ba5842a3830c8b9335e2cb07, user.id=e6e20d4c68324c8080bd81996ada970d) {{(pid=81525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:41:46.794433 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b095f7-8d31-4aff-851d-cadfc473c57e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:41:46.795870 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b095f7-8d31-4aff-851d-cadfc473c57e None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:41:46.808116 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 107/205] 10.222.0.15 () {56 vars in 1374 bytes} [Sun Oct 9 00:41:46 2022] GET /identity/v3/role_assignments?user.id=e6e20d4c68324c8080bd81996ada970d&scope.project.id=01e5c679ba5842a3830c8b9335e2cb07&role.id=93f141c2a808407dae6f9704941d0cb2 => generated 259 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 09 00:41:46.820815 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:41:46.870334 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 99/206] 10.222.0.15 () {58 vars in 1282 bytes} [Sun Oct 9 00:41:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 09 00:41:46.876649 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b095f7-8d31-4aff-851d-cadfc473c57e None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:41:47.040276 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b095f7-8d31-4aff-851d-cadfc473c57e None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:41:47.094077 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5f1aec-7b3e-4aa3-baf0-46ea20081f08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:41:47.094723 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5f1aec-7b3e-4aa3-baf0-46ea20081f08 None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:41:47.095002 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5f1aec-7b3e-4aa3-baf0-46ea20081f08 None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:41:47.095284 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5f1aec-7b3e-4aa3-baf0-46ea20081f08 None admin] PATH_INFO: `/v3/projects/3fcf2f5182c445929c38948df6235040` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:41:47.096559 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5f1aec-7b3e-4aa3-baf0-46ea20081f08 None admin] RBAC: Authorizing `identity:get_project(project_id=3fcf2f5182c445929c38948df6235040)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:41:47.098061 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5f1aec-7b3e-4aa3-baf0-46ea20081f08 None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:41:47.099813 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 108/207] 10.222.0.15 () {56 vars in 1186 bytes} [Sun Oct 9 00:41:46 2022] GET /identity/v3/projects/3fcf2f5182c445929c38948df6235040 => generated 298 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:41:47.106330 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0d381d-f827-4c59-b266-25f3e0317df9 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:41:47.258119 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0d381d-f827-4c59-b266-25f3e0317df9 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:41:47.299087 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a70f9d-0994-4365-bd14-17037cbc99c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:41:47.299738 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a70f9d-0994-4365-bd14-17037cbc99c5 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:41:47.300012 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a70f9d-0994-4365-bd14-17037cbc99c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:41:47.300286 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a70f9d-0994-4365-bd14-17037cbc99c5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:41:47.301030 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a70f9d-0994-4365-bd14-17037cbc99c5 None admin] RBAC: Adding query filter params (role.id=9da5e6c99f594f149e3f29f97cf55e7e, scope.project.id=3fcf2f5182c445929c38948df6235040, user.id=dad78f63674a4c108c90af4c08cee5ba) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:41:47.301334 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a70f9d-0994-4365-bd14-17037cbc99c5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:41:47.302798 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a70f9d-0994-4365-bd14-17037cbc99c5 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:41:47.312383 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 100/208] 10.222.0.15 () {56 vars in 1374 bytes} [Sun Oct 9 00:41:47 2022] GET /identity/v3/role_assignments?user.id=dad78f63674a4c108c90af4c08cee5ba&scope.project.id=3fcf2f5182c445929c38948df6235040&role.id=9da5e6c99f594f149e3f29f97cf55e7e => generated 608 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:41:48.714861 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b079dc1-5e60-4e88-b53c-2af09585a1ed None None] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:41:48.715599 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b079dc1-5e60-4e88-b53c-2af09585a1ed None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:41:48.715599 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b079dc1-5e60-4e88-b53c-2af09585a1ed None None] PATH_INFO: `/` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:41:48.716943 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 109/209] 10.222.0.15 () {54 vars in 927 bytes} [Sun Oct 9 00:41:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:41:48.722566 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5047c9e-d396-44e0-9724-327e8971ce24 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:41:48.723082 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5047c9e-d396-44e0-9724-327e8971ce24 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:41:48.723082 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5047c9e-d396-44e0-9724-327e8971ce24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:41:48.747507 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-c5047c9e-d396-44e0-9724-327e8971ce24 None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:41:48.748799 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-c5047c9e-d396-44e0-9724-327e8971ce24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:41:48.764585 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:41:48.770201 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c209d456-eb64-481a-92cb-eb41ac14a832 None None] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:41:48.770524 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c209d456-eb64-481a-92cb-eb41ac14a832 None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:41:48.770731 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c209d456-eb64-481a-92cb-eb41ac14a832 None None] PATH_INFO: `/` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:41:48.772441 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 110/210] 10.222.0.15 () {54 vars in 927 bytes} [Sun Oct 9 00:41:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:41:48.779568 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6952ab0-86b6-44f8-ae5b-f99754986fc5 None None] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:41:48.779899 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6952ab0-86b6-44f8-ae5b-f99754986fc5 None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:41:48.780096 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6952ab0-86b6-44f8-ae5b-f99754986fc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:41:48.799800 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.auth.core [None req-e6952ab0-86b6-44f8-ae5b-f99754986fc5 None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:41:48.800993 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-e6952ab0-86b6-44f8-ae5b-f99754986fc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:41:48.803168 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:41:48.828934 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 101/211] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Oct 9 00:41:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 09 00:41:48.875999 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d372ba56-3048-403e-8f50-c01908440323 None None] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:41:48.876867 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d372ba56-3048-403e-8f50-c01908440323 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:41:48.877744 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d372ba56-3048-403e-8f50-c01908440323 None None] PATH_INFO: `/` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:41:48.879660 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 102/212] 10.222.0.15 () {54 vars in 927 bytes} [Sun Oct 9 00:41:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 09 00:41:48.885749 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 111/213] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Oct 9 00:41:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 09 00:41:48.890515 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26f89b8-5e41-4973-8ca1-105e73aef8c8 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:41:48.890801 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26f89b8-5e41-4973-8ca1-105e73aef8c8 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:41:48.891100 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26f89b8-5e41-4973-8ca1-105e73aef8c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:41:48.910573 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-c26f89b8-5e41-4973-8ca1-105e73aef8c8 None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:41:48.911857 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-c26f89b8-5e41-4973-8ca1-105e73aef8c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:41:48.980427 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 103/214] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Oct 9 00:41:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 09 00:41:49.117125 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6952ab0-86b6-44f8-ae5b-f99754986fc5 None None] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:41:49.171209 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26f89b8-5e41-4973-8ca1-105e73aef8c8 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:41:49.225963 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6952ab0-86b6-44f8-ae5b-f99754986fc5 None None] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:41:49.260048 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:41:49.261876 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107e1d17-05ef-4b35-900a-45363eaacec7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:41:49.262523 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107e1d17-05ef-4b35-900a-45363eaacec7 None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:41:49.262824 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107e1d17-05ef-4b35-900a-45363eaacec7 None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:41:49.263125 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107e1d17-05ef-4b35-900a-45363eaacec7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:41:49.264361 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107e1d17-05ef-4b35-900a-45363eaacec7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:41:49.265792 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107e1d17-05ef-4b35-900a-45363eaacec7 None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:41:49.267430 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 112/215] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Oct 9 00:41:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:41:49.268541 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7733f8-a4d2-4033-8050-08fa79122086 None None] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:41:49.268810 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7733f8-a4d2-4033-8050-08fa79122086 None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:41:49.269091 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7733f8-a4d2-4033-8050-08fa79122086 None None] PATH_INFO: `/` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:41:49.274409 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 113/216] 10.222.0.15 () {54 vars in 927 bytes} [Sun Oct 9 00:41:49 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:41:49.274409 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7733f8-a4d2-4033-8050-08fa79122086 None None] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:41:49.283041 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:41:49.287366 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26f89b8-5e41-4973-8ca1-105e73aef8c8 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:41:49.322187 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea9e28f-8006-4b3b-b403-c88ae182bb9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:41:49.322850 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea9e28f-8006-4b3b-b403-c88ae182bb9e None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:41:49.323133 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea9e28f-8006-4b3b-b403-c88ae182bb9e None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:41:49.323446 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea9e28f-8006-4b3b-b403-c88ae182bb9e None admin] PATH_INFO: `/v3/roles/member` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:41:49.333374 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea9e28f-8006-4b3b-b403-c88ae182bb9e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 09 00:41:49.338294 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application [None req-9ea9e28f-8006-4b3b-b403-c88ae182bb9e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 09 00:41:49.338294 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:41:49.338294 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:41:49.338294 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:41:49.338294 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:41:49.338294 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:41:49.338294 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:41:49.338294 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:41:49.338294 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:41:49.338294 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:41:49.338294 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:41:49.338294 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:41:49.338294 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 09 00:41:49.338294 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 09 00:41:49.338294 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 09 00:41:49.338294 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 09 00:41:49.339408 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 09 00:41:49.339408 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 09 00:41:49.339408 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 09 00:41:49.339408 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 09 00:41:49.339408 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:41:49.339408 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:41:49.339408 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:41:49.339408 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:41:49.339408 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:41:49.339408 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:41:49.339408 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:41:49.339408 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application with Lock( Oct 09 00:41:49.339408 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:41:49.339408 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:41:49.339408 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:41:49.339408 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:41:49.340196 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:41:49.340196 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:41:49.340196 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:41:49.340196 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:41:49.340196 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 09 00:41:49.340196 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 09 00:41:49.340196 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 09 00:41:49.340196 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 09 00:41:49.340196 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 09 00:41:49.340196 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 09 00:41:49.340196 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 09 00:41:49.340196 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application Oct 09 00:41:49.340196 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 104/217] 10.222.0.15 () {56 vars in 1099 bytes} [Sun Oct 9 00:41:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 09 00:41:49.340843 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea9e28f-8006-4b3b-b403-c88ae182bb9e None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:41:49.385863 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7733f8-a4d2-4033-8050-08fa79122086 None None] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:41:49.421957 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3993f2bc-f55a-4238-9f29-ca61a20f4c98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:41:49.422593 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3993f2bc-f55a-4238-9f29-ca61a20f4c98 None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:41:49.422862 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3993f2bc-f55a-4238-9f29-ca61a20f4c98 None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:41:49.423126 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3993f2bc-f55a-4238-9f29-ca61a20f4c98 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:41:49.433893 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3993f2bc-f55a-4238-9f29-ca61a20f4c98 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 09 00:41:49.439027 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application [None req-3993f2bc-f55a-4238-9f29-ca61a20f4c98 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 09 00:41:49.439027 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:41:49.439027 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:41:49.439027 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:41:49.439027 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:41:49.439027 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:41:49.439027 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:41:49.439027 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:41:49.439027 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:41:49.439027 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:41:49.439027 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:41:49.439027 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:41:49.439027 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 09 00:41:49.439027 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 09 00:41:49.439027 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 09 00:41:49.439027 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 09 00:41:49.441074 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 09 00:41:49.441074 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 09 00:41:49.441074 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 09 00:41:49.441074 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 09 00:41:49.441074 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:41:49.441074 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:41:49.441074 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:41:49.441074 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:41:49.441074 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:41:49.441074 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:41:49.441074 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:41:49.441074 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application with Lock( Oct 09 00:41:49.441074 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:41:49.441074 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:41:49.441074 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:41:49.441074 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:41:49.442773 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:41:49.442773 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:41:49.442773 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:41:49.442773 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:41:49.442773 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 09 00:41:49.442773 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 09 00:41:49.442773 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 09 00:41:49.442773 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 09 00:41:49.442773 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 09 00:41:49.442773 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 09 00:41:49.442773 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 09 00:41:49.442773 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Oct 09 00:41:49.442773 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 114/218] 10.222.0.15 () {56 vars in 1096 bytes} [Sun Oct 9 00:41:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:41:49.445377 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092dedd8-5215-478a-8b1e-4cd8136ea813 None None] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:41:49.445377 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092dedd8-5215-478a-8b1e-4cd8136ea813 None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:41:49.445377 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092dedd8-5215-478a-8b1e-4cd8136ea813 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:41:49.464230 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea9e28f-8006-4b3b-b403-c88ae182bb9e None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:41:49.465051 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.auth.core [None req-092dedd8-5215-478a-8b1e-4cd8136ea813 None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:41:49.466287 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-092dedd8-5215-478a-8b1e-4cd8136ea813 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:41:49.497762 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234c1b2b-c6ea-47a5-a011-1579a1c7e312 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:41:49.498373 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234c1b2b-c6ea-47a5-a011-1579a1c7e312 None admin] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:41:49.498646 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234c1b2b-c6ea-47a5-a011-1579a1c7e312 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:41:49.499239 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234c1b2b-c6ea-47a5-a011-1579a1c7e312 None admin] PATH_INFO: `/v3/users` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:41:49.499929 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234c1b2b-c6ea-47a5-a011-1579a1c7e312 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:41:49.501384 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234c1b2b-c6ea-47a5-a011-1579a1c7e312 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:41:49.513801 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:41:49.527682 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:41:49.530275 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 105/219] 10.222.0.15 () {60 vars in 1132 bytes} [Sun Oct 9 00:41:49 2022] POST /identity/v3/users => generated 297 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 09 00:41:49.531156 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234c1b2b-c6ea-47a5-a011-1579a1c7e312 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:41:49.551291 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 115/220] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Oct 9 00:41:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 09 00:41:49.551291 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092dedd8-5215-478a-8b1e-4cd8136ea813 None None] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:41:49.644311 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234c1b2b-c6ea-47a5-a011-1579a1c7e312 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:41:49.686668 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc23e89-7d28-40df-aa39-766cc5d74432 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:41:49.687331 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc23e89-7d28-40df-aa39-766cc5d74432 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:41:49.687612 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc23e89-7d28-40df-aa39-766cc5d74432 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:41:49.687884 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc23e89-7d28-40df-aa39-766cc5d74432 None admin] PATH_INFO: `/v3/roles` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:41:49.688675 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc23e89-7d28-40df-aa39-766cc5d74432 None admin] RBAC: Adding query filter params (name=member) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:41:49.688865 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc23e89-7d28-40df-aa39-766cc5d74432 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:41:49.690309 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc23e89-7d28-40df-aa39-766cc5d74432 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:41:49.705298 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 106/221] 10.222.0.15 () {56 vars in 1101 bytes} [Sun Oct 9 00:41:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:41:49.706328 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc23e89-7d28-40df-aa39-766cc5d74432 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:41:49.741280 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092dedd8-5215-478a-8b1e-4cd8136ea813 None None] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:41:49.774220 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:41:49.795365 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f26e697-9051-48f7-9fe8-556464222fc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:41:49.796843 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f26e697-9051-48f7-9fe8-556464222fc8 None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:41:49.797592 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f26e697-9051-48f7-9fe8-556464222fc8 None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:41:49.798332 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f26e697-9051-48f7-9fe8-556464222fc8 None admin] PATH_INFO: `/v3/roles` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:41:49.799668 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f26e697-9051-48f7-9fe8-556464222fc8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:41:49.800270 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f26e697-9051-48f7-9fe8-556464222fc8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:41:49.802804 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f26e697-9051-48f7-9fe8-556464222fc8 None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:41:49.819708 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 116/222] 10.222.0.15 () {56 vars in 1099 bytes} [Sun Oct 9 00:41:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:41:49.821232 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f26e697-9051-48f7-9fe8-556464222fc8 None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:41:49.831295 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc23e89-7d28-40df-aa39-766cc5d74432 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:41:49.876306 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc79127-1daa-4252-b9e6-def04c6c8616 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:41:49.876977 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc79127-1daa-4252-b9e6-def04c6c8616 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:41:49.877258 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc79127-1daa-4252-b9e6-def04c6c8616 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:41:49.877527 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc79127-1daa-4252-b9e6-def04c6c8616 None admin] PATH_INFO: `/v3/users/ac9b23b1c3f94770a4f872f6167ee3b0` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:41:49.896930 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc79127-1daa-4252-b9e6-def04c6c8616 None admin] RBAC: Authorizing `identity:get_user(user_id=ac9b23b1c3f94770a4f872f6167ee3b0)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:41:49.898520 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc79127-1daa-4252-b9e6-def04c6c8616 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:41:49.900563 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 107/223] 10.222.0.15 () {56 vars in 1177 bytes} [Sun Oct 9 00:41:49 2022] GET /identity/v3/users/ac9b23b1c3f94770a4f872f6167ee3b0 => generated 297 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:41:49.901300 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc79127-1daa-4252-b9e6-def04c6c8616 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:41:49.903176 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:41:49.953771 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f26e697-9051-48f7-9fe8-556464222fc8 None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:41:50.001070 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2eeeb1-cdc0-45e7-9976-8e180c7767b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:41:50.002122 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2eeeb1-cdc0-45e7-9976-8e180c7767b0 None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:41:50.002589 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2eeeb1-cdc0-45e7-9976-8e180c7767b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:41:50.003092 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2eeeb1-cdc0-45e7-9976-8e180c7767b0 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:41:50.019588 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2eeeb1-cdc0-45e7-9976-8e180c7767b0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 09 00:41:50.025103 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application [None req-0f2eeeb1-cdc0-45e7-9976-8e180c7767b0 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 09 00:41:50.025103 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:41:50.025103 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:41:50.025103 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:41:50.025103 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:41:50.025103 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:41:50.025103 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:41:50.025103 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:41:50.025103 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:41:50.025103 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:41:50.025103 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:41:50.025103 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:41:50.025103 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 09 00:41:50.025103 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 09 00:41:50.025103 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 09 00:41:50.025103 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 09 00:41:50.026257 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 09 00:41:50.026257 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 09 00:41:50.026257 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 09 00:41:50.026257 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 09 00:41:50.026257 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:41:50.026257 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:41:50.026257 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:41:50.026257 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:41:50.026257 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:41:50.026257 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:41:50.026257 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:41:50.026257 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application with Lock( Oct 09 00:41:50.026257 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:41:50.026257 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:41:50.026257 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:41:50.026257 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:41:50.027043 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:41:50.027043 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:41:50.027043 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:41:50.027043 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:41:50.027043 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 09 00:41:50.027043 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 09 00:41:50.027043 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 09 00:41:50.027043 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 09 00:41:50.027043 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 09 00:41:50.027043 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 09 00:41:50.027043 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 09 00:41:50.027043 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Oct 09 00:41:50.029708 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 117/224] 10.222.0.15 () {56 vars in 1114 bytes} [Sun Oct 9 00:41:49 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:41:50.030755 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2eeeb1-cdc0-45e7-9976-8e180c7767b0 None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:41:50.042024 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc79127-1daa-4252-b9e6-def04c6c8616 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:41:50.056902 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:41:50.081482 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7183b781-2316-424b-b350-ea2b3e6448d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:41:50.082499 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7183b781-2316-424b-b350-ea2b3e6448d7 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:41:50.083091 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7183b781-2316-424b-b350-ea2b3e6448d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:41:50.083597 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7183b781-2316-424b-b350-ea2b3e6448d7 None admin] PATH_INFO: `/v3/users/e6e20d4c68324c8080bd81996ada970d` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:41:50.085070 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7183b781-2316-424b-b350-ea2b3e6448d7 None admin] RBAC: Authorizing `identity:get_user(user_id=e6e20d4c68324c8080bd81996ada970d)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:41:50.086739 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7183b781-2316-424b-b350-ea2b3e6448d7 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:41:50.089103 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 108/225] 10.222.0.15 () {56 vars in 1177 bytes} [Sun Oct 9 00:41:49 2022] GET /identity/v3/users/e6e20d4c68324c8080bd81996ada970d => generated 283 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:41:50.090225 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7183b781-2316-424b-b350-ea2b3e6448d7 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:41:50.159408 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2eeeb1-cdc0-45e7-9976-8e180c7767b0 None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:41:50.178708 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:41:50.199456 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745051ee-50a3-4704-8711-9ccff9f3fbfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:41:50.200429 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745051ee-50a3-4704-8711-9ccff9f3fbfb None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:41:50.200899 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745051ee-50a3-4704-8711-9ccff9f3fbfb None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:41:50.201403 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745051ee-50a3-4704-8711-9ccff9f3fbfb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:41:50.242153 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7183b781-2316-424b-b350-ea2b3e6448d7 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:41:50.274993 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745051ee-50a3-4704-8711-9ccff9f3fbfb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:41:50.277107 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745051ee-50a3-4704-8711-9ccff9f3fbfb None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:41:50.286666 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce37a4f-dee9-40e9-80fc-6ffbed0068f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:41:50.287628 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce37a4f-dee9-40e9-80fc-6ffbed0068f5 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:41:50.287904 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce37a4f-dee9-40e9-80fc-6ffbed0068f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:41:50.288178 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce37a4f-dee9-40e9-80fc-6ffbed0068f5 None admin] PATH_INFO: `/v3/roles` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:41:50.288858 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce37a4f-dee9-40e9-80fc-6ffbed0068f5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:41:50.289163 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce37a4f-dee9-40e9-80fc-6ffbed0068f5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:41:50.291070 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce37a4f-dee9-40e9-80fc-6ffbed0068f5 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:41:50.307474 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 109/226] 10.222.0.15 () {56 vars in 1111 bytes} [Sun Oct 9 00:41:50 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:41:50.308394 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce37a4f-dee9-40e9-80fc-6ffbed0068f5 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:41:50.371649 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:41:50.398962 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 118/227] 10.222.0.15 () {58 vars in 1282 bytes} [Sun Oct 9 00:41:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 09 00:41:50.399867 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745051ee-50a3-4704-8711-9ccff9f3fbfb None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:41:50.419634 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:41:50.453614 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce37a4f-dee9-40e9-80fc-6ffbed0068f5 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:41:50.499950 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64db4a76-801e-4b35-afcc-29219013244e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:41:50.501146 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64db4a76-801e-4b35-afcc-29219013244e None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:41:50.502014 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64db4a76-801e-4b35-afcc-29219013244e None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:41:50.502459 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64db4a76-801e-4b35-afcc-29219013244e None admin] PATH_INFO: `/v3/projects/01e5c679ba5842a3830c8b9335e2cb07` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:41:50.503812 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64db4a76-801e-4b35-afcc-29219013244e None admin] RBAC: Authorizing `identity:get_project(project_id=01e5c679ba5842a3830c8b9335e2cb07)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:41:50.506266 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64db4a76-801e-4b35-afcc-29219013244e None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:41:50.513124 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 110/228] 10.222.0.15 () {56 vars in 1186 bytes} [Sun Oct 9 00:41:50 2022] GET /identity/v3/projects/01e5c679ba5842a3830c8b9335e2cb07 => generated 302 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:41:50.513124 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64db4a76-801e-4b35-afcc-29219013244e None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:41:50.525191 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745051ee-50a3-4704-8711-9ccff9f3fbfb None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:41:50.570849 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cd9832-39b5-43b7-b0e9-10436222dc44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:41:50.572080 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cd9832-39b5-43b7-b0e9-10436222dc44 None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:41:50.572578 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cd9832-39b5-43b7-b0e9-10436222dc44 None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:41:50.573013 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cd9832-39b5-43b7-b0e9-10436222dc44 None admin] PATH_INFO: `/v3/users/e6e20d4c68324c8080bd81996ada970d` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:41:50.575102 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cd9832-39b5-43b7-b0e9-10436222dc44 None admin] RBAC: Authorizing `identity:get_user(user_id=e6e20d4c68324c8080bd81996ada970d)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:41:50.577299 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cd9832-39b5-43b7-b0e9-10436222dc44 None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:41:50.584411 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 119/229] 10.222.0.15 () {56 vars in 1177 bytes} [Sun Oct 9 00:41:50 2022] GET /identity/v3/users/e6e20d4c68324c8080bd81996ada970d => generated 283 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:41:50.584411 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cd9832-39b5-43b7-b0e9-10436222dc44 None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:41:50.640058 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64db4a76-801e-4b35-afcc-29219013244e None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:41:50.654645 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:41:50.679167 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:41:50.688021 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c1980e-8f68-4f0c-bb88-e97cebcb31a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:41:50.689574 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c1980e-8f68-4f0c-bb88-e97cebcb31a4 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:41:50.690080 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c1980e-8f68-4f0c-bb88-e97cebcb31a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:41:50.690700 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c1980e-8f68-4f0c-bb88-e97cebcb31a4 None admin] PATH_INFO: `/v3/projects/01e5c679ba5842a3830c8b9335e2cb07` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:41:50.692828 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c1980e-8f68-4f0c-bb88-e97cebcb31a4 None admin] RBAC: Authorizing `identity:get_project(project_id=01e5c679ba5842a3830c8b9335e2cb07)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:41:50.695199 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c1980e-8f68-4f0c-bb88-e97cebcb31a4 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:41:50.697598 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 111/230] 10.222.0.15 () {56 vars in 1186 bytes} [Sun Oct 9 00:41:50 2022] GET /identity/v3/projects/01e5c679ba5842a3830c8b9335e2cb07 => generated 302 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:41:50.698149 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cd9832-39b5-43b7-b0e9-10436222dc44 None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:41:50.699107 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c1980e-8f68-4f0c-bb88-e97cebcb31a4 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:41:50.736202 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1da1d7e-446f-4f51-a532-f26c908e703c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:41:50.736905 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1da1d7e-446f-4f51-a532-f26c908e703c None admin] REQUEST_METHOD: `PUT` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:41:50.737177 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1da1d7e-446f-4f51-a532-f26c908e703c None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:41:50.737508 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1da1d7e-446f-4f51-a532-f26c908e703c None admin] PATH_INFO: `/v3/projects/01e5c679ba5842a3830c8b9335e2cb07/users/e6e20d4c68324c8080bd81996ada970d/roles/f69dddf26daf4dd79d4c962beb877af5` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:41:50.739692 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1da1d7e-446f-4f51-a532-f26c908e703c None admin] RBAC: Authorizing `identity:create_grant(project_id=01e5c679ba5842a3830c8b9335e2cb07, user_id=e6e20d4c68324c8080bd81996ada970d, role_id=f69dddf26daf4dd79d4c962beb877af5)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:41:50.741151 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1da1d7e-446f-4f51-a532-f26c908e703c None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:41:50.763287 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 120/231] 10.222.0.15 () {58 vars in 1439 bytes} [Sun Oct 9 00:41:50 2022] PUT /identity/v3/projects/01e5c679ba5842a3830c8b9335e2cb07/users/e6e20d4c68324c8080bd81996ada970d/roles/f69dddf26daf4dd79d4c962beb877af5 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 00:41:50.763287 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1da1d7e-446f-4f51-a532-f26c908e703c None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:41:50.887900 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1da1d7e-446f-4f51-a532-f26c908e703c None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:41:50.913910 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c1980e-8f68-4f0c-bb88-e97cebcb31a4 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:41:50.943282 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104cd3ee-6f0b-4b26-b904-397473dbe662 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:41:50.944196 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104cd3ee-6f0b-4b26-b904-397473dbe662 None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:41:50.944475 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104cd3ee-6f0b-4b26-b904-397473dbe662 None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:41:50.944746 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104cd3ee-6f0b-4b26-b904-397473dbe662 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:41:50.945491 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104cd3ee-6f0b-4b26-b904-397473dbe662 None admin] RBAC: Adding query filter params (role.id=afb0a01183d9497795eaa4fa1a4046ae, scope.project.id=01e5c679ba5842a3830c8b9335e2cb07, user.id=ac9b23b1c3f94770a4f872f6167ee3b0) {{(pid=81525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:41:50.945795 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104cd3ee-6f0b-4b26-b904-397473dbe662 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:41:50.948628 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104cd3ee-6f0b-4b26-b904-397473dbe662 None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:41:50.962539 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 121/232] 10.222.0.15 () {56 vars in 1374 bytes} [Sun Oct 9 00:41:50 2022] GET /identity/v3/role_assignments?user.id=ac9b23b1c3f94770a4f872f6167ee3b0&scope.project.id=01e5c679ba5842a3830c8b9335e2cb07&role.id=afb0a01183d9497795eaa4fa1a4046ae => generated 259 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:41:50.978756 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0e5674-1040-4061-85bb-2962c24e07ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:41:50.979535 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0e5674-1040-4061-85bb-2962c24e07ef None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:41:50.979813 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0e5674-1040-4061-85bb-2962c24e07ef None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:41:50.980082 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0e5674-1040-4061-85bb-2962c24e07ef None admin] PATH_INFO: `/v3/projects/01e5c679ba5842a3830c8b9335e2cb07` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:41:50.981345 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0e5674-1040-4061-85bb-2962c24e07ef None admin] RBAC: Authorizing `identity:get_project(project_id=01e5c679ba5842a3830c8b9335e2cb07)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:41:50.982925 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0e5674-1040-4061-85bb-2962c24e07ef None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:41:50.984998 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 112/233] 10.222.0.15 () {56 vars in 1186 bytes} [Sun Oct 9 00:41:50 2022] GET /identity/v3/projects/01e5c679ba5842a3830c8b9335e2cb07 => generated 302 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:41:50.991087 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104cd3ee-6f0b-4b26-b904-397473dbe662 None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:41:51.007158 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:41:51.118287 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104cd3ee-6f0b-4b26-b904-397473dbe662 None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:41:51.155934 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c7fdaa-b010-4e12-873b-692ddcf09a0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:41:51.156528 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c7fdaa-b010-4e12-873b-692ddcf09a0b None admin] REQUEST_METHOD: `PUT` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:41:51.156807 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c7fdaa-b010-4e12-873b-692ddcf09a0b None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:41:51.157078 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c7fdaa-b010-4e12-873b-692ddcf09a0b None admin] PATH_INFO: `/v3/projects/01e5c679ba5842a3830c8b9335e2cb07/users/e6e20d4c68324c8080bd81996ada970d/roles/93f141c2a808407dae6f9704941d0cb2` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:41:51.159378 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c7fdaa-b010-4e12-873b-692ddcf09a0b None admin] RBAC: Authorizing `identity:create_grant(project_id=01e5c679ba5842a3830c8b9335e2cb07, user_id=e6e20d4c68324c8080bd81996ada970d, role_id=93f141c2a808407dae6f9704941d0cb2)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:41:51.160886 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c7fdaa-b010-4e12-873b-692ddcf09a0b None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:41:51.180093 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 122/234] 10.222.0.15 () {58 vars in 1439 bytes} [Sun Oct 9 00:41:50 2022] PUT /identity/v3/projects/01e5c679ba5842a3830c8b9335e2cb07/users/e6e20d4c68324c8080bd81996ada970d/roles/93f141c2a808407dae6f9704941d0cb2 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 09 00:41:52.208780 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afca1d20-ef04-4191-abf0-2a09a1167961 None None] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:41:52.209337 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afca1d20-ef04-4191-abf0-2a09a1167961 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:41:52.209337 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afca1d20-ef04-4191-abf0-2a09a1167961 None None] PATH_INFO: `/` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:41:52.210926 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 113/235] 10.222.0.15 () {54 vars in 927 bytes} [Sun Oct 9 00:41:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:41:52.216500 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3725d5cc-554d-48bb-81a6-895f6d2b5b1c None None] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:41:52.216940 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3725d5cc-554d-48bb-81a6-895f6d2b5b1c None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:41:52.217137 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3725d5cc-554d-48bb-81a6-895f6d2b5b1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:41:52.236143 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.auth.core [None req-3725d5cc-554d-48bb-81a6-895f6d2b5b1c None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:41:52.237356 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-3725d5cc-554d-48bb-81a6-895f6d2b5b1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:41:52.240243 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede680c6-d2ae-4d07-a5c4-c85b8bb99300 None None] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:41:52.240522 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede680c6-d2ae-4d07-a5c4-c85b8bb99300 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:41:52.240787 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede680c6-d2ae-4d07-a5c4-c85b8bb99300 None None] PATH_INFO: `/` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:41:52.242366 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 114/236] 10.222.0.15 () {54 vars in 927 bytes} [Sun Oct 9 00:41:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:41:52.247893 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3b3131-a07a-47e0-a1d3-57e10166181d None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:41:52.248168 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3b3131-a07a-47e0-a1d3-57e10166181d None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:41:52.248439 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3b3131-a07a-47e0-a1d3-57e10166181d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:41:52.268014 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-8d3b3131-a07a-47e0-a1d3-57e10166181d None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:41:52.269302 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-8d3b3131-a07a-47e0-a1d3-57e10166181d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:41:52.326891 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:41:52.339383 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 123/237] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Oct 9 00:41:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 09 00:41:52.343637 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:41:52.387499 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 115/238] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Oct 9 00:41:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 09 00:41:52.680228 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3725d5cc-554d-48bb-81a6-895f6d2b5b1c None None] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:41:52.710234 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3b3131-a07a-47e0-a1d3-57e10166181d None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:41:52.847496 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3725d5cc-554d-48bb-81a6-895f6d2b5b1c None None] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:41:52.893154 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3b3131-a07a-47e0-a1d3-57e10166181d None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:41:52.920086 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452f2f54-4aac-495c-bce4-d43419d78689 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:41:52.920747 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452f2f54-4aac-495c-bce4-d43419d78689 None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:41:52.921023 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452f2f54-4aac-495c-bce4-d43419d78689 None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:41:52.921294 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452f2f54-4aac-495c-bce4-d43419d78689 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:41:52.944032 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452f2f54-4aac-495c-bce4-d43419d78689 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 09 00:41:52.951307 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application [None req-452f2f54-4aac-495c-bce4-d43419d78689 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 09 00:41:52.951307 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:41:52.951307 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:41:52.951307 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:41:52.951307 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:41:52.951307 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:41:52.951307 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:41:52.951307 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:41:52.951307 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:41:52.951307 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:41:52.951307 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:41:52.951307 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:41:52.951307 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 09 00:41:52.951307 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 09 00:41:52.951307 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 09 00:41:52.951307 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 09 00:41:52.952182 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 09 00:41:52.952182 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 09 00:41:52.952182 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 09 00:41:52.952182 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 09 00:41:52.952182 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:41:52.952182 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:41:52.952182 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:41:52.952182 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:41:52.952182 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:41:52.952182 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:41:52.952182 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:41:52.952182 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application with Lock( Oct 09 00:41:52.952182 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:41:52.952182 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:41:52.952182 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:41:52.952182 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:41:52.952948 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:41:52.952948 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:41:52.952948 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:41:52.952948 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:41:52.952948 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 09 00:41:52.952948 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 09 00:41:52.952948 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 09 00:41:52.952948 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 09 00:41:52.952948 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 09 00:41:52.952948 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 09 00:41:52.952948 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 09 00:41:52.952948 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Oct 09 00:41:52.952948 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 124/239] 10.222.0.15 () {56 vars in 1099 bytes} [Sun Oct 9 00:41:52 2022] GET /identity/v3/roles/reader => generated 84 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:41:52.956170 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452f2f54-4aac-495c-bce4-d43419d78689 None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:41:52.979522 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90c5d8c-a9ea-4908-a545-da20718ef5f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:41:52.980278 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90c5d8c-a9ea-4908-a545-da20718ef5f0 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:41:52.980549 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90c5d8c-a9ea-4908-a545-da20718ef5f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:41:52.980809 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90c5d8c-a9ea-4908-a545-da20718ef5f0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:41:52.985721 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90c5d8c-a9ea-4908-a545-da20718ef5f0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:41:52.987193 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90c5d8c-a9ea-4908-a545-da20718ef5f0 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:41:52.990291 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 116/240] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Oct 9 00:41:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 09 00:41:52.995996 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90c5d8c-a9ea-4908-a545-da20718ef5f0 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:41:53.052141 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:41:53.075670 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:41:53.109371 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452f2f54-4aac-495c-bce4-d43419d78689 None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:41:53.152971 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845634bb-81f0-4bcb-9fbf-6f02787a6e01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:41:53.153594 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845634bb-81f0-4bcb-9fbf-6f02787a6e01 None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:41:53.153868 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845634bb-81f0-4bcb-9fbf-6f02787a6e01 None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:41:53.154138 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845634bb-81f0-4bcb-9fbf-6f02787a6e01 None admin] PATH_INFO: `/v3/roles` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:41:53.154807 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845634bb-81f0-4bcb-9fbf-6f02787a6e01 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:41:53.155114 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845634bb-81f0-4bcb-9fbf-6f02787a6e01 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:41:53.156538 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845634bb-81f0-4bcb-9fbf-6f02787a6e01 None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:41:53.166579 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90c5d8c-a9ea-4908-a545-da20718ef5f0 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:41:53.174074 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 125/241] 10.222.0.15 () {56 vars in 1101 bytes} [Sun Oct 9 00:41:52 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 09 00:41:53.179651 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845634bb-81f0-4bcb-9fbf-6f02787a6e01 None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:41:53.231335 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bbd086-252c-4d01-bc1b-b1f78d5fe0a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:41:53.231989 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bbd086-252c-4d01-bc1b-b1f78d5fe0a1 None admin] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:41:53.232199 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bbd086-252c-4d01-bc1b-b1f78d5fe0a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:41:53.232470 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bbd086-252c-4d01-bc1b-b1f78d5fe0a1 None admin] PATH_INFO: `/v3/users` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:41:53.233185 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bbd086-252c-4d01-bc1b-b1f78d5fe0a1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:41:53.234642 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bbd086-252c-4d01-bc1b-b1f78d5fe0a1 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:41:53.269459 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 117/242] 10.222.0.15 () {60 vars in 1132 bytes} [Sun Oct 9 00:41:52 2022] POST /identity/v3/users => generated 293 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 09 00:41:53.370790 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845634bb-81f0-4bcb-9fbf-6f02787a6e01 None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:41:53.402408 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:41:53.421398 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502a6aa2-31b5-48a6-8863-5aee605802d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:41:53.422063 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502a6aa2-31b5-48a6-8863-5aee605802d1 None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:41:53.422338 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502a6aa2-31b5-48a6-8863-5aee605802d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:41:53.422610 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502a6aa2-31b5-48a6-8863-5aee605802d1 None admin] PATH_INFO: `/v3/users/29b54e97fdf740e8b36e0e6428db5047` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:41:53.443655 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502a6aa2-31b5-48a6-8863-5aee605802d1 None admin] RBAC: Authorizing `identity:get_user(user_id=29b54e97fdf740e8b36e0e6428db5047)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:41:53.445204 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502a6aa2-31b5-48a6-8863-5aee605802d1 None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:41:53.447440 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 126/243] 10.222.0.15 () {56 vars in 1177 bytes} [Sun Oct 9 00:41:53 2022] GET /identity/v3/users/29b54e97fdf740e8b36e0e6428db5047 => generated 297 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:41:53.453157 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bbd086-252c-4d01-bc1b-b1f78d5fe0a1 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:41:53.510536 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209c90dc-219d-4f10-97b3-e2c334000951 None None] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:41:53.510706 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209c90dc-219d-4f10-97b3-e2c334000951 None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:41:53.511084 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209c90dc-219d-4f10-97b3-e2c334000951 None None] PATH_INFO: `/` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:41:53.512864 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 127/244] 10.222.0.15 () {54 vars in 927 bytes} [Sun Oct 9 00:41:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:41:53.521160 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525d49c8-6543-4e9a-a9c9-cc600eff4c1e None None] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:41:53.521497 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525d49c8-6543-4e9a-a9c9-cc600eff4c1e None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:41:53.521698 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525d49c8-6543-4e9a-a9c9-cc600eff4c1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:41:53.552819 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.auth.core [None req-525d49c8-6543-4e9a-a9c9-cc600eff4c1e None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:41:53.554047 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-525d49c8-6543-4e9a-a9c9-cc600eff4c1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:41:53.629455 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:41:53.634328 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bbd086-252c-4d01-bc1b-b1f78d5fe0a1 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:41:53.658688 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 128/245] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Oct 9 00:41:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 09 00:41:53.678718 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34bb255-2602-4a13-a256-1edc80b4fcce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:41:53.679422 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34bb255-2602-4a13-a256-1edc80b4fcce None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:41:53.679708 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34bb255-2602-4a13-a256-1edc80b4fcce None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:41:53.679979 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34bb255-2602-4a13-a256-1edc80b4fcce None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:41:53.768551 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34bb255-2602-4a13-a256-1edc80b4fcce None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:41:53.770032 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34bb255-2602-4a13-a256-1edc80b4fcce None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:41:53.861513 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501a2333-0fa0-4b4b-847e-aa19125d3114 None None] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:41:53.862134 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501a2333-0fa0-4b4b-847e-aa19125d3114 None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:41:53.862617 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501a2333-0fa0-4b4b-847e-aa19125d3114 None None] PATH_INFO: `/` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:41:53.864218 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 129/246] 10.222.0.15 () {54 vars in 927 bytes} [Sun Oct 9 00:41:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 09 00:41:53.870329 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a39fdd5-1599-40c7-8c05-7f6ae8d12a5a None None] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:41:53.870901 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a39fdd5-1599-40c7-8c05-7f6ae8d12a5a None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:41:53.871389 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a39fdd5-1599-40c7-8c05-7f6ae8d12a5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:41:53.896343 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.auth.core [None req-0a39fdd5-1599-40c7-8c05-7f6ae8d12a5a None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:41:53.897922 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-0a39fdd5-1599-40c7-8c05-7f6ae8d12a5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:41:53.914872 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:41:53.920688 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 118/247] 10.222.0.15 () {58 vars in 1282 bytes} [Sun Oct 9 00:41:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 468 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 09 00:41:53.926567 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34bb255-2602-4a13-a256-1edc80b4fcce None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:41:53.982410 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 130/248] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Oct 9 00:41:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 09 00:41:53.983679 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5e14d8-8814-4b15-9bef-de19891222c7 None None] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:41:53.985486 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5e14d8-8814-4b15-9bef-de19891222c7 None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:41:53.985764 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5e14d8-8814-4b15-9bef-de19891222c7 None None] PATH_INFO: `/` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:41:53.987110 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 131/249] 10.222.0.15 () {54 vars in 927 bytes} [Sun Oct 9 00:41:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:41:53.988901 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5e14d8-8814-4b15-9bef-de19891222c7 None None] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:41:54.045187 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:41:54.055850 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34bb255-2602-4a13-a256-1edc80b4fcce None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:41:54.100673 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7606829a-505f-4f18-a187-bcd3f41d6c14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:41:54.101688 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7606829a-505f-4f18-a187-bcd3f41d6c14 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:41:54.102151 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7606829a-505f-4f18-a187-bcd3f41d6c14 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:41:54.102628 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7606829a-505f-4f18-a187-bcd3f41d6c14 None admin] PATH_INFO: `/v3/projects/01e5c679ba5842a3830c8b9335e2cb07` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:41:54.104639 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7606829a-505f-4f18-a187-bcd3f41d6c14 None admin] RBAC: Authorizing `identity:get_project(project_id=01e5c679ba5842a3830c8b9335e2cb07)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:41:54.106762 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7606829a-505f-4f18-a187-bcd3f41d6c14 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:41:54.109188 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 119/250] 10.222.0.15 () {56 vars in 1186 bytes} [Sun Oct 9 00:41:53 2022] GET /identity/v3/projects/01e5c679ba5842a3830c8b9335e2cb07 => generated 302 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:41:54.110884 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9608ff0b-72bb-4b69-bb84-bf5aa7ad7c10 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:41:54.115232 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9608ff0b-72bb-4b69-bb84-bf5aa7ad7c10 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:41:54.116135 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9608ff0b-72bb-4b69-bb84-bf5aa7ad7c10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:41:54.123059 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5e14d8-8814-4b15-9bef-de19891222c7 None None] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:41:54.141040 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-9608ff0b-72bb-4b69-bb84-bf5aa7ad7c10 None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:41:54.142576 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-9608ff0b-72bb-4b69-bb84-bf5aa7ad7c10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:41:54.169717 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a626411-a0e2-4253-b40a-6ac2ededefbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:41:54.170479 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a626411-a0e2-4253-b40a-6ac2ededefbd None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:41:54.170759 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a626411-a0e2-4253-b40a-6ac2ededefbd None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:41:54.171030 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a626411-a0e2-4253-b40a-6ac2ededefbd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:41:54.187325 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a626411-a0e2-4253-b40a-6ac2ededefbd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 09 00:41:54.194097 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application [None req-3a626411-a0e2-4253-b40a-6ac2ededefbd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 09 00:41:54.194097 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:41:54.194097 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:41:54.194097 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:41:54.194097 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:41:54.194097 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:41:54.194097 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:41:54.194097 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:41:54.194097 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:41:54.194097 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:41:54.194097 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:41:54.194097 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:41:54.194097 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 09 00:41:54.194097 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 09 00:41:54.194097 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 09 00:41:54.194097 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 09 00:41:54.195071 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 09 00:41:54.195071 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 09 00:41:54.195071 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 09 00:41:54.195071 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 09 00:41:54.195071 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:41:54.195071 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:41:54.195071 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:41:54.195071 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:41:54.195071 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:41:54.195071 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:41:54.195071 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:41:54.195071 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application with Lock( Oct 09 00:41:54.195071 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:41:54.195071 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:41:54.195071 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:41:54.195071 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:41:54.195921 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:41:54.195921 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:41:54.195921 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:41:54.195921 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:41:54.195921 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 09 00:41:54.195921 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 09 00:41:54.195921 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 09 00:41:54.195921 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 09 00:41:54.195921 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 09 00:41:54.195921 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 09 00:41:54.195921 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 09 00:41:54.195921 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Oct 09 00:41:54.195921 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 132/251] 10.222.0.15 () {56 vars in 1096 bytes} [Sun Oct 9 00:41:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:41:54.197407 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a626411-a0e2-4253-b40a-6ac2ededefbd None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:41:54.256132 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 120/252] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Oct 9 00:41:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 09 00:41:54.256688 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:41:54.258909 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9608ff0b-72bb-4b69-bb84-bf5aa7ad7c10 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:41:54.391383 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:41:54.395143 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a626411-a0e2-4253-b40a-6ac2ededefbd None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:41:54.442004 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9608ff0b-72bb-4b69-bb84-bf5aa7ad7c10 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:41:54.467414 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ae4132-3d9c-4489-933b-fcaeb2bcb1e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:41:54.468041 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ae4132-3d9c-4489-933b-fcaeb2bcb1e8 None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:41:54.468317 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ae4132-3d9c-4489-933b-fcaeb2bcb1e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:41:54.468590 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ae4132-3d9c-4489-933b-fcaeb2bcb1e8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:41:54.469332 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ae4132-3d9c-4489-933b-fcaeb2bcb1e8 None admin] RBAC: Adding query filter params (role.id=9da5e6c99f594f149e3f29f97cf55e7e, scope.project.id=01e5c679ba5842a3830c8b9335e2cb07, user.id=29b54e97fdf740e8b36e0e6428db5047) {{(pid=81525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:41:54.469634 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ae4132-3d9c-4489-933b-fcaeb2bcb1e8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:41:54.471121 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ae4132-3d9c-4489-933b-fcaeb2bcb1e8 None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:41:54.481820 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 133/253] 10.222.0.15 () {56 vars in 1374 bytes} [Sun Oct 9 00:41:54 2022] GET /identity/v3/role_assignments?user.id=29b54e97fdf740e8b36e0e6428db5047&scope.project.id=01e5c679ba5842a3830c8b9335e2cb07&role.id=9da5e6c99f594f149e3f29f97cf55e7e => generated 259 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:41:54.482791 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ae4132-3d9c-4489-933b-fcaeb2bcb1e8 None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:41:54.526425 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4537c4b4-1358-401b-88c4-b5bc99a69641 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:41:54.527059 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4537c4b4-1358-401b-88c4-b5bc99a69641 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:41:54.527358 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4537c4b4-1358-401b-88c4-b5bc99a69641 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:41:54.527632 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4537c4b4-1358-401b-88c4-b5bc99a69641 None admin] PATH_INFO: `/v3/roles` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:41:54.528315 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4537c4b4-1358-401b-88c4-b5bc99a69641 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:41:54.528613 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4537c4b4-1358-401b-88c4-b5bc99a69641 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:41:54.530054 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4537c4b4-1358-401b-88c4-b5bc99a69641 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:41:54.542975 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 121/254] 10.222.0.15 () {56 vars in 1099 bytes} [Sun Oct 9 00:41:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:41:54.549289 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4537c4b4-1358-401b-88c4-b5bc99a69641 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:41:54.663738 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:41:54.719429 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ae4132-3d9c-4489-933b-fcaeb2bcb1e8 None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:41:54.724580 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4537c4b4-1358-401b-88c4-b5bc99a69641 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:41:54.760790 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd498db-b464-4eb5-a0f0-be19aa907435 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:41:54.761593 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd498db-b464-4eb5-a0f0-be19aa907435 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:41:54.761964 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd498db-b464-4eb5-a0f0-be19aa907435 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:41:54.762328 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd498db-b464-4eb5-a0f0-be19aa907435 None admin] PATH_INFO: `/v3/users/e6e20d4c68324c8080bd81996ada970d` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:41:54.763655 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd498db-b464-4eb5-a0f0-be19aa907435 None admin] RBAC: Authorizing `identity:get_user(user_id=e6e20d4c68324c8080bd81996ada970d)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:41:54.765215 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd498db-b464-4eb5-a0f0-be19aa907435 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:41:54.770429 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 122/255] 10.222.0.15 () {56 vars in 1177 bytes} [Sun Oct 9 00:41:54 2022] GET /identity/v3/users/e6e20d4c68324c8080bd81996ada970d => generated 283 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:41:54.770429 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd498db-b464-4eb5-a0f0-be19aa907435 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:41:54.789478 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afa7bd4-4dd5-4a8a-a751-0439adaa0bcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:41:54.789910 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afa7bd4-4dd5-4a8a-a751-0439adaa0bcb None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:41:54.790280 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afa7bd4-4dd5-4a8a-a751-0439adaa0bcb None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:41:54.790705 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afa7bd4-4dd5-4a8a-a751-0439adaa0bcb None admin] PATH_INFO: `/v3/roles/member` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:41:54.807742 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afa7bd4-4dd5-4a8a-a751-0439adaa0bcb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 09 00:41:54.815789 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application [None req-1afa7bd4-4dd5-4a8a-a751-0439adaa0bcb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 09 00:41:54.815789 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:41:54.815789 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:41:54.815789 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:41:54.815789 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:41:54.815789 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:41:54.815789 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:41:54.815789 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:41:54.815789 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:41:54.815789 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:41:54.815789 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:41:54.815789 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:41:54.815789 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 09 00:41:54.815789 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 09 00:41:54.815789 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 09 00:41:54.815789 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 09 00:41:54.816737 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 09 00:41:54.816737 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 09 00:41:54.816737 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 09 00:41:54.816737 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 09 00:41:54.816737 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:41:54.816737 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:41:54.816737 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:41:54.816737 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:41:54.816737 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:41:54.816737 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:41:54.816737 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:41:54.816737 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application with Lock( Oct 09 00:41:54.816737 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:41:54.816737 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:41:54.816737 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:41:54.816737 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:41:54.817523 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:41:54.817523 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:41:54.817523 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:41:54.817523 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:41:54.817523 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 09 00:41:54.817523 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 09 00:41:54.817523 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 09 00:41:54.817523 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 09 00:41:54.817523 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 09 00:41:54.817523 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 09 00:41:54.817523 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 09 00:41:54.817523 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Oct 09 00:41:54.820574 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 134/256] 10.222.0.15 () {56 vars in 1099 bytes} [Sun Oct 9 00:41:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 338 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:41:54.822103 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afa7bd4-4dd5-4a8a-a751-0439adaa0bcb None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:41:54.873327 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:41:54.953012 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd498db-b464-4eb5-a0f0-be19aa907435 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:41:54.982540 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:41:54.992698 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3910078a-6c84-49f0-96da-f6861a01445e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:41:54.999380 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3910078a-6c84-49f0-96da-f6861a01445e None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:41:54.999380 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3910078a-6c84-49f0-96da-f6861a01445e None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:41:54.999380 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3910078a-6c84-49f0-96da-f6861a01445e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:41:55.022813 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3910078a-6c84-49f0-96da-f6861a01445e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 09 00:41:55.029111 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application [None req-3910078a-6c84-49f0-96da-f6861a01445e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 09 00:41:55.029111 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:41:55.029111 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:41:55.029111 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:41:55.029111 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:41:55.029111 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:41:55.029111 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:41:55.029111 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:41:55.029111 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:41:55.029111 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:41:55.029111 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:41:55.029111 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:41:55.029111 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 09 00:41:55.029111 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 09 00:41:55.029111 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 09 00:41:55.029111 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 09 00:41:55.030167 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 09 00:41:55.030167 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 09 00:41:55.030167 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 09 00:41:55.030167 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 09 00:41:55.030167 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:41:55.030167 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:41:55.030167 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:41:55.030167 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:41:55.030167 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:41:55.030167 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:41:55.030167 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:41:55.030167 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application with Lock( Oct 09 00:41:55.030167 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:41:55.030167 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:41:55.030167 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:41:55.030167 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:41:55.031137 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:41:55.031137 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:41:55.031137 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:41:55.031137 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:41:55.031137 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 09 00:41:55.031137 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 09 00:41:55.031137 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 09 00:41:55.031137 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 09 00:41:55.031137 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 09 00:41:55.031137 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 09 00:41:55.031137 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 09 00:41:55.031137 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application Oct 09 00:41:55.036365 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 123/257] 10.222.0.15 () {56 vars in 1114 bytes} [Sun Oct 9 00:41:54 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:41:55.042430 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3910078a-6c84-49f0-96da-f6861a01445e None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:41:55.049046 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afa7bd4-4dd5-4a8a-a751-0439adaa0bcb None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:41:55.108713 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0863ea36-74db-41b3-95e9-88aa222a4cb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:41:55.109733 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0863ea36-74db-41b3-95e9-88aa222a4cb7 None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:41:55.110012 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0863ea36-74db-41b3-95e9-88aa222a4cb7 None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:41:55.110287 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0863ea36-74db-41b3-95e9-88aa222a4cb7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:41:55.222525 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0863ea36-74db-41b3-95e9-88aa222a4cb7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:41:55.223972 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0863ea36-74db-41b3-95e9-88aa222a4cb7 None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:41:55.224230 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3910078a-6c84-49f0-96da-f6861a01445e None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:41:55.260476 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca130907-5e0a-490e-857c-a53f1a43bd1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:41:55.261126 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca130907-5e0a-490e-857c-a53f1a43bd1b None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:41:55.261364 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca130907-5e0a-490e-857c-a53f1a43bd1b None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:41:55.261639 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca130907-5e0a-490e-857c-a53f1a43bd1b None admin] PATH_INFO: `/v3/roles` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:41:55.262479 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca130907-5e0a-490e-857c-a53f1a43bd1b None admin] RBAC: Adding query filter params (name=member) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:41:55.262718 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca130907-5e0a-490e-857c-a53f1a43bd1b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:41:55.266138 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca130907-5e0a-490e-857c-a53f1a43bd1b None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:41:55.268840 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:41:55.286214 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 124/258] 10.222.0.15 () {56 vars in 1101 bytes} [Sun Oct 9 00:41:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:41:55.287381 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca130907-5e0a-490e-857c-a53f1a43bd1b None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:41:55.381491 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:41:55.406489 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 135/259] 10.222.0.15 () {58 vars in 1282 bytes} [Sun Oct 9 00:41:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 585 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 09 00:41:55.408142 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0863ea36-74db-41b3-95e9-88aa222a4cb7 None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:41:55.516442 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca130907-5e0a-490e-857c-a53f1a43bd1b None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:41:55.525809 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0863ea36-74db-41b3-95e9-88aa222a4cb7 None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:41:55.553687 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:41:55.575725 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ee67d4-78c3-4477-bfcb-e6b3266cd9b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:41:55.576378 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ee67d4-78c3-4477-bfcb-e6b3266cd9b6 None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:41:55.578891 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ee67d4-78c3-4477-bfcb-e6b3266cd9b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:41:55.579226 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ee67d4-78c3-4477-bfcb-e6b3266cd9b6 None admin] PATH_INFO: `/v3/users/ac9b23b1c3f94770a4f872f6167ee3b0` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:41:55.581423 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ee67d4-78c3-4477-bfcb-e6b3266cd9b6 None admin] RBAC: Authorizing `identity:get_user(user_id=ac9b23b1c3f94770a4f872f6167ee3b0)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:41:55.582915 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ee67d4-78c3-4477-bfcb-e6b3266cd9b6 None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:41:55.584559 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 136/260] 10.222.0.15 () {56 vars in 1177 bytes} [Sun Oct 9 00:41:55 2022] GET /identity/v3/users/ac9b23b1c3f94770a4f872f6167ee3b0 => generated 297 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:41:55.585346 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ee67d4-78c3-4477-bfcb-e6b3266cd9b6 None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:41:55.599375 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8644f0-b2f3-41c2-8108-892cf7d923fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:41:55.600061 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8644f0-b2f3-41c2-8108-892cf7d923fc None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:41:55.600342 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8644f0-b2f3-41c2-8108-892cf7d923fc None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:41:55.600609 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8644f0-b2f3-41c2-8108-892cf7d923fc None admin] PATH_INFO: `/v3/roles` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:41:55.601292 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8644f0-b2f3-41c2-8108-892cf7d923fc None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:41:55.602817 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8644f0-b2f3-41c2-8108-892cf7d923fc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:41:55.604331 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8644f0-b2f3-41c2-8108-892cf7d923fc None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:41:55.623714 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 125/261] 10.222.0.15 () {56 vars in 1111 bytes} [Sun Oct 9 00:41:55 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 337 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:41:55.625007 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8644f0-b2f3-41c2-8108-892cf7d923fc None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:41:55.753264 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8644f0-b2f3-41c2-8108-892cf7d923fc None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:41:55.774135 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ee67d4-78c3-4477-bfcb-e6b3266cd9b6 None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:41:55.794122 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:41:55.827749 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2432daae-2d03-4830-838b-c6c428a417bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:41:55.830030 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2432daae-2d03-4830-838b-c6c428a417bc None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:41:55.830500 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2432daae-2d03-4830-838b-c6c428a417bc None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:41:55.832071 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2432daae-2d03-4830-838b-c6c428a417bc None admin] PATH_INFO: `/v3/projects/01e5c679ba5842a3830c8b9335e2cb07` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:41:55.834169 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2432daae-2d03-4830-838b-c6c428a417bc None admin] RBAC: Authorizing `identity:get_project(project_id=01e5c679ba5842a3830c8b9335e2cb07)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:41:55.837962 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2432daae-2d03-4830-838b-c6c428a417bc None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:41:55.841317 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 126/262] 10.222.0.15 () {56 vars in 1186 bytes} [Sun Oct 9 00:41:55 2022] GET /identity/v3/projects/01e5c679ba5842a3830c8b9335e2cb07 => generated 302 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:41:55.842858 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2432daae-2d03-4830-838b-c6c428a417bc None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:41:55.847939 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff75b8b-76a6-4030-855a-1002ad8d77b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:41:55.849920 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff75b8b-76a6-4030-855a-1002ad8d77b6 None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:41:55.850387 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff75b8b-76a6-4030-855a-1002ad8d77b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:41:55.852581 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff75b8b-76a6-4030-855a-1002ad8d77b6 None admin] PATH_INFO: `/v3/projects/01e5c679ba5842a3830c8b9335e2cb07` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:41:55.856766 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff75b8b-76a6-4030-855a-1002ad8d77b6 None admin] RBAC: Authorizing `identity:get_project(project_id=01e5c679ba5842a3830c8b9335e2cb07)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:41:55.858478 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff75b8b-76a6-4030-855a-1002ad8d77b6 None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:41:55.862484 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 137/263] 10.222.0.15 () {56 vars in 1186 bytes} [Sun Oct 9 00:41:55 2022] GET /identity/v3/projects/01e5c679ba5842a3830c8b9335e2cb07 => generated 302 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:41:55.868926 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff75b8b-76a6-4030-855a-1002ad8d77b6 None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:41:55.986419 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2432daae-2d03-4830-838b-c6c428a417bc None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:41:55.996348 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:41:56.025383 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2eacf0-0b2a-4599-9fce-601481fca4c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:41:56.026012 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2eacf0-0b2a-4599-9fce-601481fca4c7 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:41:56.026285 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2eacf0-0b2a-4599-9fce-601481fca4c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:41:56.026552 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2eacf0-0b2a-4599-9fce-601481fca4c7 None admin] PATH_INFO: `/v3/users/e6e20d4c68324c8080bd81996ada970d` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:41:56.027763 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2eacf0-0b2a-4599-9fce-601481fca4c7 None admin] RBAC: Authorizing `identity:get_user(user_id=e6e20d4c68324c8080bd81996ada970d)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:41:56.029238 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2eacf0-0b2a-4599-9fce-601481fca4c7 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:41:56.031381 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 127/264] 10.222.0.15 () {56 vars in 1177 bytes} [Sun Oct 9 00:41:55 2022] GET /identity/v3/users/e6e20d4c68324c8080bd81996ada970d => generated 283 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:41:56.032011 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2eacf0-0b2a-4599-9fce-601481fca4c7 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:41:56.077852 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff75b8b-76a6-4030-855a-1002ad8d77b6 None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:41:56.117123 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:41:56.124693 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e4ed5e-9a3a-4ff7-96a7-4363771d104c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:41:56.125391 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e4ed5e-9a3a-4ff7-96a7-4363771d104c None admin] REQUEST_METHOD: `PUT` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:41:56.125669 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e4ed5e-9a3a-4ff7-96a7-4363771d104c None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:41:56.125942 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e4ed5e-9a3a-4ff7-96a7-4363771d104c None admin] PATH_INFO: `/v3/projects/01e5c679ba5842a3830c8b9335e2cb07/users/ac9b23b1c3f94770a4f872f6167ee3b0/roles/afb0a01183d9497795eaa4fa1a4046ae` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:41:56.128151 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e4ed5e-9a3a-4ff7-96a7-4363771d104c None admin] RBAC: Authorizing `identity:create_grant(project_id=01e5c679ba5842a3830c8b9335e2cb07, user_id=ac9b23b1c3f94770a4f872f6167ee3b0, role_id=afb0a01183d9497795eaa4fa1a4046ae)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:41:56.130033 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e4ed5e-9a3a-4ff7-96a7-4363771d104c None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:41:56.149680 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 138/265] 10.222.0.15 () {58 vars in 1439 bytes} [Sun Oct 9 00:41:55 2022] PUT /identity/v3/projects/01e5c679ba5842a3830c8b9335e2cb07/users/ac9b23b1c3f94770a4f872f6167ee3b0/roles/afb0a01183d9497795eaa4fa1a4046ae => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 00:41:56.151587 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e4ed5e-9a3a-4ff7-96a7-4363771d104c None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:41:56.237091 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2eacf0-0b2a-4599-9fce-601481fca4c7 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:41:56.279702 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e4ed5e-9a3a-4ff7-96a7-4363771d104c None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:41:56.304893 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:41:56.307926 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cca032-9fda-4c1b-b1ba-ee19dc92cdee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:41:56.308569 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cca032-9fda-4c1b-b1ba-ee19dc92cdee None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:41:56.308814 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cca032-9fda-4c1b-b1ba-ee19dc92cdee None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:41:56.309080 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cca032-9fda-4c1b-b1ba-ee19dc92cdee None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:41:56.309823 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cca032-9fda-4c1b-b1ba-ee19dc92cdee None admin] RBAC: Adding query filter params (role.id=f69dddf26daf4dd79d4c962beb877af5, scope.project.id=01e5c679ba5842a3830c8b9335e2cb07, user.id=e6e20d4c68324c8080bd81996ada970d) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:41:56.310124 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cca032-9fda-4c1b-b1ba-ee19dc92cdee None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:41:56.311607 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cca032-9fda-4c1b-b1ba-ee19dc92cdee None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:41:56.320861 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6074666-b0b5-4390-a844-7bb1d46cc04b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:41:56.322329 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6074666-b0b5-4390-a844-7bb1d46cc04b None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:41:56.322651 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6074666-b0b5-4390-a844-7bb1d46cc04b None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:41:56.322925 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6074666-b0b5-4390-a844-7bb1d46cc04b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:41:56.331587 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 128/266] 10.222.0.15 () {56 vars in 1374 bytes} [Sun Oct 9 00:41:56 2022] GET /identity/v3/role_assignments?user.id=e6e20d4c68324c8080bd81996ada970d&scope.project.id=01e5c679ba5842a3830c8b9335e2cb07&role.id=f69dddf26daf4dd79d4c962beb877af5 => generated 608 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:41:56.332886 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fed212-cb2d-4ef8-a4e3-479b418fb50b None None] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:41:56.333162 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fed212-cb2d-4ef8-a4e3-479b418fb50b None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:41:56.333430 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fed212-cb2d-4ef8-a4e3-479b418fb50b None None] PATH_INFO: `/` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:41:56.335011 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 129/267] 10.222.0.15 () {54 vars in 927 bytes} [Sun Oct 9 00:41:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:41:56.341597 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873e3670-9c0e-4d3f-aaca-db9adc78268a None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:41:56.341897 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873e3670-9c0e-4d3f-aaca-db9adc78268a None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:41:56.342129 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873e3670-9c0e-4d3f-aaca-db9adc78268a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:41:56.380523 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-873e3670-9c0e-4d3f-aaca-db9adc78268a None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:41:56.381828 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-873e3670-9c0e-4d3f-aaca-db9adc78268a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:41:56.411573 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6074666-b0b5-4390-a844-7bb1d46cc04b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:41:56.413324 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6074666-b0b5-4390-a844-7bb1d46cc04b None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:41:56.558846 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 139/268] 10.222.0.15 () {58 vars in 1282 bytes} [Sun Oct 9 00:41:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 09 00:41:56.565525 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6074666-b0b5-4390-a844-7bb1d46cc04b None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:41:56.587246 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 130/269] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Oct 9 00:41:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 09 00:41:56.590317 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:41:56.682981 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6074666-b0b5-4390-a844-7bb1d46cc04b None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:41:56.719671 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661a5b38-5156-49e1-b6f8-77b068cfa495 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:41:56.720319 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661a5b38-5156-49e1-b6f8-77b068cfa495 None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:41:56.720592 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661a5b38-5156-49e1-b6f8-77b068cfa495 None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:41:56.720858 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661a5b38-5156-49e1-b6f8-77b068cfa495 None admin] PATH_INFO: `/v3/projects/01e5c679ba5842a3830c8b9335e2cb07` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:41:56.722015 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661a5b38-5156-49e1-b6f8-77b068cfa495 None admin] RBAC: Authorizing `identity:get_project(project_id=01e5c679ba5842a3830c8b9335e2cb07)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:41:56.723527 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661a5b38-5156-49e1-b6f8-77b068cfa495 None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:41:56.730405 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 140/270] 10.222.0.15 () {56 vars in 1186 bytes} [Sun Oct 9 00:41:56 2022] GET /identity/v3/projects/01e5c679ba5842a3830c8b9335e2cb07 => generated 302 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:41:56.732061 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873e3670-9c0e-4d3f-aaca-db9adc78268a None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:41:56.770262 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160b0df4-e560-4615-a9d1-2983c5bbd142 None None] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:41:56.770585 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160b0df4-e560-4615-a9d1-2983c5bbd142 None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:41:56.770878 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160b0df4-e560-4615-a9d1-2983c5bbd142 None None] PATH_INFO: `/` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:41:56.772674 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 141/271] 10.222.0.15 () {54 vars in 927 bytes} [Sun Oct 9 00:41:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 09 00:41:56.787343 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:41:56.787536 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8162994-0f18-49d8-ac2f-a1d25cea4fec None None] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:41:56.787536 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8162994-0f18-49d8-ac2f-a1d25cea4fec None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:41:56.787536 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8162994-0f18-49d8-ac2f-a1d25cea4fec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:41:56.809259 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.auth.core [None req-e8162994-0f18-49d8-ac2f-a1d25cea4fec None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:41:56.810563 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-e8162994-0f18-49d8-ac2f-a1d25cea4fec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:41:56.891902 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 142/272] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Oct 9 00:41:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 09 00:41:56.912982 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873e3670-9c0e-4d3f-aaca-db9adc78268a None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:41:56.923116 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8162994-0f18-49d8-ac2f-a1d25cea4fec None None] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:41:56.958616 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:41:56.996183 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e015b3bc-2df8-4d99-a48b-340cf50b51bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:41:56.996823 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e015b3bc-2df8-4d99-a48b-340cf50b51bc None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:41:56.997095 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e015b3bc-2df8-4d99-a48b-340cf50b51bc None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:41:56.997363 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e015b3bc-2df8-4d99-a48b-340cf50b51bc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:41:56.998119 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e015b3bc-2df8-4d99-a48b-340cf50b51bc None admin] RBAC: Adding query filter params (role.id=93f141c2a808407dae6f9704941d0cb2, scope.project.id=01e5c679ba5842a3830c8b9335e2cb07, user.id=e6e20d4c68324c8080bd81996ada970d) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:41:56.998423 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e015b3bc-2df8-4d99-a48b-340cf50b51bc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:41:57.000338 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e015b3bc-2df8-4d99-a48b-340cf50b51bc None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:41:57.018186 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 131/273] 10.222.0.15 () {56 vars in 1374 bytes} [Sun Oct 9 00:41:56 2022] GET /identity/v3/role_assignments?user.id=e6e20d4c68324c8080bd81996ada970d&scope.project.id=01e5c679ba5842a3830c8b9335e2cb07&role.id=93f141c2a808407dae6f9704941d0cb2 => generated 608 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:41:57.088593 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8162994-0f18-49d8-ac2f-a1d25cea4fec None None] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:41:57.138838 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70e94ea-5c26-4028-845f-23c00dfdb928 None None] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:41:57.139332 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70e94ea-5c26-4028-845f-23c00dfdb928 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:41:57.139546 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70e94ea-5c26-4028-845f-23c00dfdb928 None None] PATH_INFO: `/` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:41:57.139954 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950bb67e-3d27-4285-a035-21d5da6bf271 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:41:57.140637 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950bb67e-3d27-4285-a035-21d5da6bf271 None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:41:57.140914 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950bb67e-3d27-4285-a035-21d5da6bf271 None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:41:57.141029 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 132/274] 10.222.0.15 () {54 vars in 927 bytes} [Sun Oct 9 00:41:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:41:57.141181 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950bb67e-3d27-4285-a035-21d5da6bf271 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:41:57.148819 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9774d3-b206-4f78-90ec-97574ce813e5 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:41:57.149139 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9774d3-b206-4f78-90ec-97574ce813e5 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:41:57.149342 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9774d3-b206-4f78-90ec-97574ce813e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:41:57.157594 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950bb67e-3d27-4285-a035-21d5da6bf271 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 09 00:41:57.162829 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application [None req-950bb67e-3d27-4285-a035-21d5da6bf271 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 09 00:41:57.162829 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:41:57.162829 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:41:57.162829 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:41:57.162829 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:41:57.162829 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:41:57.162829 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:41:57.162829 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:41:57.162829 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:41:57.162829 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:41:57.162829 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:41:57.162829 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:41:57.162829 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 09 00:41:57.162829 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 09 00:41:57.162829 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 09 00:41:57.162829 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 09 00:41:57.163845 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 09 00:41:57.163845 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 09 00:41:57.163845 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 09 00:41:57.163845 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 09 00:41:57.163845 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:41:57.163845 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:41:57.163845 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:41:57.163845 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:41:57.163845 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:41:57.163845 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:41:57.163845 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:41:57.163845 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application with Lock( Oct 09 00:41:57.163845 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:41:57.163845 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:41:57.163845 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:41:57.163845 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:41:57.164646 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:41:57.164646 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:41:57.164646 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:41:57.164646 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:41:57.164646 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 09 00:41:57.164646 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 09 00:41:57.164646 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 09 00:41:57.164646 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 09 00:41:57.164646 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 09 00:41:57.164646 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 09 00:41:57.164646 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 09 00:41:57.164646 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Oct 09 00:41:57.164646 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 143/275] 10.222.0.15 () {56 vars in 1099 bytes} [Sun Oct 9 00:41:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:41:57.173972 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950bb67e-3d27-4285-a035-21d5da6bf271 None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:41:57.196514 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-8f9774d3-b206-4f78-90ec-97574ce813e5 None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:41:57.198227 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-8f9774d3-b206-4f78-90ec-97574ce813e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:41:57.273410 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 133/276] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Oct 9 00:41:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 09 00:41:57.274809 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9774d3-b206-4f78-90ec-97574ce813e5 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:41:57.287061 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950bb67e-3d27-4285-a035-21d5da6bf271 None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:41:57.299723 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:41:57.315084 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:41:57.325583 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d080894f-5869-4d3c-a1eb-d7b16d88c702 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:41:57.326208 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d080894f-5869-4d3c-a1eb-d7b16d88c702 None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:41:57.326485 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d080894f-5869-4d3c-a1eb-d7b16d88c702 None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:41:57.326758 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d080894f-5869-4d3c-a1eb-d7b16d88c702 None admin] PATH_INFO: `/v3/roles` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:41:57.327469 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d080894f-5869-4d3c-a1eb-d7b16d88c702 None admin] RBAC: Adding query filter params (name=member) {{(pid=81525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:41:57.327775 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d080894f-5869-4d3c-a1eb-d7b16d88c702 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:41:57.329269 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d080894f-5869-4d3c-a1eb-d7b16d88c702 None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:41:57.339728 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 144/277] 10.222.0.15 () {56 vars in 1101 bytes} [Sun Oct 9 00:41:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:41:57.350118 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d080894f-5869-4d3c-a1eb-d7b16d88c702 None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:41:57.393453 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9774d3-b206-4f78-90ec-97574ce813e5 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:41:57.458709 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873a7237-a000-472d-a74e-d839d151ad00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:41:57.459856 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873a7237-a000-472d-a74e-d839d151ad00 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:41:57.460328 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873a7237-a000-472d-a74e-d839d151ad00 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:41:57.460808 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873a7237-a000-472d-a74e-d839d151ad00 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:41:57.462311 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873a7237-a000-472d-a74e-d839d151ad00 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:41:57.464316 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873a7237-a000-472d-a74e-d839d151ad00 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:41:57.466536 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 134/278] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Oct 9 00:41:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:41:57.473722 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873a7237-a000-472d-a74e-d839d151ad00 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:41:57.508244 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d080894f-5869-4d3c-a1eb-d7b16d88c702 None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:41:57.548539 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6257abec-a0dc-47ae-8cfd-e7a1a2ad5260 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:41:57.549299 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6257abec-a0dc-47ae-8cfd-e7a1a2ad5260 None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:41:57.549635 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6257abec-a0dc-47ae-8cfd-e7a1a2ad5260 None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:41:57.549971 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6257abec-a0dc-47ae-8cfd-e7a1a2ad5260 None admin] PATH_INFO: `/v3/users/0f41d4c99ab946d0934ee47fa23e1469` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:41:57.561447 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:41:57.565935 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6257abec-a0dc-47ae-8cfd-e7a1a2ad5260 None admin] RBAC: Authorizing `identity:get_user(user_id=0f41d4c99ab946d0934ee47fa23e1469)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:41:57.567745 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6257abec-a0dc-47ae-8cfd-e7a1a2ad5260 None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:41:57.569951 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 145/279] 10.222.0.15 () {56 vars in 1177 bytes} [Sun Oct 9 00:41:57 2022] GET /identity/v3/users/0f41d4c99ab946d0934ee47fa23e1469 => generated 293 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:41:57.575909 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6257abec-a0dc-47ae-8cfd-e7a1a2ad5260 None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:41:57.614000 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873a7237-a000-472d-a74e-d839d151ad00 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:41:57.618281 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:41:57.655092 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb2c948-72b7-4e0f-85da-10fa54ca34d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:41:57.656093 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb2c948-72b7-4e0f-85da-10fa54ca34d1 None admin] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:41:57.656366 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb2c948-72b7-4e0f-85da-10fa54ca34d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:41:57.656635 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb2c948-72b7-4e0f-85da-10fa54ca34d1 None admin] PATH_INFO: `/v3/users` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:41:57.657298 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb2c948-72b7-4e0f-85da-10fa54ca34d1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:41:57.658758 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb2c948-72b7-4e0f-85da-10fa54ca34d1 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:41:57.683914 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 135/280] 10.222.0.15 () {60 vars in 1132 bytes} [Sun Oct 9 00:41:57 2022] POST /identity/v3/users => generated 293 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 09 00:41:57.685028 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb2c948-72b7-4e0f-85da-10fa54ca34d1 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:41:57.704586 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6257abec-a0dc-47ae-8cfd-e7a1a2ad5260 None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:41:57.755395 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e116e5a2-8b41-412d-b8f8-ad835334477f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:41:57.757061 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e116e5a2-8b41-412d-b8f8-ad835334477f None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:41:57.757338 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e116e5a2-8b41-412d-b8f8-ad835334477f None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:41:57.757813 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e116e5a2-8b41-412d-b8f8-ad835334477f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:41:57.758563 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e116e5a2-8b41-412d-b8f8-ad835334477f None admin] RBAC: Adding query filter params (role.id=afb0a01183d9497795eaa4fa1a4046ae, user.id=0f41d4c99ab946d0934ee47fa23e1469, scope.system=all) {{(pid=81525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:41:57.758868 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e116e5a2-8b41-412d-b8f8-ad835334477f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:41:57.760457 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e116e5a2-8b41-412d-b8f8-ad835334477f None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:41:57.766213 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 146/281] 10.222.0.15 () {56 vars in 1308 bytes} [Sun Oct 9 00:41:57 2022] GET /identity/v3/role_assignments?user.id=0f41d4c99ab946d0934ee47fa23e1469&scope.system=all&role.id=afb0a01183d9497795eaa4fa1a4046ae => generated 226 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 09 00:41:57.819309 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb2c948-72b7-4e0f-85da-10fa54ca34d1 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:41:57.861549 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5d3cc8-bb93-424f-b173-45030b98b4c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:41:57.862527 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5d3cc8-bb93-424f-b173-45030b98b4c0 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:41:57.862985 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5d3cc8-bb93-424f-b173-45030b98b4c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:41:57.863487 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5d3cc8-bb93-424f-b173-45030b98b4c0 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:41:57.877557 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5d3cc8-bb93-424f-b173-45030b98b4c0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 09 00:41:57.883768 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application [None req-7e5d3cc8-bb93-424f-b173-45030b98b4c0 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 09 00:41:57.883768 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:41:57.883768 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:41:57.883768 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:41:57.883768 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:41:57.883768 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:41:57.883768 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:41:57.883768 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:41:57.883768 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:41:57.883768 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:41:57.883768 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:41:57.883768 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:41:57.883768 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 09 00:41:57.883768 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 09 00:41:57.883768 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 09 00:41:57.883768 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 09 00:41:57.884951 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 09 00:41:57.884951 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 09 00:41:57.884951 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 09 00:41:57.884951 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 09 00:41:57.884951 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:41:57.884951 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:41:57.884951 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:41:57.884951 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:41:57.884951 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:41:57.884951 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:41:57.884951 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:41:57.884951 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application with Lock( Oct 09 00:41:57.884951 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:41:57.884951 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:41:57.884951 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:41:57.884951 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:41:57.885927 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:41:57.885927 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:41:57.885927 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:41:57.885927 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:41:57.885927 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 09 00:41:57.885927 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 09 00:41:57.885927 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 09 00:41:57.885927 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 09 00:41:57.885927 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 09 00:41:57.885927 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 09 00:41:57.885927 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 09 00:41:57.885927 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application Oct 09 00:41:57.888084 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 136/282] 10.222.0.15 () {56 vars in 1099 bytes} [Sun Oct 9 00:41:57 2022] GET /identity/v3/roles/reader => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:41:57.894381 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e116e5a2-8b41-412d-b8f8-ad835334477f None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:41:57.976602 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:41:58.027545 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e116e5a2-8b41-412d-b8f8-ad835334477f None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:41:58.063206 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412cabf8-fcff-459d-9cbf-cb77f7b3a557 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:41:58.063875 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412cabf8-fcff-459d-9cbf-cb77f7b3a557 None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:41:58.064148 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412cabf8-fcff-459d-9cbf-cb77f7b3a557 None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:41:58.064414 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412cabf8-fcff-459d-9cbf-cb77f7b3a557 None admin] PATH_INFO: `/v3/roles` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:41:58.065090 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412cabf8-fcff-459d-9cbf-cb77f7b3a557 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:41:58.065388 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412cabf8-fcff-459d-9cbf-cb77f7b3a557 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:41:58.066780 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412cabf8-fcff-459d-9cbf-cb77f7b3a557 None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:41:58.076377 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 147/283] 10.222.0.15 () {56 vars in 1101 bytes} [Sun Oct 9 00:41:57 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:41:58.082297 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5d3cc8-bb93-424f-b173-45030b98b4c0 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:41:58.109597 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:41:58.206083 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5d3cc8-bb93-424f-b173-45030b98b4c0 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:41:58.240828 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4308f67-c0a8-4e06-a2ee-c83dcf996122 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:41:58.241476 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4308f67-c0a8-4e06-a2ee-c83dcf996122 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:41:58.241750 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4308f67-c0a8-4e06-a2ee-c83dcf996122 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:41:58.242019 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4308f67-c0a8-4e06-a2ee-c83dcf996122 None admin] PATH_INFO: `/v3/users/29b54e97fdf740e8b36e0e6428db5047` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:41:58.243162 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4308f67-c0a8-4e06-a2ee-c83dcf996122 None admin] RBAC: Authorizing `identity:get_user(user_id=29b54e97fdf740e8b36e0e6428db5047)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:41:58.244726 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4308f67-c0a8-4e06-a2ee-c83dcf996122 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:41:58.246396 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 137/284] 10.222.0.15 () {56 vars in 1177 bytes} [Sun Oct 9 00:41:58 2022] GET /identity/v3/users/29b54e97fdf740e8b36e0e6428db5047 => generated 297 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:41:58.252544 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412cabf8-fcff-459d-9cbf-cb77f7b3a557 None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:41:58.377456 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412cabf8-fcff-459d-9cbf-cb77f7b3a557 None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:41:58.411575 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:41:58.429341 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba4588d-2a11-453f-8e5e-f3e2f3046f4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:41:58.430068 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba4588d-2a11-453f-8e5e-f3e2f3046f4d None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:41:58.430346 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba4588d-2a11-453f-8e5e-f3e2f3046f4d None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:41:58.430622 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba4588d-2a11-453f-8e5e-f3e2f3046f4d None admin] PATH_INFO: `/v3/projects/01e5c679ba5842a3830c8b9335e2cb07` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:41:58.431878 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba4588d-2a11-453f-8e5e-f3e2f3046f4d None admin] RBAC: Authorizing `identity:get_project(project_id=01e5c679ba5842a3830c8b9335e2cb07)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:41:58.433378 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba4588d-2a11-453f-8e5e-f3e2f3046f4d None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:41:58.435041 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 148/285] 10.222.0.15 () {56 vars in 1186 bytes} [Sun Oct 9 00:41:58 2022] GET /identity/v3/projects/01e5c679ba5842a3830c8b9335e2cb07 => generated 302 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 09 00:41:58.441561 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4308f67-c0a8-4e06-a2ee-c83dcf996122 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:41:58.593646 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:41:58.610719 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4308f67-c0a8-4e06-a2ee-c83dcf996122 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:41:58.665439 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d228556d-c37f-4dc8-86f7-456303d77e3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:41:58.666559 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d228556d-c37f-4dc8-86f7-456303d77e3b None admin] REQUEST_METHOD: `PUT` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:41:58.667050 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d228556d-c37f-4dc8-86f7-456303d77e3b None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:41:58.667534 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d228556d-c37f-4dc8-86f7-456303d77e3b None admin] PATH_INFO: `/v3/projects/01e5c679ba5842a3830c8b9335e2cb07/users/29b54e97fdf740e8b36e0e6428db5047/roles/9da5e6c99f594f149e3f29f97cf55e7e` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:41:58.669739 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d228556d-c37f-4dc8-86f7-456303d77e3b None admin] RBAC: Authorizing `identity:create_grant(project_id=01e5c679ba5842a3830c8b9335e2cb07, user_id=29b54e97fdf740e8b36e0e6428db5047, role_id=9da5e6c99f594f149e3f29f97cf55e7e)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:41:58.671451 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d228556d-c37f-4dc8-86f7-456303d77e3b None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:41:58.702212 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 138/286] 10.222.0.15 () {58 vars in 1439 bytes} [Sun Oct 9 00:41:58 2022] PUT /identity/v3/projects/01e5c679ba5842a3830c8b9335e2cb07/users/29b54e97fdf740e8b36e0e6428db5047/roles/9da5e6c99f594f149e3f29f97cf55e7e => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 00:41:59.064146 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1738a7e9-56d1-476f-8d6f-3118ca32a55e None None] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:41:59.064668 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1738a7e9-56d1-476f-8d6f-3118ca32a55e None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:41:59.064771 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1738a7e9-56d1-476f-8d6f-3118ca32a55e None None] PATH_INFO: `/` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:41:59.066443 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 149/287] 10.222.0.15 () {54 vars in 927 bytes} [Sun Oct 9 00:41:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:41:59.072194 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ce7e51-75f8-434b-8e00-71d6434b49ca None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:41:59.072624 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ce7e51-75f8-434b-8e00-71d6434b49ca None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:41:59.072821 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ce7e51-75f8-434b-8e00-71d6434b49ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:41:59.097414 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-54ce7e51-75f8-434b-8e00-71d6434b49ca None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:41:59.098633 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-54ce7e51-75f8-434b-8e00-71d6434b49ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:41:59.197651 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 139/288] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Oct 9 00:41:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 09 00:41:59.602504 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1738a7e9-56d1-476f-8d6f-3118ca32a55e None None] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:41:59.724090 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1738a7e9-56d1-476f-8d6f-3118ca32a55e None None] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:41:59.766393 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e437d29-4e2a-425c-a1a5-edcfd73c9e09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:41:59.767049 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e437d29-4e2a-425c-a1a5-edcfd73c9e09 None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:41:59.767350 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e437d29-4e2a-425c-a1a5-edcfd73c9e09 None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:41:59.767613 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e437d29-4e2a-425c-a1a5-edcfd73c9e09 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:41:59.784733 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e437d29-4e2a-425c-a1a5-edcfd73c9e09 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 09 00:41:59.789726 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application [None req-7e437d29-4e2a-425c-a1a5-edcfd73c9e09 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 09 00:41:59.789726 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:41:59.789726 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:41:59.789726 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:41:59.789726 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:41:59.789726 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:41:59.789726 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:41:59.789726 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:41:59.789726 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:41:59.789726 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:41:59.789726 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:41:59.789726 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:41:59.789726 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 09 00:41:59.789726 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 09 00:41:59.789726 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 09 00:41:59.789726 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 09 00:41:59.790606 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 09 00:41:59.790606 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 09 00:41:59.790606 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 09 00:41:59.790606 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 09 00:41:59.790606 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:41:59.790606 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:41:59.790606 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:41:59.790606 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:41:59.790606 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:41:59.790606 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:41:59.790606 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:41:59.790606 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application with Lock( Oct 09 00:41:59.790606 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:41:59.790606 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:41:59.790606 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:41:59.790606 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:41:59.791454 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:41:59.791454 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:41:59.791454 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:41:59.791454 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:41:59.791454 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 09 00:41:59.791454 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 09 00:41:59.791454 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 09 00:41:59.791454 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 09 00:41:59.791454 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 09 00:41:59.791454 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 09 00:41:59.791454 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 09 00:41:59.791454 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Oct 09 00:41:59.791454 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 150/289] 10.222.0.15 () {56 vars in 1099 bytes} [Sun Oct 9 00:41:59 2022] GET /identity/v3/roles/member => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:41:59.798492 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ce7e51-75f8-434b-8e00-71d6434b49ca None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:41:59.911040 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:41:59.946827 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ce7e51-75f8-434b-8e00-71d6434b49ca None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:41:59.987879 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795be99f-ab31-4f20-8596-0da637f89dde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:41:59.988415 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795be99f-ab31-4f20-8596-0da637f89dde None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:41:59.988690 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795be99f-ab31-4f20-8596-0da637f89dde None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:41:59.988962 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795be99f-ab31-4f20-8596-0da637f89dde None admin] PATH_INFO: `/v3/roles` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:41:59.989641 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795be99f-ab31-4f20-8596-0da637f89dde None admin] RBAC: Adding query filter params (name=member) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:41:59.989943 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795be99f-ab31-4f20-8596-0da637f89dde None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:41:59.991351 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795be99f-ab31-4f20-8596-0da637f89dde None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:00.000404 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 140/290] 10.222.0.15 () {56 vars in 1101 bytes} [Sun Oct 9 00:41:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:42:00.006325 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e437d29-4e2a-425c-a1a5-edcfd73c9e09 None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:00.075849 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:00.142487 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e437d29-4e2a-425c-a1a5-edcfd73c9e09 None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:00.194482 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a026bff7-c3c1-4771-8ba5-e13c090d2481 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:00.195129 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a026bff7-c3c1-4771-8ba5-e13c090d2481 None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:00.195433 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a026bff7-c3c1-4771-8ba5-e13c090d2481 None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:00.195708 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a026bff7-c3c1-4771-8ba5-e13c090d2481 None admin] PATH_INFO: `/v3/users/ac9b23b1c3f94770a4f872f6167ee3b0` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:00.196862 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a026bff7-c3c1-4771-8ba5-e13c090d2481 None admin] RBAC: Authorizing `identity:get_user(user_id=ac9b23b1c3f94770a4f872f6167ee3b0)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:00.198437 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a026bff7-c3c1-4771-8ba5-e13c090d2481 None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:00.200084 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 151/291] 10.222.0.15 () {56 vars in 1177 bytes} [Sun Oct 9 00:42:00 2022] GET /identity/v3/users/ac9b23b1c3f94770a4f872f6167ee3b0 => generated 297 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:42:00.205827 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795be99f-ab31-4f20-8596-0da637f89dde None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:00.321239 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795be99f-ab31-4f20-8596-0da637f89dde None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:00.356545 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa28d91f-1143-40a6-9734-1b375247e9f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:00.357179 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa28d91f-1143-40a6-9734-1b375247e9f2 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:00.357457 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa28d91f-1143-40a6-9734-1b375247e9f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:00.357731 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa28d91f-1143-40a6-9734-1b375247e9f2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:00.371632 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:00.401256 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c676ba2-17fc-460b-b389-c9b9436e3227 None None] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:00.401575 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c676ba2-17fc-460b-b389-c9b9436e3227 None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:00.401792 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c676ba2-17fc-460b-b389-c9b9436e3227 None None] PATH_INFO: `/` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:00.403140 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 152/292] 10.222.0.15 () {54 vars in 927 bytes} [Sun Oct 9 00:42:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:42:00.408484 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afd6206-a35c-43a5-8987-8cbfd414f0f2 None None] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:00.408760 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afd6206-a35c-43a5-8987-8cbfd414f0f2 None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:00.409094 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afd6206-a35c-43a5-8987-8cbfd414f0f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:00.443031 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.auth.core [None req-8afd6206-a35c-43a5-8987-8cbfd414f0f2 None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:42:00.444297 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-8afd6206-a35c-43a5-8987-8cbfd414f0f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:42:00.472803 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa28d91f-1143-40a6-9734-1b375247e9f2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:00.474295 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa28d91f-1143-40a6-9734-1b375247e9f2 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:00.588097 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 153/293] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Oct 9 00:42:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 09 00:42:00.635371 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 141/294] 10.222.0.15 () {58 vars in 1282 bytes} [Sun Oct 9 00:42:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 09 00:42:00.641406 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afd6206-a35c-43a5-8987-8cbfd414f0f2 None None] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:00.717341 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b1eef0-c9e0-48d4-8274-cc5b4330ae62 None None] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:00.717859 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b1eef0-c9e0-48d4-8274-cc5b4330ae62 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:00.718416 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b1eef0-c9e0-48d4-8274-cc5b4330ae62 None None] PATH_INFO: `/` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:00.720291 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 142/295] 10.222.0.15 () {54 vars in 927 bytes} [Sun Oct 9 00:42:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:42:00.729851 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:00.731657 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189b42f0-c362-4b5f-8a46-22b6a995f047 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:00.732241 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189b42f0-c362-4b5f-8a46-22b6a995f047 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:00.732678 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189b42f0-c362-4b5f-8a46-22b6a995f047 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:00.761917 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-189b42f0-c362-4b5f-8a46-22b6a995f047 None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:42:00.763523 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-189b42f0-c362-4b5f-8a46-22b6a995f047 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:42:00.784739 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afd6206-a35c-43a5-8987-8cbfd414f0f2 None None] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:00.820442 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:00.828617 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ad5f32-0569-4882-b96a-2156deeedd99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:00.829536 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ad5f32-0569-4882-b96a-2156deeedd99 None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:00.829977 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ad5f32-0569-4882-b96a-2156deeedd99 None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:00.830821 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ad5f32-0569-4882-b96a-2156deeedd99 None admin] PATH_INFO: `/v3/projects/01e5c679ba5842a3830c8b9335e2cb07` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:00.832638 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ad5f32-0569-4882-b96a-2156deeedd99 None admin] RBAC: Authorizing `identity:get_project(project_id=01e5c679ba5842a3830c8b9335e2cb07)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:00.834749 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ad5f32-0569-4882-b96a-2156deeedd99 None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:00.837642 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 154/296] 10.222.0.15 () {56 vars in 1186 bytes} [Sun Oct 9 00:42:00 2022] GET /identity/v3/projects/01e5c679ba5842a3830c8b9335e2cb07 => generated 302 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:42:00.840043 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9ef07f-7162-4a19-92c9-5df70ce135a2 None None] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:00.840521 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9ef07f-7162-4a19-92c9-5df70ce135a2 None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:00.840979 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9ef07f-7162-4a19-92c9-5df70ce135a2 None None] PATH_INFO: `/` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:00.843844 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 155/297] 10.222.0.15 () {54 vars in 927 bytes} [Sun Oct 9 00:42:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:42:00.845845 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9ef07f-7162-4a19-92c9-5df70ce135a2 None None] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:00.862020 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 143/298] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Oct 9 00:42:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 09 00:42:00.863861 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b54c19-4ae3-43df-8fad-e2cb42db8045 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:00.864346 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b54c19-4ae3-43df-8fad-e2cb42db8045 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:00.864838 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b54c19-4ae3-43df-8fad-e2cb42db8045 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:00.893045 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-19b54c19-4ae3-43df-8fad-e2cb42db8045 None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:42:00.895746 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-19b54c19-4ae3-43df-8fad-e2cb42db8045 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:42:00.988928 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 144/299] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Oct 9 00:42:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 09 00:42:00.990030 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b54c19-4ae3-43df-8fad-e2cb42db8045 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:01.060027 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9ef07f-7162-4a19-92c9-5df70ce135a2 None None] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:01.100614 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:01.131885 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46b22cf-406e-4015-a01f-fbc33a576418 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:01.132506 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46b22cf-406e-4015-a01f-fbc33a576418 None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:01.132781 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46b22cf-406e-4015-a01f-fbc33a576418 None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:01.133054 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46b22cf-406e-4015-a01f-fbc33a576418 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:01.134530 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46b22cf-406e-4015-a01f-fbc33a576418 None admin] RBAC: Adding query filter params (role.id=afb0a01183d9497795eaa4fa1a4046ae, scope.project.id=01e5c679ba5842a3830c8b9335e2cb07, user.id=ac9b23b1c3f94770a4f872f6167ee3b0) {{(pid=81525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:42:01.134931 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46b22cf-406e-4015-a01f-fbc33a576418 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:01.136472 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46b22cf-406e-4015-a01f-fbc33a576418 None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:01.152237 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 156/300] 10.222.0.15 () {56 vars in 1374 bytes} [Sun Oct 9 00:42:00 2022] GET /identity/v3/role_assignments?user.id=ac9b23b1c3f94770a4f872f6167ee3b0&scope.project.id=01e5c679ba5842a3830c8b9335e2cb07&role.id=afb0a01183d9497795eaa4fa1a4046ae => generated 608 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:42:01.153476 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46b22cf-406e-4015-a01f-fbc33a576418 None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:01.160557 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:01.163760 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b54c19-4ae3-43df-8fad-e2cb42db8045 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:01.205243 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3d20c5-c0ce-441f-be3c-ce8d590c5bf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:01.206352 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3d20c5-c0ce-441f-be3c-ce8d590c5bf2 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:01.206857 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3d20c5-c0ce-441f-be3c-ce8d590c5bf2 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:01.207388 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3d20c5-c0ce-441f-be3c-ce8d590c5bf2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:01.220742 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3d20c5-c0ce-441f-be3c-ce8d590c5bf2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 09 00:42:01.226270 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application [None req-2a3d20c5-c0ce-441f-be3c-ce8d590c5bf2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 09 00:42:01.226270 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:42:01.226270 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:42:01.226270 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:42:01.226270 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:42:01.226270 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:42:01.226270 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:42:01.226270 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:42:01.226270 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:42:01.226270 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:42:01.226270 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:42:01.226270 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:42:01.226270 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 09 00:42:01.226270 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 09 00:42:01.226270 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 09 00:42:01.226270 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 09 00:42:01.227311 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 09 00:42:01.227311 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 09 00:42:01.227311 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 09 00:42:01.227311 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 09 00:42:01.227311 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:42:01.227311 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:42:01.227311 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:42:01.227311 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:42:01.227311 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:42:01.227311 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:42:01.227311 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:42:01.227311 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application with Lock( Oct 09 00:42:01.227311 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:42:01.227311 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:42:01.227311 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:42:01.227311 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:42:01.228102 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:42:01.228102 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:42:01.228102 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:42:01.228102 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:42:01.228102 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 09 00:42:01.228102 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 09 00:42:01.228102 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 09 00:42:01.228102 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 09 00:42:01.228102 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 09 00:42:01.228102 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 09 00:42:01.228102 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 09 00:42:01.228102 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application Oct 09 00:42:01.230765 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 145/301] 10.222.0.15 () {56 vars in 1099 bytes} [Sun Oct 9 00:42:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:42:01.242427 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3d20c5-c0ce-441f-be3c-ce8d590c5bf2 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:01.334886 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46b22cf-406e-4015-a01f-fbc33a576418 None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:01.381043 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99904170-5efb-4ae9-a981-f60f8a16a5df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:01.382250 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99904170-5efb-4ae9-a981-f60f8a16a5df None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:01.382531 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99904170-5efb-4ae9-a981-f60f8a16a5df None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:01.382786 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99904170-5efb-4ae9-a981-f60f8a16a5df None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:01.398468 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99904170-5efb-4ae9-a981-f60f8a16a5df None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 09 00:42:01.406084 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application [None req-99904170-5efb-4ae9-a981-f60f8a16a5df None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 09 00:42:01.406084 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:42:01.406084 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:42:01.406084 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:42:01.406084 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:42:01.406084 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:42:01.406084 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:42:01.406084 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:42:01.406084 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:42:01.406084 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:42:01.406084 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:42:01.406084 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:42:01.406084 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 09 00:42:01.406084 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 09 00:42:01.406084 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 09 00:42:01.406084 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 09 00:42:01.407041 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 09 00:42:01.407041 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 09 00:42:01.407041 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 09 00:42:01.407041 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 09 00:42:01.407041 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:42:01.407041 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:42:01.407041 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:42:01.407041 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:42:01.407041 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:42:01.407041 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:42:01.407041 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:42:01.407041 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application with Lock( Oct 09 00:42:01.407041 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:42:01.407041 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:42:01.407041 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:42:01.407041 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:42:01.407866 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:42:01.407866 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:42:01.407866 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:42:01.407866 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:42:01.407866 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 09 00:42:01.407866 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 09 00:42:01.407866 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 09 00:42:01.407866 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 09 00:42:01.407866 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 09 00:42:01.407866 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 09 00:42:01.407866 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 09 00:42:01.407866 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Oct 09 00:42:01.409692 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 157/302] 10.222.0.15 () {56 vars in 1099 bytes} [Sun Oct 9 00:42:01 2022] GET /identity/v3/roles/reader => generated 84 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:42:01.409692 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99904170-5efb-4ae9-a981-f60f8a16a5df None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:01.412162 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3d20c5-c0ce-441f-be3c-ce8d590c5bf2 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:01.462788 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:01.464200 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3330ee-35d2-4ad9-bcd8-a272364f86e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:01.464773 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3330ee-35d2-4ad9-bcd8-a272364f86e6 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:01.464945 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3330ee-35d2-4ad9-bcd8-a272364f86e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:01.465678 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3330ee-35d2-4ad9-bcd8-a272364f86e6 None admin] PATH_INFO: `/v3/roles` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:01.466031 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3330ee-35d2-4ad9-bcd8-a272364f86e6 None admin] RBAC: Adding query filter params (name=member) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:42:01.466191 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3330ee-35d2-4ad9-bcd8-a272364f86e6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:01.471322 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3330ee-35d2-4ad9-bcd8-a272364f86e6 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:01.479371 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 146/303] 10.222.0.15 () {56 vars in 1101 bytes} [Sun Oct 9 00:42:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:42:01.480984 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ab2b1f-44ec-44d2-9619-b23c6b5dc7c9 None None] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:01.481443 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ab2b1f-44ec-44d2-9619-b23c6b5dc7c9 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:01.481879 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ab2b1f-44ec-44d2-9619-b23c6b5dc7c9 None None] PATH_INFO: `/` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:01.483678 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 147/304] 10.222.0.15 () {54 vars in 927 bytes} [Sun Oct 9 00:42:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:42:01.484887 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ab2b1f-44ec-44d2-9619-b23c6b5dc7c9 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:01.516831 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:01.537957 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99904170-5efb-4ae9-a981-f60f8a16a5df None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:01.571578 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46c9116-f65b-4529-bb87-2afd5be359a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:01.572214 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46c9116-f65b-4529-bb87-2afd5be359a2 None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:01.572558 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46c9116-f65b-4529-bb87-2afd5be359a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:01.572823 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46c9116-f65b-4529-bb87-2afd5be359a2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:01.573924 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46c9116-f65b-4529-bb87-2afd5be359a2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:01.575416 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46c9116-f65b-4529-bb87-2afd5be359a2 None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:01.576994 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 158/305] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Oct 9 00:42:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:42:01.578039 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46c9116-f65b-4529-bb87-2afd5be359a2 None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:01.599873 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ab2b1f-44ec-44d2-9619-b23c6b5dc7c9 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:01.633743 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65babc62-f3d6-4f38-b5c9-21b6bc3d9ed2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:01.634267 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65babc62-f3d6-4f38-b5c9-21b6bc3d9ed2 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:01.634568 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65babc62-f3d6-4f38-b5c9-21b6bc3d9ed2 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:01.634834 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65babc62-f3d6-4f38-b5c9-21b6bc3d9ed2 None admin] PATH_INFO: `/v3/roles` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:01.635528 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65babc62-f3d6-4f38-b5c9-21b6bc3d9ed2 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:42:01.635832 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65babc62-f3d6-4f38-b5c9-21b6bc3d9ed2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:01.637212 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65babc62-f3d6-4f38-b5c9-21b6bc3d9ed2 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:01.646887 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 148/306] 10.222.0.15 () {56 vars in 1101 bytes} [Sun Oct 9 00:42:01 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:42:01.648128 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ddc1e7-3a31-47e8-bb8e-59113ffb3719 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:01.648407 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ddc1e7-3a31-47e8-bb8e-59113ffb3719 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:01.648688 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ddc1e7-3a31-47e8-bb8e-59113ffb3719 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:01.667704 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-e5ddc1e7-3a31-47e8-bb8e-59113ffb3719 None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:42:01.668916 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-e5ddc1e7-3a31-47e8-bb8e-59113ffb3719 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:42:01.691580 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46c9116-f65b-4529-bb87-2afd5be359a2 None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:01.704142 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:01.729811 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5560d80-6b61-4108-a260-2838aad5f2bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:01.730447 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5560d80-6b61-4108-a260-2838aad5f2bb None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:01.730716 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5560d80-6b61-4108-a260-2838aad5f2bb None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:01.730952 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5560d80-6b61-4108-a260-2838aad5f2bb None admin] PATH_INFO: `/v3/users/0f41d4c99ab946d0934ee47fa23e1469` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:01.732143 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5560d80-6b61-4108-a260-2838aad5f2bb None admin] RBAC: Authorizing `identity:get_user(user_id=0f41d4c99ab946d0934ee47fa23e1469)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:01.733593 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5560d80-6b61-4108-a260-2838aad5f2bb None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:01.735162 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 159/307] 10.222.0.15 () {56 vars in 1177 bytes} [Sun Oct 9 00:42:01 2022] GET /identity/v3/users/0f41d4c99ab946d0934ee47fa23e1469 => generated 293 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:42:01.736053 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5560d80-6b61-4108-a260-2838aad5f2bb None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:01.746296 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 149/308] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Oct 9 00:42:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 09 00:42:01.747475 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ddc1e7-3a31-47e8-bb8e-59113ffb3719 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:01.764890 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:01.874350 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5560d80-6b61-4108-a260-2838aad5f2bb None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:01.874554 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ddc1e7-3a31-47e8-bb8e-59113ffb3719 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:01.915382 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4863e3-fc8f-46b6-97c3-b74037ef0d7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:01.915607 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdb5873-1841-42df-813d-ffcb6bd42f0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:01.916031 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4863e3-fc8f-46b6-97c3-b74037ef0d7d None admin] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:01.916271 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdb5873-1841-42df-813d-ffcb6bd42f0a None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:01.916366 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4863e3-fc8f-46b6-97c3-b74037ef0d7d None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:01.916550 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdb5873-1841-42df-813d-ffcb6bd42f0a None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:01.916642 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4863e3-fc8f-46b6-97c3-b74037ef0d7d None admin] PATH_INFO: `/v3/groups` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:01.916819 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdb5873-1841-42df-813d-ffcb6bd42f0a None admin] PATH_INFO: `/v3/users/38d7d16e974945d29e94eabfef93a5c8` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:01.917212 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4863e3-fc8f-46b6-97c3-b74037ef0d7d None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:01.918664 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4863e3-fc8f-46b6-97c3-b74037ef0d7d None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:01.935526 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdb5873-1841-42df-813d-ffcb6bd42f0a None admin] RBAC: Authorizing `identity:get_user(user_id=38d7d16e974945d29e94eabfef93a5c8)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:01.943576 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 160/309] 10.222.0.15 () {60 vars in 1134 bytes} [Sun Oct 9 00:42:01 2022] POST /identity/v3/groups => generated 229 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 09 00:42:01.943781 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdb5873-1841-42df-813d-ffcb6bd42f0a None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:01.943859 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4863e3-fc8f-46b6-97c3-b74037ef0d7d None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:01.943927 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 150/310] 10.222.0.15 () {56 vars in 1177 bytes} [Sun Oct 9 00:42:01 2022] GET /identity/v3/users/38d7d16e974945d29e94eabfef93a5c8 => generated 293 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:42:01.945376 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdb5873-1841-42df-813d-ffcb6bd42f0a None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:01.998766 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:02.061651 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:02.080723 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4863e3-fc8f-46b6-97c3-b74037ef0d7d None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:02.106134 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdb5873-1841-42df-813d-ffcb6bd42f0a None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:02.125407 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e1c1c4-0c7c-4123-b018-0ed1803a92e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:02.126092 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e1c1c4-0c7c-4123-b018-0ed1803a92e0 None admin] REQUEST_METHOD: `PUT` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:02.126360 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e1c1c4-0c7c-4123-b018-0ed1803a92e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:02.126650 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e1c1c4-0c7c-4123-b018-0ed1803a92e0 None admin] PATH_INFO: `/v3/system/users/0f41d4c99ab946d0934ee47fa23e1469/roles/afb0a01183d9497795eaa4fa1a4046ae` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:02.128120 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e1c1c4-0c7c-4123-b018-0ed1803a92e0 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=0f41d4c99ab946d0934ee47fa23e1469, role_id=afb0a01183d9497795eaa4fa1a4046ae)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:02.129566 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e1c1c4-0c7c-4123-b018-0ed1803a92e0 None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:02.142119 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 161/311] 10.222.0.15 () {58 vars in 1334 bytes} [Sun Oct 9 00:42:01 2022] PUT /identity/v3/system/users/0f41d4c99ab946d0934ee47fa23e1469/roles/afb0a01183d9497795eaa4fa1a4046ae => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 00:42:02.143134 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e1c1c4-0c7c-4123-b018-0ed1803a92e0 None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:02.153242 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca4bd91-0aa6-4fdd-aaae-6c044be1d552 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:02.153976 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca4bd91-0aa6-4fdd-aaae-6c044be1d552 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:02.154312 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca4bd91-0aa6-4fdd-aaae-6c044be1d552 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:02.154578 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca4bd91-0aa6-4fdd-aaae-6c044be1d552 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:02.155625 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca4bd91-0aa6-4fdd-aaae-6c044be1d552 None admin] RBAC: Adding query filter params (role.id=9da5e6c99f594f149e3f29f97cf55e7e, user.id=38d7d16e974945d29e94eabfef93a5c8, scope.system=all) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:42:02.155741 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca4bd91-0aa6-4fdd-aaae-6c044be1d552 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:02.157165 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca4bd91-0aa6-4fdd-aaae-6c044be1d552 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:02.171181 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 151/312] 10.222.0.15 () {56 vars in 1308 bytes} [Sun Oct 9 00:42:01 2022] GET /identity/v3/role_assignments?user.id=38d7d16e974945d29e94eabfef93a5c8&scope.system=all&role.id=9da5e6c99f594f149e3f29f97cf55e7e => generated 226 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:42:02.289896 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e1c1c4-0c7c-4123-b018-0ed1803a92e0 None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:02.291843 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:02.336185 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb136b4-d371-4f40-b1db-69f98b1bcc65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:02.336872 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb136b4-d371-4f40-b1db-69f98b1bcc65 None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:02.337154 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb136b4-d371-4f40-b1db-69f98b1bcc65 None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:02.337416 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb136b4-d371-4f40-b1db-69f98b1bcc65 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:02.350810 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb136b4-d371-4f40-b1db-69f98b1bcc65 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 09 00:42:02.356206 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application [None req-eeb136b4-d371-4f40-b1db-69f98b1bcc65 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 09 00:42:02.356206 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:42:02.356206 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:42:02.356206 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:42:02.356206 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:42:02.356206 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:42:02.356206 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:42:02.356206 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:42:02.356206 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:42:02.356206 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:42:02.356206 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:42:02.356206 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:42:02.356206 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 09 00:42:02.356206 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 09 00:42:02.356206 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 09 00:42:02.356206 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 09 00:42:02.357562 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 09 00:42:02.357562 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 09 00:42:02.357562 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 09 00:42:02.357562 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 09 00:42:02.357562 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:42:02.357562 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:42:02.357562 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:42:02.357562 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:42:02.357562 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:42:02.357562 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:42:02.357562 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:42:02.357562 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application with Lock( Oct 09 00:42:02.357562 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:42:02.357562 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:42:02.357562 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:42:02.357562 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:42:02.359506 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:42:02.359506 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:42:02.359506 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:42:02.359506 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:42:02.359506 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 09 00:42:02.359506 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 09 00:42:02.359506 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 09 00:42:02.359506 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 09 00:42:02.359506 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 09 00:42:02.359506 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 09 00:42:02.359506 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 09 00:42:02.359506 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Oct 09 00:42:02.359506 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 162/313] 10.222.0.15 () {56 vars in 1099 bytes} [Sun Oct 9 00:42:02 2022] GET /identity/v3/roles/reader => generated 84 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:42:02.364464 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca4bd91-0aa6-4fdd-aaae-6c044be1d552 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:02.478333 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca4bd91-0aa6-4fdd-aaae-6c044be1d552 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:02.516114 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a651fd61-180f-4272-b732-cfcdf76551fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:02.516740 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a651fd61-180f-4272-b732-cfcdf76551fe None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:02.517016 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a651fd61-180f-4272-b732-cfcdf76551fe None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:02.517283 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a651fd61-180f-4272-b732-cfcdf76551fe None admin] PATH_INFO: `/v3/roles` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:02.517961 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a651fd61-180f-4272-b732-cfcdf76551fe None admin] RBAC: Adding query filter params (name=reader) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:42:02.518262 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a651fd61-180f-4272-b732-cfcdf76551fe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:02.519678 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a651fd61-180f-4272-b732-cfcdf76551fe None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:02.522272 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:02.529700 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 152/314] 10.222.0.15 () {56 vars in 1101 bytes} [Sun Oct 9 00:42:02 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 09 00:42:02.535887 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb136b4-d371-4f40-b1db-69f98b1bcc65 None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:02.646400 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb136b4-d371-4f40-b1db-69f98b1bcc65 None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:02.689394 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc0d1c2-d584-428e-906c-094e73774281 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:02.689953 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc0d1c2-d584-428e-906c-094e73774281 None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:02.690223 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc0d1c2-d584-428e-906c-094e73774281 None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:02.690490 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc0d1c2-d584-428e-906c-094e73774281 None admin] PATH_INFO: `/v3/users/29b54e97fdf740e8b36e0e6428db5047` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:02.691665 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc0d1c2-d584-428e-906c-094e73774281 None admin] RBAC: Authorizing `identity:get_user(user_id=29b54e97fdf740e8b36e0e6428db5047)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:02.693153 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc0d1c2-d584-428e-906c-094e73774281 None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:02.695079 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 163/315] 10.222.0.15 () {56 vars in 1177 bytes} [Sun Oct 9 00:42:02 2022] GET /identity/v3/users/29b54e97fdf740e8b36e0e6428db5047 => generated 297 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:42:02.701017 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a651fd61-180f-4272-b732-cfcdf76551fe None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:02.814199 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a651fd61-180f-4272-b732-cfcdf76551fe None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:02.850411 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cafba40-a89f-46fa-99aa-c370eb3072ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:02.851035 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cafba40-a89f-46fa-99aa-c370eb3072ab None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:02.851341 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cafba40-a89f-46fa-99aa-c370eb3072ab None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:02.851617 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cafba40-a89f-46fa-99aa-c370eb3072ab None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:02.925327 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cafba40-a89f-46fa-99aa-c370eb3072ab None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:02.926907 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cafba40-a89f-46fa-99aa-c370eb3072ab None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:02.930294 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:03.037999 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 153/316] 10.222.0.15 () {58 vars in 1282 bytes} [Sun Oct 9 00:42:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 09 00:42:03.044302 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc0d1c2-d584-428e-906c-094e73774281 None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:03.079350 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:03.173307 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc0d1c2-d584-428e-906c-094e73774281 None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:03.209693 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73207a14-689a-4f03-bc31-d528f42e4f8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:03.210342 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73207a14-689a-4f03-bc31-d528f42e4f8c None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:03.210613 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73207a14-689a-4f03-bc31-d528f42e4f8c None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:03.210883 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73207a14-689a-4f03-bc31-d528f42e4f8c None admin] PATH_INFO: `/v3/projects/01e5c679ba5842a3830c8b9335e2cb07` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:03.212032 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73207a14-689a-4f03-bc31-d528f42e4f8c None admin] RBAC: Authorizing `identity:get_project(project_id=01e5c679ba5842a3830c8b9335e2cb07)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:03.213541 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73207a14-689a-4f03-bc31-d528f42e4f8c None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:03.215532 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 164/317] 10.222.0.15 () {56 vars in 1186 bytes} [Sun Oct 9 00:42:03 2022] GET /identity/v3/projects/01e5c679ba5842a3830c8b9335e2cb07 => generated 302 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:42:03.226379 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cafba40-a89f-46fa-99aa-c370eb3072ab None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:03.338184 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:03.342249 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cafba40-a89f-46fa-99aa-c370eb3072ab None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:03.379495 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f609f5a-641f-4a2b-bc63-4bd485b57d58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:03.380110 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f609f5a-641f-4a2b-bc63-4bd485b57d58 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:03.380379 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f609f5a-641f-4a2b-bc63-4bd485b57d58 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:03.380644 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f609f5a-641f-4a2b-bc63-4bd485b57d58 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:03.381374 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f609f5a-641f-4a2b-bc63-4bd485b57d58 None admin] RBAC: Adding query filter params (role.id=9da5e6c99f594f149e3f29f97cf55e7e, scope.project.id=01e5c679ba5842a3830c8b9335e2cb07, user.id=29b54e97fdf740e8b36e0e6428db5047) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:42:03.381671 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f609f5a-641f-4a2b-bc63-4bd485b57d58 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:03.383120 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f609f5a-641f-4a2b-bc63-4bd485b57d58 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:03.390179 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 154/318] 10.222.0.15 () {56 vars in 1374 bytes} [Sun Oct 9 00:42:03 2022] GET /identity/v3/role_assignments?user.id=29b54e97fdf740e8b36e0e6428db5047&scope.project.id=01e5c679ba5842a3830c8b9335e2cb07&role.id=9da5e6c99f594f149e3f29f97cf55e7e => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:42:04.319170 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d905b7-d7f5-451e-886a-eebe78ef4f06 None None] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:04.319819 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d905b7-d7f5-451e-886a-eebe78ef4f06 None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:04.319819 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d905b7-d7f5-451e-886a-eebe78ef4f06 None None] PATH_INFO: `/` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:04.321554 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 165/319] 10.222.0.15 () {54 vars in 927 bytes} [Sun Oct 9 00:42:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:42:04.328399 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a695c6-540b-4a55-9a8b-ce8f68eee40d None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:04.328970 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a695c6-540b-4a55-9a8b-ce8f68eee40d None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:04.328970 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a695c6-540b-4a55-9a8b-ce8f68eee40d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:04.349737 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-10a695c6-540b-4a55-9a8b-ce8f68eee40d None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:42:04.350950 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-10a695c6-540b-4a55-9a8b-ce8f68eee40d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:42:04.425993 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91e8b24-1a40-49e8-8585-e2f9285bab63 None None] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:04.426313 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91e8b24-1a40-49e8-8585-e2f9285bab63 None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:04.426533 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91e8b24-1a40-49e8-8585-e2f9285bab63 None None] PATH_INFO: `/` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:04.426892 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 155/320] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Oct 9 00:42:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 09 00:42:04.430137 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 166/321] 10.222.0.15 () {54 vars in 927 bytes} [Sun Oct 9 00:42:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 09 00:42:04.433282 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc826fd-1339-421c-965e-7099b0b75ae1 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:04.433563 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc826fd-1339-421c-965e-7099b0b75ae1 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:04.433833 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc826fd-1339-421c-965e-7099b0b75ae1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:04.440436 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dc3871-b1a4-42cf-a31d-bd497528c6f5 None None] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:04.440704 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dc3871-b1a4-42cf-a31d-bd497528c6f5 None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:04.440970 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dc3871-b1a4-42cf-a31d-bd497528c6f5 None None] PATH_INFO: `/` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:04.443694 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 167/322] 10.222.0.15 () {54 vars in 927 bytes} [Sun Oct 9 00:42:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:42:04.447963 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f7ad29-ae15-4a00-8245-74cf3c9352d9 None None] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:04.448243 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f7ad29-ae15-4a00-8245-74cf3c9352d9 None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:04.448510 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f7ad29-ae15-4a00-8245-74cf3c9352d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:04.452877 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-0dc826fd-1339-421c-965e-7099b0b75ae1 None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:42:04.454077 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-0dc826fd-1339-421c-965e-7099b0b75ae1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:42:04.467679 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.auth.core [None req-20f7ad29-ae15-4a00-8245-74cf3c9352d9 None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:42:04.468889 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-20f7ad29-ae15-4a00-8245-74cf3c9352d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:42:04.528406 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 156/323] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Oct 9 00:42:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 09 00:42:04.552591 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 168/324] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Oct 9 00:42:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 09 00:42:04.703376 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc826fd-1339-421c-965e-7099b0b75ae1 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:04.725892 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:04.789927 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f7ad29-ae15-4a00-8245-74cf3c9352d9 None None] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:04.817409 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc826fd-1339-421c-965e-7099b0b75ae1 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:04.818884 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:04.856422 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635f8f78-1e9a-4e90-b3a1-279d129567ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:04.857061 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635f8f78-1e9a-4e90-b3a1-279d129567ea None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:04.857333 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635f8f78-1e9a-4e90-b3a1-279d129567ea None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:04.857598 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635f8f78-1e9a-4e90-b3a1-279d129567ea None admin] PATH_INFO: `/v3/domains/default` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:04.858698 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635f8f78-1e9a-4e90-b3a1-279d129567ea None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:04.861511 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635f8f78-1e9a-4e90-b3a1-279d129567ea None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:04.861810 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 157/325] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Oct 9 00:42:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:42:04.862528 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635f8f78-1e9a-4e90-b3a1-279d129567ea None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:04.895613 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f7ad29-ae15-4a00-8245-74cf3c9352d9 None None] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:04.938753 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6588c2d-5ba7-46f4-bda7-cf8e19d9e92f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:04.939720 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6588c2d-5ba7-46f4-bda7-cf8e19d9e92f None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:04.940183 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6588c2d-5ba7-46f4-bda7-cf8e19d9e92f None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:04.940585 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6588c2d-5ba7-46f4-bda7-cf8e19d9e92f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:04.956810 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6588c2d-5ba7-46f4-bda7-cf8e19d9e92f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 09 00:42:04.965320 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application [None req-a6588c2d-5ba7-46f4-bda7-cf8e19d9e92f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 09 00:42:04.965320 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:42:04.965320 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:42:04.965320 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:42:04.965320 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:42:04.965320 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:42:04.965320 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:42:04.965320 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:42:04.965320 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:42:04.965320 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:42:04.965320 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:42:04.965320 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:42:04.965320 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 09 00:42:04.965320 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 09 00:42:04.965320 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 09 00:42:04.965320 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 09 00:42:04.966376 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 09 00:42:04.966376 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 09 00:42:04.966376 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 09 00:42:04.966376 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 09 00:42:04.966376 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:42:04.966376 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:42:04.966376 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:42:04.966376 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:42:04.966376 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:42:04.966376 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:42:04.966376 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:42:04.966376 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application with Lock( Oct 09 00:42:04.966376 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:42:04.966376 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:42:04.966376 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:42:04.966376 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:42:04.967370 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:42:04.967370 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:42:04.967370 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:42:04.967370 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:42:04.967370 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 09 00:42:04.967370 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 09 00:42:04.967370 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 09 00:42:04.967370 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 09 00:42:04.967370 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 09 00:42:04.967370 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 09 00:42:04.967370 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 09 00:42:04.967370 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Oct 09 00:42:04.967370 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 169/326] 10.222.0.15 () {56 vars in 1099 bytes} [Sun Oct 9 00:42:04 2022] GET /identity/v3/roles/reader => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 09 00:42:04.968335 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6588c2d-5ba7-46f4-bda7-cf8e19d9e92f None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:04.987121 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:05.000395 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635f8f78-1e9a-4e90-b3a1-279d129567ea None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:05.044979 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a7ba0d-4887-48bf-8254-72d1763631ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:05.045619 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a7ba0d-4887-48bf-8254-72d1763631ff None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:05.045892 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a7ba0d-4887-48bf-8254-72d1763631ff None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:05.046159 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a7ba0d-4887-48bf-8254-72d1763631ff None admin] PATH_INFO: `/v3/roles/member` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:05.057325 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a7ba0d-4887-48bf-8254-72d1763631ff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 09 00:42:05.062203 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application [None req-97a7ba0d-4887-48bf-8254-72d1763631ff None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 09 00:42:05.062203 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:42:05.062203 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:42:05.062203 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:42:05.062203 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:42:05.062203 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:42:05.062203 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:42:05.062203 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:42:05.062203 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:42:05.062203 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:42:05.062203 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:42:05.062203 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:42:05.062203 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 09 00:42:05.062203 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 09 00:42:05.062203 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 09 00:42:05.062203 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 09 00:42:05.063163 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 09 00:42:05.063163 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 09 00:42:05.063163 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 09 00:42:05.063163 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 09 00:42:05.063163 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:42:05.063163 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:42:05.063163 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:42:05.063163 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:42:05.063163 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:42:05.063163 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:42:05.063163 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:42:05.063163 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application with Lock( Oct 09 00:42:05.063163 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:42:05.063163 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:42:05.063163 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:42:05.063163 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:42:05.064178 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:42:05.064178 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:42:05.064178 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:42:05.064178 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:42:05.064178 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 09 00:42:05.064178 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 09 00:42:05.064178 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 09 00:42:05.064178 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 09 00:42:05.064178 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 09 00:42:05.064178 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 09 00:42:05.064178 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 09 00:42:05.064178 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application Oct 09 00:42:05.064178 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 158/327] 10.222.0.15 () {56 vars in 1099 bytes} [Sun Oct 9 00:42:04 2022] GET /identity/v3/roles/member => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:42:05.064178 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a7ba0d-4887-48bf-8254-72d1763631ff None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:05.073421 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:05.086577 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6588c2d-5ba7-46f4-bda7-cf8e19d9e92f None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:05.123674 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da635fb-34cc-4792-959d-c041f3082d0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:05.124633 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da635fb-34cc-4792-959d-c041f3082d0a None admin] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:05.124912 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da635fb-34cc-4792-959d-c041f3082d0a None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:05.125176 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da635fb-34cc-4792-959d-c041f3082d0a None admin] PATH_INFO: `/v3/groups` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:05.125803 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da635fb-34cc-4792-959d-c041f3082d0a None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:05.127294 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da635fb-34cc-4792-959d-c041f3082d0a None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:05.144866 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 170/328] 10.222.0.15 () {60 vars in 1134 bytes} [Sun Oct 9 00:42:04 2022] POST /identity/v3/groups => generated 226 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 09 00:42:05.145709 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da635fb-34cc-4792-959d-c041f3082d0a None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:05.184197 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a7ba0d-4887-48bf-8254-72d1763631ff None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:05.227372 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42ebf30-2e8b-42b5-82c1-b06dafdea337 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:05.227935 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42ebf30-2e8b-42b5-82c1-b06dafdea337 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:05.228214 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42ebf30-2e8b-42b5-82c1-b06dafdea337 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:05.228509 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42ebf30-2e8b-42b5-82c1-b06dafdea337 None admin] PATH_INFO: `/v3/roles` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:05.229202 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42ebf30-2e8b-42b5-82c1-b06dafdea337 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:42:05.229495 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42ebf30-2e8b-42b5-82c1-b06dafdea337 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:05.231040 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42ebf30-2e8b-42b5-82c1-b06dafdea337 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:05.240699 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 159/329] 10.222.0.15 () {56 vars in 1101 bytes} [Sun Oct 9 00:42:05 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:42:05.246770 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42ebf30-2e8b-42b5-82c1-b06dafdea337 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:05.271062 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:05.287105 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da635fb-34cc-4792-959d-c041f3082d0a None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:05.329926 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937e8b87-8462-4973-8652-5b39b2a26a69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:05.334096 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937e8b87-8462-4973-8652-5b39b2a26a69 None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:05.334096 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937e8b87-8462-4973-8652-5b39b2a26a69 None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:05.334096 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937e8b87-8462-4973-8652-5b39b2a26a69 None admin] PATH_INFO: `/v3/roles` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:05.334096 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937e8b87-8462-4973-8652-5b39b2a26a69 None admin] RBAC: Adding query filter params (name=member) {{(pid=81525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:42:05.334096 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937e8b87-8462-4973-8652-5b39b2a26a69 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:05.334096 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937e8b87-8462-4973-8652-5b39b2a26a69 None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:05.343797 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 171/330] 10.222.0.15 () {56 vars in 1101 bytes} [Sun Oct 9 00:42:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:42:05.349896 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937e8b87-8462-4973-8652-5b39b2a26a69 None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:05.369457 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:05.394086 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42ebf30-2e8b-42b5-82c1-b06dafdea337 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:05.434919 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5089ce2a-b382-4c04-a01d-4b48448aa92c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:05.435617 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5089ce2a-b382-4c04-a01d-4b48448aa92c None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:05.436338 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5089ce2a-b382-4c04-a01d-4b48448aa92c None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:05.436605 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5089ce2a-b382-4c04-a01d-4b48448aa92c None admin] PATH_INFO: `/v3/users/38d7d16e974945d29e94eabfef93a5c8` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:05.439301 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5089ce2a-b382-4c04-a01d-4b48448aa92c None admin] RBAC: Authorizing `identity:get_user(user_id=38d7d16e974945d29e94eabfef93a5c8)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:05.439301 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5089ce2a-b382-4c04-a01d-4b48448aa92c None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:05.443298 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 160/331] 10.222.0.15 () {56 vars in 1177 bytes} [Sun Oct 9 00:42:05 2022] GET /identity/v3/users/38d7d16e974945d29e94eabfef93a5c8 => generated 293 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 09 00:42:05.448310 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5089ce2a-b382-4c04-a01d-4b48448aa92c None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:05.499784 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937e8b87-8462-4973-8652-5b39b2a26a69 None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:05.545777 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911bd86b-d25b-4626-ac90-2d4862078f84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:05.546429 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911bd86b-d25b-4626-ac90-2d4862078f84 None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:05.546699 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911bd86b-d25b-4626-ac90-2d4862078f84 None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:05.547041 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911bd86b-d25b-4626-ac90-2d4862078f84 None admin] PATH_INFO: `/v3/users/0f41d4c99ab946d0934ee47fa23e1469` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:05.548632 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911bd86b-d25b-4626-ac90-2d4862078f84 None admin] RBAC: Authorizing `identity:get_user(user_id=0f41d4c99ab946d0934ee47fa23e1469)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:05.550094 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911bd86b-d25b-4626-ac90-2d4862078f84 None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:05.552084 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 172/332] 10.222.0.15 () {56 vars in 1177 bytes} [Sun Oct 9 00:42:05 2022] GET /identity/v3/users/0f41d4c99ab946d0934ee47fa23e1469 => generated 293 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 09 00:42:05.556072 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:05.559133 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911bd86b-d25b-4626-ac90-2d4862078f84 None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:05.580764 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5089ce2a-b382-4c04-a01d-4b48448aa92c None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:05.625329 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e8a233-7a3f-40ef-8642-e579c10567c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:05.625986 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e8a233-7a3f-40ef-8642-e579c10567c5 None admin] REQUEST_METHOD: `PUT` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:05.626263 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e8a233-7a3f-40ef-8642-e579c10567c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:05.626531 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e8a233-7a3f-40ef-8642-e579c10567c5 None admin] PATH_INFO: `/v3/system/users/38d7d16e974945d29e94eabfef93a5c8/roles/9da5e6c99f594f149e3f29f97cf55e7e` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:05.628027 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e8a233-7a3f-40ef-8642-e579c10567c5 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=38d7d16e974945d29e94eabfef93a5c8, role_id=9da5e6c99f594f149e3f29f97cf55e7e)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:05.629929 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e8a233-7a3f-40ef-8642-e579c10567c5 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:05.646105 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 161/333] 10.222.0.15 () {58 vars in 1334 bytes} [Sun Oct 9 00:42:05 2022] PUT /identity/v3/system/users/38d7d16e974945d29e94eabfef93a5c8/roles/9da5e6c99f594f149e3f29f97cf55e7e => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 00:42:05.658759 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:05.685051 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911bd86b-d25b-4626-ac90-2d4862078f84 None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:05.724930 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d33f94-cd18-47c5-9fa9-52ac0245dcca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:05.725567 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d33f94-cd18-47c5-9fa9-52ac0245dcca None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:05.725841 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d33f94-cd18-47c5-9fa9-52ac0245dcca None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:05.726109 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d33f94-cd18-47c5-9fa9-52ac0245dcca None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:05.726857 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d33f94-cd18-47c5-9fa9-52ac0245dcca None admin] RBAC: Adding query filter params (role.id=afb0a01183d9497795eaa4fa1a4046ae, user.id=0f41d4c99ab946d0934ee47fa23e1469, scope.system=all) {{(pid=81525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:42:05.727166 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d33f94-cd18-47c5-9fa9-52ac0245dcca None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:05.728917 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d33f94-cd18-47c5-9fa9-52ac0245dcca None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:05.745209 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 173/334] 10.222.0.15 () {56 vars in 1308 bytes} [Sun Oct 9 00:42:05 2022] GET /identity/v3/role_assignments?user.id=0f41d4c99ab946d0934ee47fa23e1469&scope.system=all&role.id=afb0a01183d9497795eaa4fa1a4046ae => generated 510 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:42:08.009630 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6419d64-f052-42b7-9596-a04ee4df6995 None None] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:08.010808 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6419d64-f052-42b7-9596-a04ee4df6995 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:08.011326 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6419d64-f052-42b7-9596-a04ee4df6995 None None] PATH_INFO: `/` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:08.013234 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 162/335] 10.222.0.15 () {54 vars in 927 bytes} [Sun Oct 9 00:42:08 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:42:08.018836 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0629f07-542a-4445-b6cc-152ab2980787 None None] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:08.019806 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0629f07-542a-4445-b6cc-152ab2980787 None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:08.020309 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0629f07-542a-4445-b6cc-152ab2980787 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:08.049349 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.auth.core [None req-c0629f07-542a-4445-b6cc-152ab2980787 None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:42:08.050587 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-c0629f07-542a-4445-b6cc-152ab2980787 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:42:08.141499 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 174/336] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Oct 9 00:42:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 09 00:42:08.165850 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1065c67d-99bb-4d1b-8fc0-1efff3d3b771 None None] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:08.166247 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1065c67d-99bb-4d1b-8fc0-1efff3d3b771 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:08.166432 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1065c67d-99bb-4d1b-8fc0-1efff3d3b771 None None] PATH_INFO: `/` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:08.168193 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 163/337] 10.222.0.15 () {54 vars in 927 bytes} [Sun Oct 9 00:42:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:42:08.177458 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c51ee7-f87f-460f-8caf-31264329af1f None None] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:08.177784 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c51ee7-f87f-460f-8caf-31264329af1f None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:08.177997 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c51ee7-f87f-460f-8caf-31264329af1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:08.201495 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.auth.core [None req-c2c51ee7-f87f-460f-8caf-31264329af1f None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:42:08.202719 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-c2c51ee7-f87f-460f-8caf-31264329af1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:42:08.223738 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e50e2a5-a3b0-4a41-9f5b-2dd4f1861a66 None None] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:08.224062 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e50e2a5-a3b0-4a41-9f5b-2dd4f1861a66 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:08.224281 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e50e2a5-a3b0-4a41-9f5b-2dd4f1861a66 None None] PATH_INFO: `/` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:08.225765 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 164/338] 10.222.0.15 () {54 vars in 927 bytes} [Sun Oct 9 00:42:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 09 00:42:08.237023 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861744f1-5032-4212-928b-0b7ea04bb891 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:08.237299 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861744f1-5032-4212-928b-0b7ea04bb891 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:08.237565 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861744f1-5032-4212-928b-0b7ea04bb891 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:08.267613 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-861744f1-5032-4212-928b-0b7ea04bb891 None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:42:08.268730 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-861744f1-5032-4212-928b-0b7ea04bb891 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:42:08.307102 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:08.315987 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 175/339] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Oct 9 00:42:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 09 00:42:08.317386 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cdb420-d643-4dc1-a5ed-8178a6f27c23 None None] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:08.317668 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cdb420-d643-4dc1-a5ed-8178a6f27c23 None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:08.317935 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cdb420-d643-4dc1-a5ed-8178a6f27c23 None None] PATH_INFO: `/` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:08.320248 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 176/340] 10.222.0.15 () {54 vars in 927 bytes} [Sun Oct 9 00:42:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:42:08.326088 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0a54d2-90db-4b34-b06b-2731311aa870 None None] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:08.326363 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0a54d2-90db-4b34-b06b-2731311aa870 None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:08.326628 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0a54d2-90db-4b34-b06b-2731311aa870 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:08.345786 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.auth.core [None req-1d0a54d2-90db-4b34-b06b-2731311aa870 None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:42:08.346987 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-1d0a54d2-90db-4b34-b06b-2731311aa870 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:42:08.427614 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 165/341] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Oct 9 00:42:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 09 00:42:08.432050 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 177/342] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Oct 9 00:42:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 09 00:42:08.568891 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861744f1-5032-4212-928b-0b7ea04bb891 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:08.659842 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:08.687166 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861744f1-5032-4212-928b-0b7ea04bb891 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:08.724667 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982c5fb9-dc08-42f0-bbd7-49f749c1d361 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:08.725306 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982c5fb9-dc08-42f0-bbd7-49f749c1d361 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:08.725578 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982c5fb9-dc08-42f0-bbd7-49f749c1d361 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:08.725848 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982c5fb9-dc08-42f0-bbd7-49f749c1d361 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:08.737448 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982c5fb9-dc08-42f0-bbd7-49f749c1d361 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 09 00:42:08.742448 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application [None req-982c5fb9-dc08-42f0-bbd7-49f749c1d361 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 09 00:42:08.742448 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:42:08.742448 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:42:08.742448 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:42:08.742448 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:42:08.742448 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:42:08.742448 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:42:08.742448 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:42:08.742448 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:42:08.742448 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:42:08.742448 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:42:08.742448 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:42:08.742448 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 09 00:42:08.742448 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 09 00:42:08.742448 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 09 00:42:08.742448 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 09 00:42:08.743415 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 09 00:42:08.743415 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 09 00:42:08.743415 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 09 00:42:08.743415 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 09 00:42:08.743415 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:42:08.743415 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:42:08.743415 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:42:08.743415 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:42:08.743415 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:42:08.743415 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:42:08.743415 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:42:08.743415 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application with Lock( Oct 09 00:42:08.743415 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:42:08.743415 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:42:08.743415 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:42:08.743415 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:42:08.744275 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:42:08.744275 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:42:08.744275 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:42:08.744275 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:42:08.744275 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 09 00:42:08.744275 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 09 00:42:08.744275 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 09 00:42:08.744275 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 09 00:42:08.744275 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 09 00:42:08.744275 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 09 00:42:08.744275 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 09 00:42:08.744275 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application Oct 09 00:42:08.744275 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 166/343] 10.222.0.15 () {56 vars in 1099 bytes} [Sun Oct 9 00:42:08 2022] GET /identity/v3/roles/reader => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:42:08.750059 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0a54d2-90db-4b34-b06b-2731311aa870 None None] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:08.795864 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982c5fb9-dc08-42f0-bbd7-49f749c1d361 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:08.912122 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0a54d2-90db-4b34-b06b-2731311aa870 None None] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:08.954494 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:08.965803 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010d0e0c-4e4e-44db-9164-4b6d8f7653dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:08.966812 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010d0e0c-4e4e-44db-9164-4b6d8f7653dc None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:08.967158 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010d0e0c-4e4e-44db-9164-4b6d8f7653dc None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:08.967815 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010d0e0c-4e4e-44db-9164-4b6d8f7653dc None admin] PATH_INFO: `/v3/roles` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:08.969085 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010d0e0c-4e4e-44db-9164-4b6d8f7653dc None admin] RBAC: Adding query filter params (name=reader) {{(pid=81525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:42:08.969608 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010d0e0c-4e4e-44db-9164-4b6d8f7653dc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:08.971182 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010d0e0c-4e4e-44db-9164-4b6d8f7653dc None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:08.971654 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982c5fb9-dc08-42f0-bbd7-49f749c1d361 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:08.982455 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 178/344] 10.222.0.15 () {56 vars in 1101 bytes} [Sun Oct 9 00:42:08 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:42:08.983836 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010d0e0c-4e4e-44db-9164-4b6d8f7653dc None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:09.029991 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33823d1-5c22-4f58-80f2-8ff8a5e75a34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:09.030705 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33823d1-5c22-4f58-80f2-8ff8a5e75a34 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:09.030985 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33823d1-5c22-4f58-80f2-8ff8a5e75a34 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:09.031269 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33823d1-5c22-4f58-80f2-8ff8a5e75a34 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:09.034423 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:09.050183 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33823d1-5c22-4f58-80f2-8ff8a5e75a34 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 09 00:42:09.056377 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application [None req-e33823d1-5c22-4f58-80f2-8ff8a5e75a34 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 09 00:42:09.056377 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:42:09.056377 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:42:09.056377 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:42:09.056377 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:42:09.056377 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:42:09.056377 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:42:09.056377 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:42:09.056377 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:42:09.056377 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:42:09.056377 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:42:09.056377 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:42:09.056377 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 09 00:42:09.056377 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 09 00:42:09.056377 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 09 00:42:09.056377 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 09 00:42:09.057497 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 09 00:42:09.057497 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 09 00:42:09.057497 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 09 00:42:09.057497 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 09 00:42:09.057497 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:42:09.057497 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:42:09.057497 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:42:09.057497 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:42:09.057497 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:42:09.057497 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:42:09.057497 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:42:09.057497 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application with Lock( Oct 09 00:42:09.057497 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:42:09.057497 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:42:09.057497 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:42:09.057497 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:42:09.058355 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:42:09.058355 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:42:09.058355 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:42:09.058355 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:42:09.058355 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 09 00:42:09.058355 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 09 00:42:09.058355 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 09 00:42:09.058355 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 09 00:42:09.058355 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 09 00:42:09.058355 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 09 00:42:09.058355 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 09 00:42:09.058355 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application Oct 09 00:42:09.060500 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 167/345] 10.222.0.15 () {56 vars in 1099 bytes} [Sun Oct 9 00:42:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:42:09.061559 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33823d1-5c22-4f58-80f2-8ff8a5e75a34 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:09.127018 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010d0e0c-4e4e-44db-9164-4b6d8f7653dc None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:09.170638 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0501961f-bd86-4f1f-b125-ad3a5d987ca0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:09.171203 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0501961f-bd86-4f1f-b125-ad3a5d987ca0 None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:09.171518 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0501961f-bd86-4f1f-b125-ad3a5d987ca0 None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:09.171847 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0501961f-bd86-4f1f-b125-ad3a5d987ca0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:09.186700 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0501961f-bd86-4f1f-b125-ad3a5d987ca0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 09 00:42:09.188175 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33823d1-5c22-4f58-80f2-8ff8a5e75a34 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:09.193310 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application [None req-0501961f-bd86-4f1f-b125-ad3a5d987ca0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 09 00:42:09.193310 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:42:09.193310 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:42:09.193310 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:42:09.193310 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:42:09.193310 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:42:09.193310 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:42:09.193310 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:42:09.193310 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:42:09.193310 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:42:09.193310 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:42:09.193310 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:42:09.193310 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 09 00:42:09.193310 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 09 00:42:09.193310 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 09 00:42:09.193310 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 09 00:42:09.194222 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 09 00:42:09.194222 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 09 00:42:09.194222 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 09 00:42:09.194222 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 09 00:42:09.194222 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:42:09.194222 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:42:09.194222 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:42:09.194222 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:42:09.194222 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:42:09.194222 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:42:09.194222 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:42:09.194222 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application with Lock( Oct 09 00:42:09.194222 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:42:09.194222 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:42:09.194222 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:42:09.194222 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:42:09.195132 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:42:09.195132 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:42:09.195132 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:42:09.195132 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:42:09.195132 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 09 00:42:09.195132 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 09 00:42:09.195132 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 09 00:42:09.195132 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 09 00:42:09.195132 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 09 00:42:09.195132 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 09 00:42:09.195132 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 09 00:42:09.195132 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Oct 09 00:42:09.197750 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 179/346] 10.222.0.15 () {56 vars in 1099 bytes} [Sun Oct 9 00:42:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:42:09.198809 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0501961f-bd86-4f1f-b125-ad3a5d987ca0 None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:09.231886 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9ba8c3-f99e-4026-8d83-020bbf7f34c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:09.232594 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9ba8c3-f99e-4026-8d83-020bbf7f34c2 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:09.233107 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9ba8c3-f99e-4026-8d83-020bbf7f34c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:09.233381 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9ba8c3-f99e-4026-8d83-020bbf7f34c2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:09.247498 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9ba8c3-f99e-4026-8d83-020bbf7f34c2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 09 00:42:09.253371 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application [None req-bd9ba8c3-f99e-4026-8d83-020bbf7f34c2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 09 00:42:09.253371 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:42:09.253371 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:42:09.253371 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:42:09.253371 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:42:09.253371 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:42:09.253371 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:42:09.253371 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:42:09.253371 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:42:09.253371 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:42:09.253371 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:42:09.253371 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:42:09.253371 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 09 00:42:09.253371 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 09 00:42:09.253371 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 09 00:42:09.253371 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 09 00:42:09.254260 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 09 00:42:09.254260 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 09 00:42:09.254260 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 09 00:42:09.254260 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 09 00:42:09.254260 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:42:09.254260 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:42:09.254260 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:42:09.254260 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:42:09.254260 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:42:09.254260 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:42:09.254260 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:42:09.254260 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application with Lock( Oct 09 00:42:09.254260 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:42:09.254260 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:42:09.254260 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:42:09.254260 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:42:09.255071 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:42:09.255071 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:42:09.255071 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:42:09.255071 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:42:09.255071 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 09 00:42:09.255071 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 09 00:42:09.255071 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 09 00:42:09.255071 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 09 00:42:09.255071 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 09 00:42:09.255071 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 09 00:42:09.255071 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 09 00:42:09.255071 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application Oct 09 00:42:09.255071 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 168/347] 10.222.0.15 () {56 vars in 1114 bytes} [Sun Oct 9 00:42:09 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:42:09.260064 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9ba8c3-f99e-4026-8d83-020bbf7f34c2 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:09.260787 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:09.327929 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0501961f-bd86-4f1f-b125-ad3a5d987ca0 None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:09.331128 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:09.368204 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753f4f03-5290-4177-8ea5-a6fe86cdfee2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:09.369047 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753f4f03-5290-4177-8ea5-a6fe86cdfee2 None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:09.369324 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753f4f03-5290-4177-8ea5-a6fe86cdfee2 None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:09.369670 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753f4f03-5290-4177-8ea5-a6fe86cdfee2 None admin] PATH_INFO: `/v3/users/38d7d16e974945d29e94eabfef93a5c8` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:09.370912 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753f4f03-5290-4177-8ea5-a6fe86cdfee2 None admin] RBAC: Authorizing `identity:get_user(user_id=38d7d16e974945d29e94eabfef93a5c8)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:09.372528 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753f4f03-5290-4177-8ea5-a6fe86cdfee2 None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:09.375022 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 180/348] 10.222.0.15 () {56 vars in 1177 bytes} [Sun Oct 9 00:42:09 2022] GET /identity/v3/users/38d7d16e974945d29e94eabfef93a5c8 => generated 293 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:42:09.375971 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753f4f03-5290-4177-8ea5-a6fe86cdfee2 None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:09.402040 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9ba8c3-f99e-4026-8d83-020bbf7f34c2 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:09.446512 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcc14fc-c053-424b-a339-2eca82b4348e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:09.447688 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcc14fc-c053-424b-a339-2eca82b4348e None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:09.448207 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcc14fc-c053-424b-a339-2eca82b4348e None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:09.448855 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcc14fc-c053-424b-a339-2eca82b4348e None admin] PATH_INFO: `/v3/roles` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:09.450190 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcc14fc-c053-424b-a339-2eca82b4348e None admin] RBAC: Adding query filter params (name=member) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:42:09.450940 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcc14fc-c053-424b-a339-2eca82b4348e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:09.453230 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcc14fc-c053-424b-a339-2eca82b4348e None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:09.466124 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 169/349] 10.222.0.15 () {56 vars in 1101 bytes} [Sun Oct 9 00:42:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:42:09.467376 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcc14fc-c053-424b-a339-2eca82b4348e None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:09.500726 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753f4f03-5290-4177-8ea5-a6fe86cdfee2 None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:09.519466 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:09.540466 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fc89a3-30ca-43d8-bff9-ce876842ebc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:09.541262 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fc89a3-30ca-43d8-bff9-ce876842ebc0 None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:09.541601 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fc89a3-30ca-43d8-bff9-ce876842ebc0 None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:09.541941 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fc89a3-30ca-43d8-bff9-ce876842ebc0 None admin] PATH_INFO: `/v3/roles` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:09.542814 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fc89a3-30ca-43d8-bff9-ce876842ebc0 None admin] RBAC: Adding query filter params (name=member) {{(pid=81525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:42:09.542975 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fc89a3-30ca-43d8-bff9-ce876842ebc0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:09.544532 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fc89a3-30ca-43d8-bff9-ce876842ebc0 None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:09.554886 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 181/350] 10.222.0.15 () {56 vars in 1101 bytes} [Sun Oct 9 00:42:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:42:09.555932 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fc89a3-30ca-43d8-bff9-ce876842ebc0 None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:09.600369 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcc14fc-c053-424b-a339-2eca82b4348e None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:09.639635 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:09.652918 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a20141-b776-4d44-9907-e3d4c3159e4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:09.653821 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a20141-b776-4d44-9907-e3d4c3159e4f None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:09.654105 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a20141-b776-4d44-9907-e3d4c3159e4f None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:09.654512 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a20141-b776-4d44-9907-e3d4c3159e4f None admin] PATH_INFO: `/v3/roles` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:09.655760 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a20141-b776-4d44-9907-e3d4c3159e4f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:42:09.656074 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a20141-b776-4d44-9907-e3d4c3159e4f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:09.657778 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a20141-b776-4d44-9907-e3d4c3159e4f None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:09.668853 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 170/351] 10.222.0.15 () {56 vars in 1111 bytes} [Sun Oct 9 00:42:09 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:42:09.669884 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a20141-b776-4d44-9907-e3d4c3159e4f None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:09.720177 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fc89a3-30ca-43d8-bff9-ce876842ebc0 None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:09.762866 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bc2856-d3b5-4527-8c34-e94e61dc1c37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:09.763536 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bc2856-d3b5-4527-8c34-e94e61dc1c37 None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:09.763818 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bc2856-d3b5-4527-8c34-e94e61dc1c37 None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:09.764089 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bc2856-d3b5-4527-8c34-e94e61dc1c37 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:09.764836 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bc2856-d3b5-4527-8c34-e94e61dc1c37 None admin] RBAC: Adding query filter params (role.id=9da5e6c99f594f149e3f29f97cf55e7e, user.id=38d7d16e974945d29e94eabfef93a5c8, scope.system=all) {{(pid=81525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:42:09.765142 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bc2856-d3b5-4527-8c34-e94e61dc1c37 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:09.766757 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bc2856-d3b5-4527-8c34-e94e61dc1c37 None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:09.780982 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 182/352] 10.222.0.15 () {56 vars in 1308 bytes} [Sun Oct 9 00:42:09 2022] GET /identity/v3/role_assignments?user.id=38d7d16e974945d29e94eabfef93a5c8&scope.system=all&role.id=9da5e6c99f594f149e3f29f97cf55e7e => generated 510 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:42:09.781878 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bc2856-d3b5-4527-8c34-e94e61dc1c37 None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:09.830394 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a20141-b776-4d44-9907-e3d4c3159e4f None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:09.861270 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:09.915695 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be50b94-9eed-4ef6-99ee-de1c2dda95e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:09.917253 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be50b94-9eed-4ef6-99ee-de1c2dda95e8 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:09.917799 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be50b94-9eed-4ef6-99ee-de1c2dda95e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:09.918289 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be50b94-9eed-4ef6-99ee-de1c2dda95e8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:09.950518 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bc2856-d3b5-4527-8c34-e94e61dc1c37 None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:09.982472 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:09.993773 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baae0213-cabe-40d6-a815-aee15cd9dc7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:09.995326 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baae0213-cabe-40d6-a815-aee15cd9dc7a None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:09.995326 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baae0213-cabe-40d6-a815-aee15cd9dc7a None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:09.995326 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baae0213-cabe-40d6-a815-aee15cd9dc7a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:10.013846 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be50b94-9eed-4ef6-99ee-de1c2dda95e8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:10.016699 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be50b94-9eed-4ef6-99ee-de1c2dda95e8 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:10.094361 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baae0213-cabe-40d6-a815-aee15cd9dc7a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:10.096092 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baae0213-cabe-40d6-a815-aee15cd9dc7a None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:10.138132 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:10.160529 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 171/353] 10.222.0.15 () {58 vars in 1282 bytes} [Sun Oct 9 00:42:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 491 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 09 00:42:10.161412 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be50b94-9eed-4ef6-99ee-de1c2dda95e8 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:10.222808 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 183/354] 10.222.0.15 () {58 vars in 1282 bytes} [Sun Oct 9 00:42:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 09 00:42:10.224480 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1334c3fe-a00c-4e6d-9183-9dd72bc7e62d None None] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:10.224959 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1334c3fe-a00c-4e6d-9183-9dd72bc7e62d None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:10.225421 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1334c3fe-a00c-4e6d-9183-9dd72bc7e62d None None] PATH_INFO: `/` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:10.227646 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 184/355] 10.222.0.15 () {54 vars in 927 bytes} [Sun Oct 9 00:42:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:42:10.229113 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1334c3fe-a00c-4e6d-9183-9dd72bc7e62d None None] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:10.280353 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:10.314664 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be50b94-9eed-4ef6-99ee-de1c2dda95e8 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:10.356882 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6cf306-6664-40ee-8fe1-fd72bc1ec929 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:10.357884 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6cf306-6664-40ee-8fe1-fd72bc1ec929 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:10.358325 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6cf306-6664-40ee-8fe1-fd72bc1ec929 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:10.358743 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6cf306-6664-40ee-8fe1-fd72bc1ec929 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:10.360106 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1334c3fe-a00c-4e6d-9183-9dd72bc7e62d None None] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:10.399566 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b80d4d7-b011-4a9c-8c4b-28c7ad02ee67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:10.400236 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b80d4d7-b011-4a9c-8c4b-28c7ad02ee67 None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:10.400556 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b80d4d7-b011-4a9c-8c4b-28c7ad02ee67 None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:10.400818 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b80d4d7-b011-4a9c-8c4b-28c7ad02ee67 None admin] PATH_INFO: `/v3/projects/3fcf2f5182c445929c38948df6235040` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:10.402029 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b80d4d7-b011-4a9c-8c4b-28c7ad02ee67 None admin] RBAC: Authorizing `identity:get_project(project_id=3fcf2f5182c445929c38948df6235040)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:10.403553 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b80d4d7-b011-4a9c-8c4b-28c7ad02ee67 None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:10.405217 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 185/356] 10.222.0.15 () {56 vars in 1186 bytes} [Sun Oct 9 00:42:10 2022] GET /identity/v3/projects/3fcf2f5182c445929c38948df6235040 => generated 298 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:42:10.406378 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af8f029-3712-4837-a84f-4e6b612f342e None None] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:10.406656 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af8f029-3712-4837-a84f-4e6b612f342e None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:10.406921 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af8f029-3712-4837-a84f-4e6b612f342e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:10.414691 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:10.426655 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.auth.core [None req-5af8f029-3712-4837-a84f-4e6b612f342e None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:42:10.427899 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-5af8f029-3712-4837-a84f-4e6b612f342e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:42:10.439500 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6cf306-6664-40ee-8fe1-fd72bc1ec929 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:10.441607 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6cf306-6664-40ee-8fe1-fd72bc1ec929 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:10.508866 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 186/357] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Oct 9 00:42:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 09 00:42:10.509531 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af8f029-3712-4837-a84f-4e6b612f342e None None] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:10.545293 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:10.575141 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 172/358] 10.222.0.15 () {58 vars in 1282 bytes} [Sun Oct 9 00:42:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 09 00:42:10.576918 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13b4c00-74c7-481c-b0c8-636a371958a1 None None] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:10.577290 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13b4c00-74c7-481c-b0c8-636a371958a1 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:10.577628 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13b4c00-74c7-481c-b0c8-636a371958a1 None None] PATH_INFO: `/` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:10.579186 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 173/359] 10.222.0.15 () {54 vars in 927 bytes} [Sun Oct 9 00:42:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:42:10.579994 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13b4c00-74c7-481c-b0c8-636a371958a1 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:10.637773 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af8f029-3712-4837-a84f-4e6b612f342e None None] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:10.681602 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665048a3-37f8-472e-a599-9dfceac00701 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:10.682310 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665048a3-37f8-472e-a599-9dfceac00701 None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:10.682520 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665048a3-37f8-472e-a599-9dfceac00701 None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:10.682791 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665048a3-37f8-472e-a599-9dfceac00701 None admin] PATH_INFO: `/v3/projects/01e5c679ba5842a3830c8b9335e2cb07` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:10.684346 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665048a3-37f8-472e-a599-9dfceac00701 None admin] RBAC: Authorizing `identity:get_project(project_id=01e5c679ba5842a3830c8b9335e2cb07)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:10.685816 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665048a3-37f8-472e-a599-9dfceac00701 None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:10.687875 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 187/360] 10.222.0.15 () {56 vars in 1186 bytes} [Sun Oct 9 00:42:10 2022] GET /identity/v3/projects/01e5c679ba5842a3830c8b9335e2cb07 => generated 302 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:42:10.690125 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2717f6-31f5-48b1-84f7-ad6baf928155 None None] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:10.690125 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2717f6-31f5-48b1-84f7-ad6baf928155 None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:10.690125 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2717f6-31f5-48b1-84f7-ad6baf928155 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:10.698652 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:10.715465 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.auth.core [None req-6a2717f6-31f5-48b1-84f7-ad6baf928155 None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:42:10.716364 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13b4c00-74c7-481c-b0c8-636a371958a1 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:10.717336 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-6a2717f6-31f5-48b1-84f7-ad6baf928155 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:42:10.766300 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c1805b-af16-4053-8663-2fa5954e87fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:10.766939 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c1805b-af16-4053-8663-2fa5954e87fe None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:10.767209 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c1805b-af16-4053-8663-2fa5954e87fe None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:10.767505 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c1805b-af16-4053-8663-2fa5954e87fe None admin] PATH_INFO: `/v3/groups/8d42d332b621439ea2323e96a92e0d04` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:10.774778 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c1805b-af16-4053-8663-2fa5954e87fe None admin] RBAC: Authorizing `identity:get_group(group_id=8d42d332b621439ea2323e96a92e0d04)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:10.776219 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c1805b-af16-4053-8663-2fa5954e87fe None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:10.778015 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 174/361] 10.222.0.15 () {56 vars in 1180 bytes} [Sun Oct 9 00:42:10 2022] GET /identity/v3/groups/8d42d332b621439ea2323e96a92e0d04 => generated 226 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:42:10.779202 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c1805b-af16-4053-8663-2fa5954e87fe None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:10.799916 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 188/362] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Oct 9 00:42:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 09 00:42:10.801026 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2717f6-31f5-48b1-84f7-ad6baf928155 None None] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:10.832031 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:10.912840 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c1805b-af16-4053-8663-2fa5954e87fe None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:10.923026 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2717f6-31f5-48b1-84f7-ad6baf928155 None None] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:10.957619 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:10.959341 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38205506-141c-463d-8da8-a1744d0263cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:10.960312 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38205506-141c-463d-8da8-a1744d0263cd None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:10.960637 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38205506-141c-463d-8da8-a1744d0263cd None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:10.960883 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38205506-141c-463d-8da8-a1744d0263cd None admin] PATH_INFO: `/v3/projects/3fcf2f5182c445929c38948df6235040` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:10.963469 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38205506-141c-463d-8da8-a1744d0263cd None admin] RBAC: Authorizing `identity:get_project(project_id=3fcf2f5182c445929c38948df6235040)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:10.963901 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38205506-141c-463d-8da8-a1744d0263cd None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:10.965694 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 175/363] 10.222.0.15 () {56 vars in 1186 bytes} [Sun Oct 9 00:42:10 2022] GET /identity/v3/projects/3fcf2f5182c445929c38948df6235040 => generated 298 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:42:10.966013 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ab9055-6c82-4fe1-9bbc-d7df283b28b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:10.966682 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ab9055-6c82-4fe1-9bbc-d7df283b28b8 None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:10.966963 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ab9055-6c82-4fe1-9bbc-d7df283b28b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:10.967237 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ab9055-6c82-4fe1-9bbc-d7df283b28b8 None admin] PATH_INFO: `/v3/groups/8d42d332b621439ea2323e96a92e0d04` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:10.968436 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ab9055-6c82-4fe1-9bbc-d7df283b28b8 None admin] RBAC: Authorizing `identity:get_group(group_id=8d42d332b621439ea2323e96a92e0d04)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:10.969904 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ab9055-6c82-4fe1-9bbc-d7df283b28b8 None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:10.971060 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38205506-141c-463d-8da8-a1744d0263cd None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:10.971726 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 189/364] 10.222.0.15 () {56 vars in 1180 bytes} [Sun Oct 9 00:42:10 2022] GET /identity/v3/groups/8d42d332b621439ea2323e96a92e0d04 => generated 226 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:42:10.972508 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ab9055-6c82-4fe1-9bbc-d7df283b28b8 None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:11.108777 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ab9055-6c82-4fe1-9bbc-d7df283b28b8 None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:11.113994 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38205506-141c-463d-8da8-a1744d0263cd None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:11.127757 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:11.147750 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d747bb27-028c-49d2-8bce-3c9a64e96a41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:11.148519 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d747bb27-028c-49d2-8bce-3c9a64e96a41 None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:11.148800 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d747bb27-028c-49d2-8bce-3c9a64e96a41 None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:11.149093 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d747bb27-028c-49d2-8bce-3c9a64e96a41 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:11.155948 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7564d2-d726-49b3-9081-f7f357488021 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:11.156569 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7564d2-d726-49b3-9081-f7f357488021 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:11.156849 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7564d2-d726-49b3-9081-f7f357488021 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:11.157118 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7564d2-d726-49b3-9081-f7f357488021 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:11.157858 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7564d2-d726-49b3-9081-f7f357488021 None admin] RBAC: Adding query filter params (group.id=8d42d332b621439ea2323e96a92e0d04, role.id=afb0a01183d9497795eaa4fa1a4046ae, scope.project.id=3fcf2f5182c445929c38948df6235040) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:42:11.158161 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7564d2-d726-49b3-9081-f7f357488021 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:11.159645 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7564d2-d726-49b3-9081-f7f357488021 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:11.161151 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d747bb27-028c-49d2-8bce-3c9a64e96a41 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 09 00:42:11.165617 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 176/365] 10.222.0.15 () {56 vars in 1376 bytes} [Sun Oct 9 00:42:10 2022] GET /identity/v3/role_assignments?group.id=8d42d332b621439ea2323e96a92e0d04&scope.project.id=3fcf2f5182c445929c38948df6235040&role.id=afb0a01183d9497795eaa4fa1a4046ae => generated 260 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:42:11.166258 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7564d2-d726-49b3-9081-f7f357488021 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:11.167871 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application [None req-d747bb27-028c-49d2-8bce-3c9a64e96a41 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 09 00:42:11.167871 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:42:11.167871 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:42:11.167871 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:42:11.167871 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:42:11.167871 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:42:11.167871 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:42:11.167871 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:42:11.167871 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:42:11.167871 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:42:11.167871 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:42:11.167871 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:42:11.167871 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 09 00:42:11.167871 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 09 00:42:11.167871 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 09 00:42:11.167871 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 09 00:42:11.168898 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 09 00:42:11.168898 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 09 00:42:11.168898 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 09 00:42:11.168898 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 09 00:42:11.168898 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:42:11.168898 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:42:11.168898 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:42:11.168898 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:42:11.168898 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:42:11.168898 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:42:11.168898 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:42:11.168898 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application with Lock( Oct 09 00:42:11.168898 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:42:11.168898 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:42:11.168898 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:42:11.168898 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:42:11.169953 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:42:11.169953 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:42:11.169953 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:42:11.169953 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:42:11.169953 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 09 00:42:11.169953 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 09 00:42:11.169953 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 09 00:42:11.169953 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 09 00:42:11.169953 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 09 00:42:11.169953 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 09 00:42:11.169953 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 09 00:42:11.169953 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Oct 09 00:42:11.169953 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 190/366] 10.222.0.15 () {56 vars in 1114 bytes} [Sun Oct 9 00:42:10 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:42:11.169953 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d747bb27-028c-49d2-8bce-3c9a64e96a41 None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:11.249401 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:11.301649 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d747bb27-028c-49d2-8bce-3c9a64e96a41 None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:11.309977 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7564d2-d726-49b3-9081-f7f357488021 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:11.353648 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff3a8f4-4fbe-4f95-bcc1-1de93c9b0b8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:11.354067 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff3a8f4-4fbe-4f95-bcc1-1de93c9b0b8f None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:11.354345 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff3a8f4-4fbe-4f95-bcc1-1de93c9b0b8f None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:11.354611 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff3a8f4-4fbe-4f95-bcc1-1de93c9b0b8f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:11.355828 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff3a8f4-4fbe-4f95-bcc1-1de93c9b0b8f None admin] RBAC: Adding query filter params (group.id=8d42d332b621439ea2323e96a92e0d04, role.id=afb0a01183d9497795eaa4fa1a4046ae, scope.project.id=01e5c679ba5842a3830c8b9335e2cb07) {{(pid=81525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:42:11.355828 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff3a8f4-4fbe-4f95-bcc1-1de93c9b0b8f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:11.357189 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff3a8f4-4fbe-4f95-bcc1-1de93c9b0b8f None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:11.364139 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 191/367] 10.222.0.15 () {56 vars in 1376 bytes} [Sun Oct 9 00:42:11 2022] GET /identity/v3/role_assignments?group.id=8d42d332b621439ea2323e96a92e0d04&scope.project.id=01e5c679ba5842a3830c8b9335e2cb07&role.id=afb0a01183d9497795eaa4fa1a4046ae => generated 260 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:42:11.364747 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff3a8f4-4fbe-4f95-bcc1-1de93c9b0b8f None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:11.368579 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0948557-2d5f-4133-952f-b892288609c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:11.369376 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0948557-2d5f-4133-952f-b892288609c3 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:11.369651 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0948557-2d5f-4133-952f-b892288609c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:11.369918 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0948557-2d5f-4133-952f-b892288609c3 None admin] PATH_INFO: `/v3/groups/8d42d332b621439ea2323e96a92e0d04` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:11.371108 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0948557-2d5f-4133-952f-b892288609c3 None admin] RBAC: Authorizing `identity:get_group(group_id=8d42d332b621439ea2323e96a92e0d04)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:11.372656 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0948557-2d5f-4133-952f-b892288609c3 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:11.374672 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 177/368] 10.222.0.15 () {56 vars in 1180 bytes} [Sun Oct 9 00:42:11 2022] GET /identity/v3/groups/8d42d332b621439ea2323e96a92e0d04 => generated 226 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:42:11.380654 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0948557-2d5f-4133-952f-b892288609c3 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:11.445308 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:11.505209 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff3a8f4-4fbe-4f95-bcc1-1de93c9b0b8f None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:11.508554 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0948557-2d5f-4133-952f-b892288609c3 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:11.535234 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:11.546753 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c106164-a3c7-476b-a942-8fb2bc1fbc2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:11.546753 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c106164-a3c7-476b-a942-8fb2bc1fbc2e None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:11.547059 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c106164-a3c7-476b-a942-8fb2bc1fbc2e None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:11.547228 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c106164-a3c7-476b-a942-8fb2bc1fbc2e None admin] PATH_INFO: `/v3/roles` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:11.548136 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c106164-a3c7-476b-a942-8fb2bc1fbc2e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:42:11.548451 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c106164-a3c7-476b-a942-8fb2bc1fbc2e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:11.549964 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c106164-a3c7-476b-a942-8fb2bc1fbc2e None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:11.552955 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fccef2-1543-4539-ba9c-69afc55d2e36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:11.553615 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fccef2-1543-4539-ba9c-69afc55d2e36 None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:11.553889 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fccef2-1543-4539-ba9c-69afc55d2e36 None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:11.554157 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fccef2-1543-4539-ba9c-69afc55d2e36 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:11.563072 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 178/369] 10.222.0.15 () {56 vars in 1111 bytes} [Sun Oct 9 00:42:11 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:42:11.564074 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c106164-a3c7-476b-a942-8fb2bc1fbc2e None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:11.571442 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fccef2-1543-4539-ba9c-69afc55d2e36 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 09 00:42:11.578967 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application [None req-08fccef2-1543-4539-ba9c-69afc55d2e36 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 09 00:42:11.578967 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:42:11.578967 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:42:11.578967 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:42:11.578967 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:42:11.578967 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:42:11.578967 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:42:11.578967 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:42:11.578967 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:42:11.578967 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:42:11.578967 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:42:11.578967 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:42:11.578967 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 09 00:42:11.578967 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 09 00:42:11.578967 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 09 00:42:11.578967 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 09 00:42:11.579963 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 09 00:42:11.579963 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 09 00:42:11.579963 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 09 00:42:11.579963 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 09 00:42:11.579963 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:42:11.579963 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:42:11.579963 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:42:11.579963 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:42:11.579963 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:42:11.579963 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:42:11.579963 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:42:11.579963 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application with Lock( Oct 09 00:42:11.579963 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:42:11.579963 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:42:11.579963 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:42:11.579963 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:42:11.580787 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:42:11.580787 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:42:11.580787 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:42:11.580787 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:42:11.580787 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 09 00:42:11.580787 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 09 00:42:11.580787 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 09 00:42:11.580787 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 09 00:42:11.580787 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 09 00:42:11.580787 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 09 00:42:11.580787 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 09 00:42:11.580787 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Oct 09 00:42:11.584509 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 192/370] 10.222.0.15 () {56 vars in 1096 bytes} [Sun Oct 9 00:42:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:42:11.586002 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fccef2-1543-4539-ba9c-69afc55d2e36 None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:11.702072 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c106164-a3c7-476b-a942-8fb2bc1fbc2e None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:11.704977 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:11.717572 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fccef2-1543-4539-ba9c-69afc55d2e36 None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:11.746051 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5516263e-7e17-4761-bef6-bee26d3d97ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:11.746733 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5516263e-7e17-4761-bef6-bee26d3d97ad None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:11.747012 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5516263e-7e17-4761-bef6-bee26d3d97ad None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:11.747308 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5516263e-7e17-4761-bef6-bee26d3d97ad None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:11.748434 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5516263e-7e17-4761-bef6-bee26d3d97ad None admin] RBAC: Adding query filter params (group.id=8d42d332b621439ea2323e96a92e0d04, role.id=93f141c2a808407dae6f9704941d0cb2, scope.project.id=3fcf2f5182c445929c38948df6235040) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:42:11.749196 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5516263e-7e17-4761-bef6-bee26d3d97ad None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:11.750944 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5516263e-7e17-4761-bef6-bee26d3d97ad None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:11.756877 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086f9728-9a00-4e81-9e8a-66fbb9dd039d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:11.757812 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086f9728-9a00-4e81-9e8a-66fbb9dd039d None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:11.758308 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086f9728-9a00-4e81-9e8a-66fbb9dd039d None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:11.758773 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086f9728-9a00-4e81-9e8a-66fbb9dd039d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:11.763115 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 179/371] 10.222.0.15 () {56 vars in 1376 bytes} [Sun Oct 9 00:42:11 2022] GET /identity/v3/role_assignments?group.id=8d42d332b621439ea2323e96a92e0d04&scope.project.id=3fcf2f5182c445929c38948df6235040&role.id=93f141c2a808407dae6f9704941d0cb2 => generated 260 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:42:11.764228 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5516263e-7e17-4761-bef6-bee26d3d97ad None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:11.879688 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:11.919161 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086f9728-9a00-4e81-9e8a-66fbb9dd039d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:11.924675 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086f9728-9a00-4e81-9e8a-66fbb9dd039d None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:12.005855 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5516263e-7e17-4761-bef6-bee26d3d97ad None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:12.083203 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb9b2c1-94fa-4ab8-af23-91ec15c18ab7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:12.084255 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb9b2c1-94fa-4ab8-af23-91ec15c18ab7 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:12.084704 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb9b2c1-94fa-4ab8-af23-91ec15c18ab7 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:12.085163 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb9b2c1-94fa-4ab8-af23-91ec15c18ab7 None admin] PATH_INFO: `/v3/roles` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:12.088361 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb9b2c1-94fa-4ab8-af23-91ec15c18ab7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:42:12.088868 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb9b2c1-94fa-4ab8-af23-91ec15c18ab7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:12.091231 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb9b2c1-94fa-4ab8-af23-91ec15c18ab7 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:12.123486 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 180/372] 10.222.0.15 () {56 vars in 1099 bytes} [Sun Oct 9 00:42:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 360 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:42:12.133600 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb9b2c1-94fa-4ab8-af23-91ec15c18ab7 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:12.193689 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 193/373] 10.222.0.15 () {58 vars in 1282 bytes} [Sun Oct 9 00:42:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 605 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 09 00:42:12.198664 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086f9728-9a00-4e81-9e8a-66fbb9dd039d None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:12.205928 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:12.293875 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb9b2c1-94fa-4ab8-af23-91ec15c18ab7 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:12.339177 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d60d411-111c-48ad-8ecc-bbe19ded7a4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:12.340810 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d60d411-111c-48ad-8ecc-bbe19ded7a4e None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:12.341102 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d60d411-111c-48ad-8ecc-bbe19ded7a4e None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:12.341378 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d60d411-111c-48ad-8ecc-bbe19ded7a4e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:12.372862 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:12.400212 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086f9728-9a00-4e81-9e8a-66fbb9dd039d None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:12.444495 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d60d411-111c-48ad-8ecc-bbe19ded7a4e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:12.446013 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d60d411-111c-48ad-8ecc-bbe19ded7a4e None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:12.479408 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:12.501715 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fe5fd0-fc54-4db6-ad4e-68ec58a21ac4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:12.502918 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fe5fd0-fc54-4db6-ad4e-68ec58a21ac4 None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:12.503412 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fe5fd0-fc54-4db6-ad4e-68ec58a21ac4 None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:12.503872 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fe5fd0-fc54-4db6-ad4e-68ec58a21ac4 None admin] PATH_INFO: `/v3/projects/01e5c679ba5842a3830c8b9335e2cb07` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:12.506028 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fe5fd0-fc54-4db6-ad4e-68ec58a21ac4 None admin] RBAC: Authorizing `identity:get_project(project_id=01e5c679ba5842a3830c8b9335e2cb07)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:12.508369 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fe5fd0-fc54-4db6-ad4e-68ec58a21ac4 None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:12.516067 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 194/374] 10.222.0.15 () {56 vars in 1186 bytes} [Sun Oct 9 00:42:12 2022] GET /identity/v3/projects/01e5c679ba5842a3830c8b9335e2cb07 => generated 302 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 09 00:42:12.524820 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fe5fd0-fc54-4db6-ad4e-68ec58a21ac4 None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:12.558995 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 181/375] 10.222.0.15 () {58 vars in 1282 bytes} [Sun Oct 9 00:42:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 09 00:42:12.565046 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d60d411-111c-48ad-8ecc-bbe19ded7a4e None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:12.664748 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fe5fd0-fc54-4db6-ad4e-68ec58a21ac4 None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:12.702854 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54913169-fb41-4dfc-a6ec-696a75587be7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:12.703541 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54913169-fb41-4dfc-a6ec-696a75587be7 None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:12.703819 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54913169-fb41-4dfc-a6ec-696a75587be7 None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:12.704153 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54913169-fb41-4dfc-a6ec-696a75587be7 None admin] PATH_INFO: `/v3/groups/8d42d332b621439ea2323e96a92e0d04` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:12.705358 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54913169-fb41-4dfc-a6ec-696a75587be7 None admin] RBAC: Authorizing `identity:get_group(group_id=8d42d332b621439ea2323e96a92e0d04)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:12.706842 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54913169-fb41-4dfc-a6ec-696a75587be7 None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:12.709995 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 195/376] 10.222.0.15 () {56 vars in 1180 bytes} [Sun Oct 9 00:42:12 2022] GET /identity/v3/groups/8d42d332b621439ea2323e96a92e0d04 => generated 226 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:42:12.716188 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54913169-fb41-4dfc-a6ec-696a75587be7 None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:12.754482 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d60d411-111c-48ad-8ecc-bbe19ded7a4e None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:12.775063 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:12.799844 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:12.805076 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f838621-8b27-4ded-b5de-322596e192aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:12.805929 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f838621-8b27-4ded-b5de-322596e192aa None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:12.806302 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f838621-8b27-4ded-b5de-322596e192aa None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:12.806741 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f838621-8b27-4ded-b5de-322596e192aa None admin] PATH_INFO: `/v3/projects/4024dc4bc9484e24953f0b564215ab2a` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:12.808209 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f838621-8b27-4ded-b5de-322596e192aa None admin] RBAC: Authorizing `identity:get_project(project_id=4024dc4bc9484e24953f0b564215ab2a)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:12.809769 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f838621-8b27-4ded-b5de-322596e192aa None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:12.814548 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 182/377] 10.222.0.15 () {56 vars in 1186 bytes} [Sun Oct 9 00:42:12 2022] GET /identity/v3/projects/4024dc4bc9484e24953f0b564215ab2a => generated 344 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 09 00:42:12.819902 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f838621-8b27-4ded-b5de-322596e192aa None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:12.942220 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f838621-8b27-4ded-b5de-322596e192aa None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:12.986781 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b3ffe0-b94b-4e91-9038-2ad608773988 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:12.987558 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b3ffe0-b94b-4e91-9038-2ad608773988 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:12.989653 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b3ffe0-b94b-4e91-9038-2ad608773988 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:12.989962 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b3ffe0-b94b-4e91-9038-2ad608773988 None admin] PATH_INFO: `/v3/groups/bfd589775c1842f4aaf9e1e51f657fbe` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:12.995472 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b3ffe0-b94b-4e91-9038-2ad608773988 None admin] RBAC: Authorizing `identity:get_group(group_id=bfd589775c1842f4aaf9e1e51f657fbe)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:12.996945 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b3ffe0-b94b-4e91-9038-2ad608773988 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:12.997234 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54913169-fb41-4dfc-a6ec-696a75587be7 None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:12.999643 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 183/378] 10.222.0.15 () {56 vars in 1180 bytes} [Sun Oct 9 00:42:12 2022] GET /identity/v3/groups/bfd589775c1842f4aaf9e1e51f657fbe => generated 229 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:42:13.005114 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b3ffe0-b94b-4e91-9038-2ad608773988 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:13.058841 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3933f054-fa14-42de-b7f6-d5b7c7bd54aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:13.059493 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3933f054-fa14-42de-b7f6-d5b7c7bd54aa None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:13.059768 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3933f054-fa14-42de-b7f6-d5b7c7bd54aa None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:13.060238 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3933f054-fa14-42de-b7f6-d5b7c7bd54aa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:13.060921 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3933f054-fa14-42de-b7f6-d5b7c7bd54aa None admin] RBAC: Adding query filter params (group.id=8d42d332b621439ea2323e96a92e0d04, role.id=93f141c2a808407dae6f9704941d0cb2, scope.project.id=01e5c679ba5842a3830c8b9335e2cb07) {{(pid=81525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:42:13.061333 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3933f054-fa14-42de-b7f6-d5b7c7bd54aa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:13.062909 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3933f054-fa14-42de-b7f6-d5b7c7bd54aa None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:13.072077 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 196/379] 10.222.0.15 () {56 vars in 1376 bytes} [Sun Oct 9 00:42:12 2022] GET /identity/v3/role_assignments?group.id=8d42d332b621439ea2323e96a92e0d04&scope.project.id=01e5c679ba5842a3830c8b9335e2cb07&role.id=93f141c2a808407dae6f9704941d0cb2 => generated 260 bytes in 356 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 09 00:42:13.076338 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:13.122726 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b3ffe0-b94b-4e91-9038-2ad608773988 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:13.161348 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bc9050-8364-492e-8690-dd180c57c0e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:13.161972 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bc9050-8364-492e-8690-dd180c57c0e1 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:13.162248 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bc9050-8364-492e-8690-dd180c57c0e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:13.162518 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bc9050-8364-492e-8690-dd180c57c0e1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:13.163296 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bc9050-8364-492e-8690-dd180c57c0e1 None admin] RBAC: Adding query filter params (group.id=bfd589775c1842f4aaf9e1e51f657fbe, role.id=f69dddf26daf4dd79d4c962beb877af5, scope.project.id=4024dc4bc9484e24953f0b564215ab2a) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:42:13.163595 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bc9050-8364-492e-8690-dd180c57c0e1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:13.165061 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bc9050-8364-492e-8690-dd180c57c0e1 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:13.172076 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 184/380] 10.222.0.15 () {56 vars in 1376 bytes} [Sun Oct 9 00:42:13 2022] GET /identity/v3/role_assignments?group.id=bfd589775c1842f4aaf9e1e51f657fbe&scope.project.id=4024dc4bc9484e24953f0b564215ab2a&role.id=f69dddf26daf4dd79d4c962beb877af5 => generated 260 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:42:14.192225 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58843eb2-43bf-4e9c-a894-7107d1ef0a11 None None] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:14.193273 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58843eb2-43bf-4e9c-a894-7107d1ef0a11 None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:14.193784 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58843eb2-43bf-4e9c-a894-7107d1ef0a11 None None] PATH_INFO: `/` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:14.195940 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 197/381] 10.222.0.15 () {54 vars in 927 bytes} [Sun Oct 9 00:42:14 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:42:14.201384 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8ee0b2-f075-45e8-b69a-0e69c07e9951 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:14.201842 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8ee0b2-f075-45e8-b69a-0e69c07e9951 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:14.201914 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8ee0b2-f075-45e8-b69a-0e69c07e9951 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:14.226143 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-9c8ee0b2-f075-45e8-b69a-0e69c07e9951 None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:42:14.227429 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-9c8ee0b2-f075-45e8-b69a-0e69c07e9951 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:42:14.281731 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b6f3cd-b8d9-433d-9175-e84ca0eac264 None None] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:14.282347 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b6f3cd-b8d9-433d-9175-e84ca0eac264 None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:14.282804 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b6f3cd-b8d9-433d-9175-e84ca0eac264 None None] PATH_INFO: `/` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:14.284642 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 198/382] 10.222.0.15 () {54 vars in 927 bytes} [Sun Oct 9 00:42:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:42:14.293667 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d3c480-88c4-4c48-bf11-338f0da689f0 None None] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:14.294221 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d3c480-88c4-4c48-bf11-338f0da689f0 None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:14.294662 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d3c480-88c4-4c48-bf11-338f0da689f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:14.327030 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.auth.core [None req-19d3c480-88c4-4c48-bf11-338f0da689f0 None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:42:14.329663 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-19d3c480-88c4-4c48-bf11-338f0da689f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:42:14.335547 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 185/383] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Oct 9 00:42:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 09 00:42:14.404720 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 199/384] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Oct 9 00:42:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 09 00:42:14.672576 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8ee0b2-f075-45e8-b69a-0e69c07e9951 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:14.710534 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d3c480-88c4-4c48-bf11-338f0da689f0 None None] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:14.734021 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:14.743827 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:14.818742 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8ee0b2-f075-45e8-b69a-0e69c07e9951 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:14.846221 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d3c480-88c4-4c48-bf11-338f0da689f0 None None] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:14.854310 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0686d43-f83d-487f-977d-0dcd0911cdd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:14.855315 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0686d43-f83d-487f-977d-0dcd0911cdd1 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:14.855904 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0686d43-f83d-487f-977d-0dcd0911cdd1 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:14.856419 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0686d43-f83d-487f-977d-0dcd0911cdd1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:14.867877 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0686d43-f83d-487f-977d-0dcd0911cdd1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 09 00:42:14.873196 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application [None req-b0686d43-f83d-487f-977d-0dcd0911cdd1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 09 00:42:14.873196 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:42:14.873196 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:42:14.873196 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:42:14.873196 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:42:14.873196 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:42:14.873196 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:42:14.873196 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:42:14.873196 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:42:14.873196 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:42:14.873196 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:42:14.873196 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:42:14.873196 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 09 00:42:14.873196 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 09 00:42:14.873196 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 09 00:42:14.873196 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 09 00:42:14.874441 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 09 00:42:14.874441 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 09 00:42:14.874441 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 09 00:42:14.874441 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 09 00:42:14.874441 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:42:14.874441 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:42:14.874441 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:42:14.874441 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:42:14.874441 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:42:14.874441 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:42:14.874441 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:42:14.874441 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application with Lock( Oct 09 00:42:14.874441 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:42:14.874441 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:42:14.874441 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:42:14.874441 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:42:14.875277 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:42:14.875277 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:42:14.875277 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:42:14.875277 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:42:14.875277 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 09 00:42:14.875277 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 09 00:42:14.875277 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 09 00:42:14.875277 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 09 00:42:14.875277 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 09 00:42:14.875277 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 09 00:42:14.875277 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 09 00:42:14.875277 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application Oct 09 00:42:14.877443 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 186/385] 10.222.0.15 () {56 vars in 1099 bytes} [Sun Oct 9 00:42:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:42:14.878877 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90964d14-adb8-4247-a035-64099e393ca2 None None] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:14.879421 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90964d14-adb8-4247-a035-64099e393ca2 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:14.879886 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90964d14-adb8-4247-a035-64099e393ca2 None None] PATH_INFO: `/` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:14.881343 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 187/386] 10.222.0.15 () {54 vars in 927 bytes} [Sun Oct 9 00:42:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:42:14.887455 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90964d14-adb8-4247-a035-64099e393ca2 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:14.891194 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71db96d-0742-4ba7-8325-d79c26ca20e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:14.891878 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71db96d-0742-4ba7-8325-d79c26ca20e2 None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:14.892156 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71db96d-0742-4ba7-8325-d79c26ca20e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:14.892442 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71db96d-0742-4ba7-8325-d79c26ca20e2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:14.905946 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71db96d-0742-4ba7-8325-d79c26ca20e2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 09 00:42:14.912635 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application [None req-e71db96d-0742-4ba7-8325-d79c26ca20e2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 09 00:42:14.912635 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:42:14.912635 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:42:14.912635 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:42:14.912635 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:42:14.912635 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:42:14.912635 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:42:14.912635 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:42:14.912635 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:42:14.912635 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:42:14.912635 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:42:14.912635 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:42:14.912635 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 09 00:42:14.912635 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 09 00:42:14.912635 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 09 00:42:14.912635 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 09 00:42:14.913522 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 09 00:42:14.913522 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 09 00:42:14.913522 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 09 00:42:14.913522 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 09 00:42:14.913522 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:42:14.913522 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:42:14.913522 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:42:14.913522 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:42:14.913522 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:42:14.913522 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:42:14.913522 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:42:14.913522 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application with Lock( Oct 09 00:42:14.913522 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:42:14.913522 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:42:14.913522 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:42:14.913522 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:42:14.914336 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:42:14.914336 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:42:14.914336 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:42:14.914336 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:42:14.914336 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 09 00:42:14.914336 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 09 00:42:14.914336 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 09 00:42:14.914336 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 09 00:42:14.914336 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 09 00:42:14.914336 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 09 00:42:14.914336 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 09 00:42:14.914336 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Oct 09 00:42:14.914336 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 200/387] 10.222.0.15 () {56 vars in 1099 bytes} [Sun Oct 9 00:42:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:42:14.915628 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660f9ae9-d52f-45ed-ad69-2a1ec13ebbdc None None] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:14.915749 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660f9ae9-d52f-45ed-ad69-2a1ec13ebbdc None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:14.916010 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660f9ae9-d52f-45ed-ad69-2a1ec13ebbdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:14.937843 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.auth.core [None req-660f9ae9-d52f-45ed-ad69-2a1ec13ebbdc None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:42:14.938982 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-660f9ae9-d52f-45ed-ad69-2a1ec13ebbdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:42:15.006539 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90964d14-adb8-4247-a035-64099e393ca2 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:15.019890 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 201/388] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Oct 9 00:42:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 09 00:42:15.019890 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660f9ae9-d52f-45ed-ad69-2a1ec13ebbdc None None] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:15.037525 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:15.039622 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:15.073252 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6dde06-5b65-4c86-82b7-b62323b6f1d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:15.075971 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6dde06-5b65-4c86-82b7-b62323b6f1d0 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:15.076256 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6dde06-5b65-4c86-82b7-b62323b6f1d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:15.076530 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6dde06-5b65-4c86-82b7-b62323b6f1d0 None admin] PATH_INFO: `/v3/roles` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:15.078227 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6dde06-5b65-4c86-82b7-b62323b6f1d0 None admin] RBAC: Adding query filter params (name=member) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:42:15.078538 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6dde06-5b65-4c86-82b7-b62323b6f1d0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:15.079954 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6dde06-5b65-4c86-82b7-b62323b6f1d0 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:15.100192 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 188/389] 10.222.0.15 () {56 vars in 1101 bytes} [Sun Oct 9 00:42:14 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 09 00:42:15.120655 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6dde06-5b65-4c86-82b7-b62323b6f1d0 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:15.207940 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660f9ae9-d52f-45ed-ad69-2a1ec13ebbdc None None] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:15.252574 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418856aa-5ffc-46dd-bd9b-32f1ee2c5389 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:15.253408 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418856aa-5ffc-46dd-bd9b-32f1ee2c5389 None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:15.253686 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418856aa-5ffc-46dd-bd9b-32f1ee2c5389 None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:15.253956 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418856aa-5ffc-46dd-bd9b-32f1ee2c5389 None admin] PATH_INFO: `/v3/roles` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:15.254634 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418856aa-5ffc-46dd-bd9b-32f1ee2c5389 None admin] RBAC: Adding query filter params (name=member) {{(pid=81525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:42:15.254939 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418856aa-5ffc-46dd-bd9b-32f1ee2c5389 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:15.257906 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418856aa-5ffc-46dd-bd9b-32f1ee2c5389 None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:15.276447 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 202/390] 10.222.0.15 () {56 vars in 1101 bytes} [Sun Oct 9 00:42:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:42:15.281893 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418856aa-5ffc-46dd-bd9b-32f1ee2c5389 None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:15.322645 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6dde06-5b65-4c86-82b7-b62323b6f1d0 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:15.359439 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7517e3-aced-4698-a57e-7f5d9b19af7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:15.360482 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7517e3-aced-4698-a57e-7f5d9b19af7d None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:15.361000 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7517e3-aced-4698-a57e-7f5d9b19af7d None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:15.361463 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7517e3-aced-4698-a57e-7f5d9b19af7d None admin] PATH_INFO: `/v3/groups/8d42d332b621439ea2323e96a92e0d04` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:15.362798 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7517e3-aced-4698-a57e-7f5d9b19af7d None admin] RBAC: Authorizing `identity:get_group(group_id=8d42d332b621439ea2323e96a92e0d04)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:15.364481 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7517e3-aced-4698-a57e-7f5d9b19af7d None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:15.366573 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 189/391] 10.222.0.15 () {56 vars in 1180 bytes} [Sun Oct 9 00:42:15 2022] GET /identity/v3/groups/8d42d332b621439ea2323e96a92e0d04 => generated 226 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 09 00:42:15.367675 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7517e3-aced-4698-a57e-7f5d9b19af7d None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:15.379645 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:15.417437 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:15.418554 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418856aa-5ffc-46dd-bd9b-32f1ee2c5389 None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:15.454749 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed009ae-9900-4b8b-86fc-1d10277858b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:15.455445 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed009ae-9900-4b8b-86fc-1d10277858b1 None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:15.455715 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed009ae-9900-4b8b-86fc-1d10277858b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:15.455984 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed009ae-9900-4b8b-86fc-1d10277858b1 None admin] PATH_INFO: `/v3/groups/8d42d332b621439ea2323e96a92e0d04` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:15.457588 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed009ae-9900-4b8b-86fc-1d10277858b1 None admin] RBAC: Authorizing `identity:get_group(group_id=8d42d332b621439ea2323e96a92e0d04)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:15.458830 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed009ae-9900-4b8b-86fc-1d10277858b1 None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:15.460870 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 203/392] 10.222.0.15 () {56 vars in 1180 bytes} [Sun Oct 9 00:42:15 2022] GET /identity/v3/groups/8d42d332b621439ea2323e96a92e0d04 => generated 226 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:42:15.461924 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed009ae-9900-4b8b-86fc-1d10277858b1 None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:15.484764 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7517e3-aced-4698-a57e-7f5d9b19af7d None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:15.520430 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da626373-1254-43d9-ba1a-3f458866fb76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:15.521451 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da626373-1254-43d9-ba1a-3f458866fb76 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:15.521953 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da626373-1254-43d9-ba1a-3f458866fb76 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:15.522420 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da626373-1254-43d9-ba1a-3f458866fb76 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:15.533808 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da626373-1254-43d9-ba1a-3f458866fb76 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 09 00:42:15.539707 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application [None req-da626373-1254-43d9-ba1a-3f458866fb76 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 09 00:42:15.539707 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:42:15.539707 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:42:15.539707 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:42:15.539707 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:42:15.539707 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:42:15.539707 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:42:15.539707 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:42:15.539707 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:42:15.539707 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:42:15.539707 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:42:15.539707 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:42:15.539707 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 09 00:42:15.539707 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 09 00:42:15.539707 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 09 00:42:15.539707 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 09 00:42:15.540622 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 09 00:42:15.540622 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 09 00:42:15.540622 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 09 00:42:15.540622 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 09 00:42:15.540622 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:42:15.540622 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:42:15.540622 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:42:15.540622 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:42:15.540622 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:42:15.540622 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:42:15.540622 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:42:15.540622 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application with Lock( Oct 09 00:42:15.540622 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:42:15.540622 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:42:15.540622 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:42:15.540622 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:42:15.541434 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:42:15.541434 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:42:15.541434 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:42:15.541434 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:42:15.541434 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 09 00:42:15.541434 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 09 00:42:15.541434 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 09 00:42:15.541434 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 09 00:42:15.541434 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 09 00:42:15.541434 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 09 00:42:15.541434 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 09 00:42:15.541434 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application Oct 09 00:42:15.543853 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 190/393] 10.222.0.15 () {56 vars in 1114 bytes} [Sun Oct 9 00:42:15 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:42:15.548586 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da626373-1254-43d9-ba1a-3f458866fb76 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:15.570173 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed009ae-9900-4b8b-86fc-1d10277858b1 None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:15.607372 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a926df-71ee-4823-87a5-6029039ade28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:15.608018 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a926df-71ee-4823-87a5-6029039ade28 None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:15.608298 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a926df-71ee-4823-87a5-6029039ade28 None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:15.608617 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a926df-71ee-4823-87a5-6029039ade28 None admin] PATH_INFO: `/v3/projects/01e5c679ba5842a3830c8b9335e2cb07` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:15.610047 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a926df-71ee-4823-87a5-6029039ade28 None admin] RBAC: Authorizing `identity:get_project(project_id=01e5c679ba5842a3830c8b9335e2cb07)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:15.611449 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a926df-71ee-4823-87a5-6029039ade28 None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:15.618050 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 204/394] 10.222.0.15 () {56 vars in 1186 bytes} [Sun Oct 9 00:42:15 2022] GET /identity/v3/projects/01e5c679ba5842a3830c8b9335e2cb07 => generated 302 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:42:15.618989 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a926df-71ee-4823-87a5-6029039ade28 None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:15.623625 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:15.660912 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da626373-1254-43d9-ba1a-3f458866fb76 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:15.668674 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:15.700224 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e552a8fc-2758-4555-ba31-f6723fc2eebf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:15.700894 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e552a8fc-2758-4555-ba31-f6723fc2eebf None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:15.701174 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e552a8fc-2758-4555-ba31-f6723fc2eebf None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:15.701448 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e552a8fc-2758-4555-ba31-f6723fc2eebf None admin] PATH_INFO: `/v3/projects/3fcf2f5182c445929c38948df6235040` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:15.702699 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e552a8fc-2758-4555-ba31-f6723fc2eebf None admin] RBAC: Authorizing `identity:get_project(project_id=3fcf2f5182c445929c38948df6235040)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:15.704242 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e552a8fc-2758-4555-ba31-f6723fc2eebf None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:15.706160 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 191/395] 10.222.0.15 () {56 vars in 1186 bytes} [Sun Oct 9 00:42:15 2022] GET /identity/v3/projects/3fcf2f5182c445929c38948df6235040 => generated 298 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:42:15.706847 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e552a8fc-2758-4555-ba31-f6723fc2eebf None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:15.740401 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a926df-71ee-4823-87a5-6029039ade28 None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:15.777963 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59017d48-7134-4b8f-a6de-bab8f973a4dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:15.778580 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59017d48-7134-4b8f-a6de-bab8f973a4dc None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:15.778863 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59017d48-7134-4b8f-a6de-bab8f973a4dc None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:15.779114 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59017d48-7134-4b8f-a6de-bab8f973a4dc None admin] PATH_INFO: `/v3/roles` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:15.779878 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59017d48-7134-4b8f-a6de-bab8f973a4dc None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:42:15.780108 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59017d48-7134-4b8f-a6de-bab8f973a4dc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:15.781609 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59017d48-7134-4b8f-a6de-bab8f973a4dc None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:15.795199 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 205/396] 10.222.0.15 () {56 vars in 1111 bytes} [Sun Oct 9 00:42:15 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:42:15.795199 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3019574f-d315-4d47-9835-9673d49bd7e7 None None] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:15.795199 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3019574f-d315-4d47-9835-9673d49bd7e7 None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:15.795199 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3019574f-d315-4d47-9835-9673d49bd7e7 None None] PATH_INFO: `/` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:15.795199 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 206/397] 10.222.0.15 () {54 vars in 927 bytes} [Sun Oct 9 00:42:15 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:42:15.795199 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3019574f-d315-4d47-9835-9673d49bd7e7 None None] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:15.821818 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e552a8fc-2758-4555-ba31-f6723fc2eebf None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:15.855082 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5331f0ec-ab68-4a80-bc92-f04f52f78961 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:15.855490 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:15.855775 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5331f0ec-ab68-4a80-bc92-f04f52f78961 None admin] REQUEST_METHOD: `PUT` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:15.856053 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5331f0ec-ab68-4a80-bc92-f04f52f78961 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:15.856336 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5331f0ec-ab68-4a80-bc92-f04f52f78961 None admin] PATH_INFO: `/v3/projects/01e5c679ba5842a3830c8b9335e2cb07/groups/8d42d332b621439ea2323e96a92e0d04/roles/afb0a01183d9497795eaa4fa1a4046ae` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:15.858402 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5331f0ec-ab68-4a80-bc92-f04f52f78961 None admin] RBAC: Authorizing `identity:create_grant(project_id=01e5c679ba5842a3830c8b9335e2cb07, group_id=8d42d332b621439ea2323e96a92e0d04, role_id=afb0a01183d9497795eaa4fa1a4046ae)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:15.859910 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5331f0ec-ab68-4a80-bc92-f04f52f78961 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:15.873213 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 192/398] 10.222.0.15 () {58 vars in 1442 bytes} [Sun Oct 9 00:42:15 2022] PUT /identity/v3/projects/01e5c679ba5842a3830c8b9335e2cb07/groups/8d42d332b621439ea2323e96a92e0d04/roles/afb0a01183d9497795eaa4fa1a4046ae => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 00:42:15.874366 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5331f0ec-ab68-4a80-bc92-f04f52f78961 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:15.898262 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3019574f-d315-4d47-9835-9673d49bd7e7 None None] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:15.916925 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:15.940383 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e78063-c608-46ec-84c8-bd9af5433be6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:15.941081 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e78063-c608-46ec-84c8-bd9af5433be6 None admin] REQUEST_METHOD: `PUT` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:15.941354 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e78063-c608-46ec-84c8-bd9af5433be6 None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:15.941620 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e78063-c608-46ec-84c8-bd9af5433be6 None admin] PATH_INFO: `/v3/projects/3fcf2f5182c445929c38948df6235040/groups/8d42d332b621439ea2323e96a92e0d04/roles/afb0a01183d9497795eaa4fa1a4046ae` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:15.943671 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e78063-c608-46ec-84c8-bd9af5433be6 None admin] RBAC: Authorizing `identity:create_grant(project_id=3fcf2f5182c445929c38948df6235040, group_id=8d42d332b621439ea2323e96a92e0d04, role_id=afb0a01183d9497795eaa4fa1a4046ae)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:15.945177 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e78063-c608-46ec-84c8-bd9af5433be6 None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:15.967293 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 207/399] 10.222.0.15 () {58 vars in 1442 bytes} [Sun Oct 9 00:42:15 2022] PUT /identity/v3/projects/3fcf2f5182c445929c38948df6235040/groups/8d42d332b621439ea2323e96a92e0d04/roles/afb0a01183d9497795eaa4fa1a4046ae => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 00:42:15.967293 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b751ef30-340d-4037-b870-d8603236ace6 None None] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:15.967293 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b751ef30-340d-4037-b870-d8603236ace6 None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:15.967293 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b751ef30-340d-4037-b870-d8603236ace6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:15.981424 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.auth.core [None req-b751ef30-340d-4037-b870-d8603236ace6 None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:42:15.982701 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-b751ef30-340d-4037-b870-d8603236ace6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:42:16.017566 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5331f0ec-ab68-4a80-bc92-f04f52f78961 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:16.063796 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be06dc1e-a854-47ae-87de-a2fa5a1e4cec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:16.064863 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be06dc1e-a854-47ae-87de-a2fa5a1e4cec None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:16.065335 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be06dc1e-a854-47ae-87de-a2fa5a1e4cec None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:16.065818 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be06dc1e-a854-47ae-87de-a2fa5a1e4cec None admin] PATH_INFO: `/v3/groups/8d42d332b621439ea2323e96a92e0d04` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:16.068023 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be06dc1e-a854-47ae-87de-a2fa5a1e4cec None admin] RBAC: Authorizing `identity:get_group(group_id=8d42d332b621439ea2323e96a92e0d04)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:16.075515 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 208/400] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Oct 9 00:42:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 09 00:42:16.075718 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be06dc1e-a854-47ae-87de-a2fa5a1e4cec None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:16.075798 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0586c58f-79fd-4c47-a85f-816b9915762a None None] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:16.075798 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0586c58f-79fd-4c47-a85f-816b9915762a None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:16.075798 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0586c58f-79fd-4c47-a85f-816b9915762a None None] PATH_INFO: `/` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:16.075991 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 193/401] 10.222.0.15 () {56 vars in 1180 bytes} [Sun Oct 9 00:42:15 2022] GET /identity/v3/groups/8d42d332b621439ea2323e96a92e0d04 => generated 226 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:42:16.076059 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 209/402] 10.222.0.15 () {54 vars in 927 bytes} [Sun Oct 9 00:42:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:42:16.078436 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ecc94d-e35b-4838-b358-a8b60c4ef167 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:16.078775 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ecc94d-e35b-4838-b358-a8b60c4ef167 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:16.079046 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ecc94d-e35b-4838-b358-a8b60c4ef167 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:16.081781 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0586c58f-79fd-4c47-a85f-816b9915762a None None] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:16.105055 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-53ecc94d-e35b-4838-b358-a8b60c4ef167 None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:42:16.106407 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-53ecc94d-e35b-4838-b358-a8b60c4ef167 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:42:16.152635 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:16.190544 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 194/403] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Oct 9 00:42:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 09 00:42:16.206934 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0586c58f-79fd-4c47-a85f-816b9915762a None None] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:16.244474 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3730ccbf-0f65-457d-b2f3-fbf2cd4a94c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:16.246027 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3730ccbf-0f65-457d-b2f3-fbf2cd4a94c4 None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:16.246521 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3730ccbf-0f65-457d-b2f3-fbf2cd4a94c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:16.246987 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3730ccbf-0f65-457d-b2f3-fbf2cd4a94c4 None admin] PATH_INFO: `/v3/projects/3fcf2f5182c445929c38948df6235040` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:16.248442 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3730ccbf-0f65-457d-b2f3-fbf2cd4a94c4 None admin] RBAC: Authorizing `identity:get_project(project_id=3fcf2f5182c445929c38948df6235040)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:16.250500 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3730ccbf-0f65-457d-b2f3-fbf2cd4a94c4 None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:16.252718 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 210/404] 10.222.0.15 () {56 vars in 1186 bytes} [Sun Oct 9 00:42:16 2022] GET /identity/v3/projects/3fcf2f5182c445929c38948df6235040 => generated 298 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 09 00:42:16.258766 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ecc94d-e35b-4838-b358-a8b60c4ef167 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:16.292044 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:16.368684 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3730ccbf-0f65-457d-b2f3-fbf2cd4a94c4 None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:16.377352 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ecc94d-e35b-4838-b358-a8b60c4ef167 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:16.413274 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6108663-55d6-4b20-9d04-d5221f673469 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:16.413950 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6108663-55d6-4b20-9d04-d5221f673469 None admin] REQUEST_METHOD: `PUT` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:16.414273 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6108663-55d6-4b20-9d04-d5221f673469 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:16.414551 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6108663-55d6-4b20-9d04-d5221f673469 None admin] PATH_INFO: `/v3/projects/3fcf2f5182c445929c38948df6235040/groups/8d42d332b621439ea2323e96a92e0d04/roles/93f141c2a808407dae6f9704941d0cb2` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:16.416826 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6108663-55d6-4b20-9d04-d5221f673469 None admin] RBAC: Authorizing `identity:create_grant(project_id=3fcf2f5182c445929c38948df6235040, group_id=8d42d332b621439ea2323e96a92e0d04, role_id=93f141c2a808407dae6f9704941d0cb2)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:16.418290 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6108663-55d6-4b20-9d04-d5221f673469 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:16.446062 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 195/405] 10.222.0.15 () {58 vars in 1442 bytes} [Sun Oct 9 00:42:16 2022] PUT /identity/v3/projects/3fcf2f5182c445929c38948df6235040/groups/8d42d332b621439ea2323e96a92e0d04/roles/93f141c2a808407dae6f9704941d0cb2 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 00:42:16.531045 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6108663-55d6-4b20-9d04-d5221f673469 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:16.541609 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3730ccbf-0f65-457d-b2f3-fbf2cd4a94c4 None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:16.577302 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:16.595523 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896824f0-c611-4aa8-beb0-06edcf9cf8e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:16.598249 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896824f0-c611-4aa8-beb0-06edcf9cf8e2 None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:16.598551 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896824f0-c611-4aa8-beb0-06edcf9cf8e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:16.598912 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896824f0-c611-4aa8-beb0-06edcf9cf8e2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:16.626638 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896824f0-c611-4aa8-beb0-06edcf9cf8e2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 09 00:42:16.640014 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application [None req-896824f0-c611-4aa8-beb0-06edcf9cf8e2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 09 00:42:16.640014 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:42:16.640014 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:42:16.640014 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:42:16.640014 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:42:16.640014 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:42:16.640014 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:42:16.640014 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:42:16.640014 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:42:16.640014 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:42:16.640014 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:42:16.640014 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:42:16.640014 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 09 00:42:16.640014 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 09 00:42:16.640014 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 09 00:42:16.640014 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 09 00:42:16.640995 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 09 00:42:16.640995 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 09 00:42:16.640995 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 09 00:42:16.640995 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 09 00:42:16.640995 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:42:16.640995 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:42:16.640995 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:42:16.640995 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:42:16.640995 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:42:16.640995 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:42:16.640995 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:42:16.640995 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application with Lock( Oct 09 00:42:16.640995 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:42:16.640995 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:42:16.640995 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:42:16.640995 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:42:16.641763 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:42:16.641763 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:42:16.641763 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:42:16.641763 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:42:16.641763 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 09 00:42:16.641763 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 09 00:42:16.641763 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 09 00:42:16.641763 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 09 00:42:16.641763 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 09 00:42:16.641763 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 09 00:42:16.641763 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 09 00:42:16.641763 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Oct 09 00:42:16.641763 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 211/406] 10.222.0.15 () {56 vars in 1114 bytes} [Sun Oct 9 00:42:16 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 09 00:42:16.647571 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896824f0-c611-4aa8-beb0-06edcf9cf8e2 None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:16.679623 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:16.691033 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6108663-55d6-4b20-9d04-d5221f673469 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:16.736381 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927c093a-4451-471d-8514-20dce7b1baa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:16.737024 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927c093a-4451-471d-8514-20dce7b1baa9 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:16.737301 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927c093a-4451-471d-8514-20dce7b1baa9 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:16.737570 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927c093a-4451-471d-8514-20dce7b1baa9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:16.749294 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927c093a-4451-471d-8514-20dce7b1baa9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 09 00:42:16.754197 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application [None req-927c093a-4451-471d-8514-20dce7b1baa9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 09 00:42:16.754197 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:42:16.754197 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:42:16.754197 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:42:16.754197 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:42:16.754197 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:42:16.754197 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:42:16.754197 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:42:16.754197 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:42:16.754197 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:42:16.754197 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:42:16.754197 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:42:16.754197 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 09 00:42:16.754197 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 09 00:42:16.754197 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 09 00:42:16.754197 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 09 00:42:16.755098 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 09 00:42:16.755098 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 09 00:42:16.755098 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 09 00:42:16.755098 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 09 00:42:16.755098 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:42:16.755098 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:42:16.755098 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:42:16.755098 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:42:16.755098 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:42:16.755098 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:42:16.755098 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:42:16.755098 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application with Lock( Oct 09 00:42:16.755098 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:42:16.755098 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:42:16.755098 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:42:16.755098 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:42:16.755893 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:42:16.755893 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:42:16.755893 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:42:16.755893 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:42:16.755893 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 09 00:42:16.755893 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 09 00:42:16.755893 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 09 00:42:16.755893 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 09 00:42:16.755893 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 09 00:42:16.755893 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 09 00:42:16.755893 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 09 00:42:16.755893 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application Oct 09 00:42:16.756485 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 196/407] 10.222.0.15 () {56 vars in 1096 bytes} [Sun Oct 9 00:42:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 09 00:42:16.763366 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927c093a-4451-471d-8514-20dce7b1baa9 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:16.780071 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896824f0-c611-4aa8-beb0-06edcf9cf8e2 None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:16.823396 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6fb3c7-258b-45c1-b80c-c113be048212 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:16.824357 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6fb3c7-258b-45c1-b80c-c113be048212 None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:16.824643 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6fb3c7-258b-45c1-b80c-c113be048212 None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:16.825189 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6fb3c7-258b-45c1-b80c-c113be048212 None admin] PATH_INFO: `/v3/roles` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:16.825872 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6fb3c7-258b-45c1-b80c-c113be048212 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:42:16.826331 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6fb3c7-258b-45c1-b80c-c113be048212 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:16.828428 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6fb3c7-258b-45c1-b80c-c113be048212 None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:16.839851 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 212/408] 10.222.0.15 () {56 vars in 1111 bytes} [Sun Oct 9 00:42:16 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 09 00:42:16.848680 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6fb3c7-258b-45c1-b80c-c113be048212 None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:16.901989 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927c093a-4451-471d-8514-20dce7b1baa9 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:16.926304 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:16.964896 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300a2e29-f385-4a39-a887-bde686b55d53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:16.965537 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300a2e29-f385-4a39-a887-bde686b55d53 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:16.965809 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300a2e29-f385-4a39-a887-bde686b55d53 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:16.966075 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300a2e29-f385-4a39-a887-bde686b55d53 None admin] PATH_INFO: `/v3/roles` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:16.966759 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300a2e29-f385-4a39-a887-bde686b55d53 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:42:16.967055 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300a2e29-f385-4a39-a887-bde686b55d53 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:16.970281 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300a2e29-f385-4a39-a887-bde686b55d53 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:16.992035 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 197/409] 10.222.0.15 () {56 vars in 1099 bytes} [Sun Oct 9 00:42:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:42:16.995977 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300a2e29-f385-4a39-a887-bde686b55d53 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:17.024859 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:17.031112 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6fb3c7-258b-45c1-b80c-c113be048212 None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:17.137925 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45daaf78-d0e1-45e0-833e-8035734898ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:17.138424 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45daaf78-d0e1-45e0-833e-8035734898ca None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:17.138697 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45daaf78-d0e1-45e0-833e-8035734898ca None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:17.138962 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45daaf78-d0e1-45e0-833e-8035734898ca None admin] PATH_INFO: `/v3/groups/8d42d332b621439ea2323e96a92e0d04` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:17.147284 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45daaf78-d0e1-45e0-833e-8035734898ca None admin] RBAC: Authorizing `identity:get_group(group_id=8d42d332b621439ea2323e96a92e0d04)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:17.147284 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45daaf78-d0e1-45e0-833e-8035734898ca None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:17.153559 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 213/410] 10.222.0.15 () {56 vars in 1180 bytes} [Sun Oct 9 00:42:16 2022] GET /identity/v3/groups/8d42d332b621439ea2323e96a92e0d04 => generated 226 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 09 00:42:17.156592 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45daaf78-d0e1-45e0-833e-8035734898ca None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:17.260244 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300a2e29-f385-4a39-a887-bde686b55d53 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:17.356040 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2014ac9-cfe1-42b0-8a7b-4c0b9b8cd71c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:17.356708 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2014ac9-cfe1-42b0-8a7b-4c0b9b8cd71c None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:17.356989 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2014ac9-cfe1-42b0-8a7b-4c0b9b8cd71c None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:17.357271 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2014ac9-cfe1-42b0-8a7b-4c0b9b8cd71c None admin] PATH_INFO: `/v3/groups/bfd589775c1842f4aaf9e1e51f657fbe` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:17.363984 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2014ac9-cfe1-42b0-8a7b-4c0b9b8cd71c None admin] RBAC: Authorizing `identity:get_group(group_id=bfd589775c1842f4aaf9e1e51f657fbe)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:17.365474 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2014ac9-cfe1-42b0-8a7b-4c0b9b8cd71c None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:17.367130 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 198/411] 10.222.0.15 () {56 vars in 1180 bytes} [Sun Oct 9 00:42:16 2022] GET /identity/v3/groups/bfd589775c1842f4aaf9e1e51f657fbe => generated 229 bytes in 372 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:42:17.376271 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2014ac9-cfe1-42b0-8a7b-4c0b9b8cd71c None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:17.403281 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45daaf78-d0e1-45e0-833e-8035734898ca None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:17.416308 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:17.470797 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6002b94-59f2-4e42-8280-9ed6d2e3516a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:17.472665 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6002b94-59f2-4e42-8280-9ed6d2e3516a None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:17.472922 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6002b94-59f2-4e42-8280-9ed6d2e3516a None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:17.473193 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6002b94-59f2-4e42-8280-9ed6d2e3516a None admin] PATH_INFO: `/v3/projects/01e5c679ba5842a3830c8b9335e2cb07` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:17.476069 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6002b94-59f2-4e42-8280-9ed6d2e3516a None admin] RBAC: Authorizing `identity:get_project(project_id=01e5c679ba5842a3830c8b9335e2cb07)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:17.477693 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6002b94-59f2-4e42-8280-9ed6d2e3516a None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:17.480002 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 214/412] 10.222.0.15 () {56 vars in 1186 bytes} [Sun Oct 9 00:42:17 2022] GET /identity/v3/projects/01e5c679ba5842a3830c8b9335e2cb07 => generated 302 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:42:17.488188 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6002b94-59f2-4e42-8280-9ed6d2e3516a None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:17.646309 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:17.684020 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2014ac9-cfe1-42b0-8a7b-4c0b9b8cd71c None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:17.738264 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6002b94-59f2-4e42-8280-9ed6d2e3516a None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:17.753401 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b02ca47-53b6-466a-a125-d88310f13bf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:17.754054 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b02ca47-53b6-466a-a125-d88310f13bf7 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:17.754330 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b02ca47-53b6-466a-a125-d88310f13bf7 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:17.754605 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b02ca47-53b6-466a-a125-d88310f13bf7 None admin] PATH_INFO: `/v3/projects/4024dc4bc9484e24953f0b564215ab2a` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:17.756040 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b02ca47-53b6-466a-a125-d88310f13bf7 None admin] RBAC: Authorizing `identity:get_project(project_id=4024dc4bc9484e24953f0b564215ab2a)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:17.757503 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b02ca47-53b6-466a-a125-d88310f13bf7 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:17.764867 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 199/413] 10.222.0.15 () {56 vars in 1186 bytes} [Sun Oct 9 00:42:17 2022] GET /identity/v3/projects/4024dc4bc9484e24953f0b564215ab2a => generated 344 bytes in 389 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:42:17.769963 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b02ca47-53b6-466a-a125-d88310f13bf7 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:17.808984 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49717f9c-ad21-4575-b7db-61c58665d4d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:17.809661 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49717f9c-ad21-4575-b7db-61c58665d4d9 None admin] REQUEST_METHOD: `PUT` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:17.809934 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49717f9c-ad21-4575-b7db-61c58665d4d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:17.810200 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49717f9c-ad21-4575-b7db-61c58665d4d9 None admin] PATH_INFO: `/v3/projects/01e5c679ba5842a3830c8b9335e2cb07/groups/8d42d332b621439ea2323e96a92e0d04/roles/93f141c2a808407dae6f9704941d0cb2` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:17.816225 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49717f9c-ad21-4575-b7db-61c58665d4d9 None admin] RBAC: Authorizing `identity:create_grant(project_id=01e5c679ba5842a3830c8b9335e2cb07, group_id=8d42d332b621439ea2323e96a92e0d04, role_id=93f141c2a808407dae6f9704941d0cb2)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:17.817695 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49717f9c-ad21-4575-b7db-61c58665d4d9 None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:17.841766 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 215/414] 10.222.0.15 () {58 vars in 1442 bytes} [Sun Oct 9 00:42:17 2022] PUT /identity/v3/projects/01e5c679ba5842a3830c8b9335e2cb07/groups/8d42d332b621439ea2323e96a92e0d04/roles/93f141c2a808407dae6f9704941d0cb2 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 00:42:17.900531 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b02ca47-53b6-466a-a125-d88310f13bf7 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:17.948108 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a8fc99-8b80-4bc0-ad07-673c4b7186d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:17.948703 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a8fc99-8b80-4bc0-ad07-673c4b7186d4 None admin] REQUEST_METHOD: `PUT` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:17.948971 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a8fc99-8b80-4bc0-ad07-673c4b7186d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:17.949239 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a8fc99-8b80-4bc0-ad07-673c4b7186d4 None admin] PATH_INFO: `/v3/projects/4024dc4bc9484e24953f0b564215ab2a/groups/bfd589775c1842f4aaf9e1e51f657fbe/roles/f69dddf26daf4dd79d4c962beb877af5` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:17.951312 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a8fc99-8b80-4bc0-ad07-673c4b7186d4 None admin] RBAC: Authorizing `identity:create_grant(project_id=4024dc4bc9484e24953f0b564215ab2a, group_id=bfd589775c1842f4aaf9e1e51f657fbe, role_id=f69dddf26daf4dd79d4c962beb877af5)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:17.952766 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a8fc99-8b80-4bc0-ad07-673c4b7186d4 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:17.975044 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 200/415] 10.222.0.15 () {58 vars in 1442 bytes} [Sun Oct 9 00:42:17 2022] PUT /identity/v3/projects/4024dc4bc9484e24953f0b564215ab2a/groups/bfd589775c1842f4aaf9e1e51f657fbe/roles/f69dddf26daf4dd79d4c962beb877af5 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 00:42:18.470467 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671e9e53-14a2-4dd0-b7d2-f0e562492726 None None] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:18.471414 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671e9e53-14a2-4dd0-b7d2-f0e562492726 None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:18.471874 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671e9e53-14a2-4dd0-b7d2-f0e562492726 None None] PATH_INFO: `/` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:18.473624 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 216/416] 10.222.0.15 () {54 vars in 927 bytes} [Sun Oct 9 00:42:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:42:18.479457 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fbbd4a-1ccd-428b-b128-af6633e9ff0a None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:18.479944 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fbbd4a-1ccd-428b-b128-af6633e9ff0a None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:18.480381 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fbbd4a-1ccd-428b-b128-af6633e9ff0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:18.503281 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-79fbbd4a-1ccd-428b-b128-af6633e9ff0a None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:42:18.504759 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-79fbbd4a-1ccd-428b-b128-af6633e9ff0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:42:18.508526 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:18.576466 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 201/417] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Oct 9 00:42:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 09 00:42:18.715181 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed06d598-8666-4336-bc5b-7dfc3fe11d00 None None] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:18.715390 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed06d598-8666-4336-bc5b-7dfc3fe11d00 None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:18.715663 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed06d598-8666-4336-bc5b-7dfc3fe11d00 None None] PATH_INFO: `/` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:18.717343 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 217/418] 10.222.0.15 () {54 vars in 927 bytes} [Sun Oct 9 00:42:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:42:18.723191 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d161bda-cd86-4ae3-9203-3b78c2878c1a None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:18.724114 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d161bda-cd86-4ae3-9203-3b78c2878c1a None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:18.724594 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d161bda-cd86-4ae3-9203-3b78c2878c1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:18.747084 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-2d161bda-cd86-4ae3-9203-3b78c2878c1a None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:42:18.748437 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-2d161bda-cd86-4ae3-9203-3b78c2878c1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:42:18.831795 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 202/419] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Oct 9 00:42:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 09 00:42:18.990583 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed06d598-8666-4336-bc5b-7dfc3fe11d00 None None] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:19.037149 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:19.059912 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9bc1be-7cd9-444a-969a-dd7fde02f098 None None] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:19.060223 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9bc1be-7cd9-444a-969a-dd7fde02f098 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:19.060469 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9bc1be-7cd9-444a-969a-dd7fde02f098 None None] PATH_INFO: `/` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:19.062153 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 203/420] 10.222.0.15 () {54 vars in 927 bytes} [Sun Oct 9 00:42:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:42:19.072704 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bc8212-e93c-4dee-9cf0-d79f4ef216cb None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:19.073008 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bc8212-e93c-4dee-9cf0-d79f4ef216cb None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:19.073251 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bc8212-e93c-4dee-9cf0-d79f4ef216cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:19.106618 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-f1bc8212-e93c-4dee-9cf0-d79f4ef216cb None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:42:19.107840 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-f1bc8212-e93c-4dee-9cf0-d79f4ef216cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:42:19.120477 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed06d598-8666-4336-bc5b-7dfc3fe11d00 None None] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:19.158297 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f467db-279d-4045-90bf-1a0112fc7301 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:19.159042 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f467db-279d-4045-90bf-1a0112fc7301 None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:19.159347 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f467db-279d-4045-90bf-1a0112fc7301 None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:19.159616 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f467db-279d-4045-90bf-1a0112fc7301 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:19.170943 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f467db-279d-4045-90bf-1a0112fc7301 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 09 00:42:19.176518 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application [None req-a6f467db-279d-4045-90bf-1a0112fc7301 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 09 00:42:19.176518 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:42:19.176518 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:42:19.176518 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:42:19.176518 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:42:19.176518 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:42:19.176518 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:42:19.176518 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:42:19.176518 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:42:19.176518 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:42:19.176518 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:42:19.176518 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:42:19.176518 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 09 00:42:19.176518 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 09 00:42:19.176518 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 09 00:42:19.176518 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 09 00:42:19.177392 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 09 00:42:19.177392 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 09 00:42:19.177392 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 09 00:42:19.177392 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 09 00:42:19.177392 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:42:19.177392 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:42:19.177392 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:42:19.177392 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:42:19.177392 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:42:19.177392 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:42:19.177392 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:42:19.177392 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application with Lock( Oct 09 00:42:19.177392 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:42:19.177392 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:42:19.177392 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:42:19.177392 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:42:19.178190 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:42:19.178190 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:42:19.178190 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:42:19.178190 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:42:19.178190 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 09 00:42:19.178190 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 09 00:42:19.178190 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 09 00:42:19.178190 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 09 00:42:19.178190 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 09 00:42:19.178190 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 09 00:42:19.178190 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 09 00:42:19.178190 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Oct 09 00:42:19.178190 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 218/421] 10.222.0.15 () {56 vars in 1099 bytes} [Sun Oct 9 00:42:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:42:19.185245 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f467db-279d-4045-90bf-1a0112fc7301 None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:19.213838 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:19.220090 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 204/422] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Oct 9 00:42:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 09 00:42:19.221188 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bc8212-e93c-4dee-9cf0-d79f4ef216cb None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:19.331529 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bc8212-e93c-4dee-9cf0-d79f4ef216cb None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:19.351307 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:19.355210 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f467db-279d-4045-90bf-1a0112fc7301 None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:19.378243 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac1a3ff-523b-4abb-a533-073f296c2cf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:19.378895 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac1a3ff-523b-4abb-a533-073f296c2cf2 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:19.379174 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac1a3ff-523b-4abb-a533-073f296c2cf2 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:19.379839 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac1a3ff-523b-4abb-a533-073f296c2cf2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:19.401307 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac1a3ff-523b-4abb-a533-073f296c2cf2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 09 00:42:19.406479 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application [None req-1ac1a3ff-523b-4abb-a533-073f296c2cf2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 09 00:42:19.406479 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:42:19.406479 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:42:19.406479 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:42:19.406479 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:42:19.406479 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:42:19.406479 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:42:19.406479 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:42:19.406479 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:42:19.406479 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:42:19.406479 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:42:19.406479 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:42:19.406479 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 09 00:42:19.406479 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 09 00:42:19.406479 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 09 00:42:19.406479 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 09 00:42:19.407382 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 09 00:42:19.407382 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 09 00:42:19.407382 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 09 00:42:19.407382 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 09 00:42:19.407382 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:42:19.407382 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:42:19.407382 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:42:19.407382 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:42:19.407382 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:42:19.407382 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:42:19.407382 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:42:19.407382 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application with Lock( Oct 09 00:42:19.407382 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:42:19.407382 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:42:19.407382 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:42:19.407382 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:42:19.408190 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:42:19.408190 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:42:19.408190 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:42:19.408190 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:42:19.408190 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 09 00:42:19.408190 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 09 00:42:19.408190 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 09 00:42:19.408190 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 09 00:42:19.408190 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 09 00:42:19.408190 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 09 00:42:19.408190 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 09 00:42:19.408190 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application Oct 09 00:42:19.414747 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 205/423] 10.222.0.15 () {56 vars in 1099 bytes} [Sun Oct 9 00:42:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:42:19.418359 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac1a3ff-523b-4abb-a533-073f296c2cf2 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:19.427161 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce0271d-1b96-4831-8829-86d1dc33d2d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:19.427810 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce0271d-1b96-4831-8829-86d1dc33d2d3 None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:19.428084 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce0271d-1b96-4831-8829-86d1dc33d2d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:19.428354 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce0271d-1b96-4831-8829-86d1dc33d2d3 None admin] PATH_INFO: `/v3/roles` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:19.429028 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce0271d-1b96-4831-8829-86d1dc33d2d3 None admin] RBAC: Adding query filter params (name=member) {{(pid=81525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:42:19.429329 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce0271d-1b96-4831-8829-86d1dc33d2d3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:19.430733 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce0271d-1b96-4831-8829-86d1dc33d2d3 None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:19.463066 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 219/424] 10.222.0.15 () {56 vars in 1101 bytes} [Sun Oct 9 00:42:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:42:19.469162 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce0271d-1b96-4831-8829-86d1dc33d2d3 None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:19.499506 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:19.540868 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac1a3ff-523b-4abb-a533-073f296c2cf2 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:19.575399 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114d15c9-0d50-4f7c-b6fd-3f9147678351 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:19.576017 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114d15c9-0d50-4f7c-b6fd-3f9147678351 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:19.576292 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114d15c9-0d50-4f7c-b6fd-3f9147678351 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:19.576562 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114d15c9-0d50-4f7c-b6fd-3f9147678351 None admin] PATH_INFO: `/v3/roles` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:19.577232 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114d15c9-0d50-4f7c-b6fd-3f9147678351 None admin] RBAC: Adding query filter params (name=member) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:42:19.577532 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114d15c9-0d50-4f7c-b6fd-3f9147678351 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:19.578918 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114d15c9-0d50-4f7c-b6fd-3f9147678351 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:19.585961 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce0271d-1b96-4831-8829-86d1dc33d2d3 None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:19.587633 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 206/425] 10.222.0.15 () {56 vars in 1101 bytes} [Sun Oct 9 00:42:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:42:19.588469 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114d15c9-0d50-4f7c-b6fd-3f9147678351 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:19.630558 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b9c458-1037-4c4b-8dfa-8ba2a18e0a57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:19.631212 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b9c458-1037-4c4b-8dfa-8ba2a18e0a57 None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:19.631538 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b9c458-1037-4c4b-8dfa-8ba2a18e0a57 None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:19.631807 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b9c458-1037-4c4b-8dfa-8ba2a18e0a57 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:19.666666 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:19.705103 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114d15c9-0d50-4f7c-b6fd-3f9147678351 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:19.711190 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b9c458-1037-4c4b-8dfa-8ba2a18e0a57 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:19.712732 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b9c458-1037-4c4b-8dfa-8ba2a18e0a57 None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:19.731470 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:19.745953 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d4411c-6a3e-4804-93fb-20f0044cde7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:19.746971 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d4411c-6a3e-4804-93fb-20f0044cde7d None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:19.747566 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d4411c-6a3e-4804-93fb-20f0044cde7d None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:19.748122 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d4411c-6a3e-4804-93fb-20f0044cde7d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:19.759636 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d4411c-6a3e-4804-93fb-20f0044cde7d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 09 00:42:19.765852 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application [None req-09d4411c-6a3e-4804-93fb-20f0044cde7d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 09 00:42:19.765852 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:42:19.765852 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:42:19.765852 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:42:19.765852 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:42:19.765852 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:42:19.765852 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:42:19.765852 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:42:19.765852 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:42:19.765852 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:42:19.765852 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:42:19.765852 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:42:19.765852 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 09 00:42:19.765852 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 09 00:42:19.765852 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 09 00:42:19.765852 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 09 00:42:19.766720 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 09 00:42:19.766720 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 09 00:42:19.766720 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 09 00:42:19.766720 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 09 00:42:19.766720 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:42:19.766720 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:42:19.766720 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:42:19.766720 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:42:19.766720 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:42:19.766720 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:42:19.766720 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:42:19.766720 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application with Lock( Oct 09 00:42:19.766720 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:42:19.766720 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:42:19.766720 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:42:19.766720 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:42:19.767969 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:42:19.767969 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:42:19.767969 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:42:19.767969 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:42:19.767969 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 09 00:42:19.767969 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 09 00:42:19.767969 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 09 00:42:19.767969 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 09 00:42:19.767969 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 09 00:42:19.767969 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 09 00:42:19.767969 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 09 00:42:19.767969 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application Oct 09 00:42:19.770341 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 207/426] 10.222.0.15 () {56 vars in 1114 bytes} [Sun Oct 9 00:42:19 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:42:19.771568 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d4411c-6a3e-4804-93fb-20f0044cde7d None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:19.842245 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 220/427] 10.222.0.15 () {58 vars in 1282 bytes} [Sun Oct 9 00:42:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 09 00:42:19.843518 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b9c458-1037-4c4b-8dfa-8ba2a18e0a57 None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:19.890513 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d4411c-6a3e-4804-93fb-20f0044cde7d None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:19.913936 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:19.928369 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c0cf5c-2886-4761-932f-62953e5a112b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:19.929350 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c0cf5c-2886-4761-932f-62953e5a112b None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:19.929825 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c0cf5c-2886-4761-932f-62953e5a112b None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:19.930426 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c0cf5c-2886-4761-932f-62953e5a112b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:19.963349 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b9c458-1037-4c4b-8dfa-8ba2a18e0a57 None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:19.991909 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:20.001515 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1977667d-23ff-4c7f-8492-18f4b9a784c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:20.002533 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1977667d-23ff-4c7f-8492-18f4b9a784c2 None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:20.003103 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1977667d-23ff-4c7f-8492-18f4b9a784c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:20.003595 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1977667d-23ff-4c7f-8492-18f4b9a784c2 None admin] PATH_INFO: `/v3/roles` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:20.004668 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1977667d-23ff-4c7f-8492-18f4b9a784c2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:42:20.005188 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1977667d-23ff-4c7f-8492-18f4b9a784c2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:20.007088 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1977667d-23ff-4c7f-8492-18f4b9a784c2 None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:20.014221 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c0cf5c-2886-4761-932f-62953e5a112b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:20.015993 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c0cf5c-2886-4761-932f-62953e5a112b None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:20.017434 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 221/428] 10.222.0.15 () {56 vars in 1111 bytes} [Sun Oct 9 00:42:19 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:42:20.018567 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1977667d-23ff-4c7f-8492-18f4b9a784c2 None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:20.135016 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1977667d-23ff-4c7f-8492-18f4b9a784c2 None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:20.146313 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 208/429] 10.222.0.15 () {58 vars in 1282 bytes} [Sun Oct 9 00:42:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 09 00:42:20.152127 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c0cf5c-2886-4761-932f-62953e5a112b None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:20.165158 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:20.179902 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a87bcab-7bc5-4151-b20c-4c646fb060d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:20.180950 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a87bcab-7bc5-4151-b20c-4c646fb060d0 None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:20.181309 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a87bcab-7bc5-4151-b20c-4c646fb060d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:20.181585 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a87bcab-7bc5-4151-b20c-4c646fb060d0 None admin] PATH_INFO: `/v3/projects/01e5c679ba5842a3830c8b9335e2cb07` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:20.183036 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a87bcab-7bc5-4151-b20c-4c646fb060d0 None admin] RBAC: Authorizing `identity:get_project(project_id=01e5c679ba5842a3830c8b9335e2cb07)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:20.185205 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a87bcab-7bc5-4151-b20c-4c646fb060d0 None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:20.187386 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 222/430] 10.222.0.15 () {56 vars in 1186 bytes} [Sun Oct 9 00:42:20 2022] GET /identity/v3/projects/01e5c679ba5842a3830c8b9335e2cb07 => generated 302 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:42:20.188554 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a87bcab-7bc5-4151-b20c-4c646fb060d0 None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:20.246179 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:20.268001 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c0cf5c-2886-4761-932f-62953e5a112b None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:20.315692 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8245d48f-b312-4543-a584-fbb71078d3de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:20.316371 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8245d48f-b312-4543-a584-fbb71078d3de None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:20.316982 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8245d48f-b312-4543-a584-fbb71078d3de None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:20.317356 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8245d48f-b312-4543-a584-fbb71078d3de None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:20.319509 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a87bcab-7bc5-4151-b20c-4c646fb060d0 None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:20.359120 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b748ff27-46d5-429d-aedc-21fdf450877f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:20.359841 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b748ff27-46d5-429d-aedc-21fdf450877f None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:20.360371 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b748ff27-46d5-429d-aedc-21fdf450877f None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:20.360667 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b748ff27-46d5-429d-aedc-21fdf450877f None admin] PATH_INFO: `/v3/projects/3fcf2f5182c445929c38948df6235040` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:20.362270 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b748ff27-46d5-429d-aedc-21fdf450877f None admin] RBAC: Authorizing `identity:get_project(project_id=3fcf2f5182c445929c38948df6235040)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:20.364100 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b748ff27-46d5-429d-aedc-21fdf450877f None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:20.371312 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 223/431] 10.222.0.15 () {56 vars in 1186 bytes} [Sun Oct 9 00:42:20 2022] GET /identity/v3/projects/3fcf2f5182c445929c38948df6235040 => generated 298 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:42:20.371312 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b748ff27-46d5-429d-aedc-21fdf450877f None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:20.409117 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8245d48f-b312-4543-a584-fbb71078d3de None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:20.411113 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8245d48f-b312-4543-a584-fbb71078d3de None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:20.445752 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:20.511389 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b748ff27-46d5-429d-aedc-21fdf450877f None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:20.515119 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:20.539295 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 209/432] 10.222.0.15 () {58 vars in 1282 bytes} [Sun Oct 9 00:42:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 09 00:42:20.540739 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8245d48f-b312-4543-a584-fbb71078d3de None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:20.560620 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e62b60-ed05-40ef-a1d6-9a073a00b3d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:20.561645 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e62b60-ed05-40ef-a1d6-9a073a00b3d4 None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:20.562133 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e62b60-ed05-40ef-a1d6-9a073a00b3d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:20.562598 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e62b60-ed05-40ef-a1d6-9a073a00b3d4 None admin] PATH_INFO: `/v3/groups/8d42d332b621439ea2323e96a92e0d04` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:20.563945 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e62b60-ed05-40ef-a1d6-9a073a00b3d4 None admin] RBAC: Authorizing `identity:get_group(group_id=8d42d332b621439ea2323e96a92e0d04)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:20.565582 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e62b60-ed05-40ef-a1d6-9a073a00b3d4 None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:20.567725 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 224/433] 10.222.0.15 () {56 vars in 1180 bytes} [Sun Oct 9 00:42:20 2022] GET /identity/v3/groups/8d42d332b621439ea2323e96a92e0d04 => generated 226 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:42:20.568853 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e62b60-ed05-40ef-a1d6-9a073a00b3d4 None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:20.648026 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8245d48f-b312-4543-a584-fbb71078d3de None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:20.674953 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e62b60-ed05-40ef-a1d6-9a073a00b3d4 None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:20.682461 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95299033-8be6-4189-939c-1c9f7f9396ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:20.683087 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95299033-8be6-4189-939c-1c9f7f9396ce None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:20.683387 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95299033-8be6-4189-939c-1c9f7f9396ce None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:20.683678 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95299033-8be6-4189-939c-1c9f7f9396ce None admin] PATH_INFO: `/v3/groups/8d42d332b621439ea2323e96a92e0d04` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:20.684754 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95299033-8be6-4189-939c-1c9f7f9396ce None admin] RBAC: Authorizing `identity:get_group(group_id=8d42d332b621439ea2323e96a92e0d04)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:20.686206 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95299033-8be6-4189-939c-1c9f7f9396ce None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:20.687789 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 210/434] 10.222.0.15 () {56 vars in 1180 bytes} [Sun Oct 9 00:42:20 2022] GET /identity/v3/groups/8d42d332b621439ea2323e96a92e0d04 => generated 226 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:42:20.691819 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95299033-8be6-4189-939c-1c9f7f9396ce None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:20.701067 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:20.709099 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8debc933-93c5-4c19-a05e-57637f4b842a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:20.709740 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8debc933-93c5-4c19-a05e-57637f4b842a None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:20.710015 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8debc933-93c5-4c19-a05e-57637f4b842a None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:20.710291 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8debc933-93c5-4c19-a05e-57637f4b842a None admin] PATH_INFO: `/v3/projects/3fcf2f5182c445929c38948df6235040` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:20.711440 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8debc933-93c5-4c19-a05e-57637f4b842a None admin] RBAC: Authorizing `identity:get_project(project_id=3fcf2f5182c445929c38948df6235040)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:20.712930 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8debc933-93c5-4c19-a05e-57637f4b842a None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:20.714716 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 225/435] 10.222.0.15 () {56 vars in 1186 bytes} [Sun Oct 9 00:42:20 2022] GET /identity/v3/projects/3fcf2f5182c445929c38948df6235040 => generated 298 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:42:20.715696 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7916b433-62be-4e69-93fb-9dcbd1c2dc6c None None] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:20.715973 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7916b433-62be-4e69-93fb-9dcbd1c2dc6c None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:20.716271 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7916b433-62be-4e69-93fb-9dcbd1c2dc6c None None] PATH_INFO: `/` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:20.717447 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 226/436] 10.222.0.15 () {54 vars in 927 bytes} [Sun Oct 9 00:42:20 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:42:20.718435 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92489252-61ab-4317-9267-ca27a5b13b66 None None] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:20.718710 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92489252-61ab-4317-9267-ca27a5b13b66 None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:20.718978 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92489252-61ab-4317-9267-ca27a5b13b66 None None] PATH_INFO: `/` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:20.720199 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 227/437] 10.222.0.15 () {54 vars in 927 bytes} [Sun Oct 9 00:42:20 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:42:20.720887 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92489252-61ab-4317-9267-ca27a5b13b66 None None] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:20.748233 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:20.799046 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95299033-8be6-4189-939c-1c9f7f9396ce None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:20.823632 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92489252-61ab-4317-9267-ca27a5b13b66 None None] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:20.832243 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d489577-cc04-4e64-aad1-a34fc1e08d25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:20.832856 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d489577-cc04-4e64-aad1-a34fc1e08d25 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:20.833125 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d489577-cc04-4e64-aad1-a34fc1e08d25 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:20.833391 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d489577-cc04-4e64-aad1-a34fc1e08d25 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:20.834113 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d489577-cc04-4e64-aad1-a34fc1e08d25 None admin] RBAC: Adding query filter params (group.id=8d42d332b621439ea2323e96a92e0d04, role.id=afb0a01183d9497795eaa4fa1a4046ae, scope.project.id=01e5c679ba5842a3830c8b9335e2cb07) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:42:20.834412 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d489577-cc04-4e64-aad1-a34fc1e08d25 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:20.835894 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d489577-cc04-4e64-aad1-a34fc1e08d25 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:20.841734 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 211/438] 10.222.0.15 () {56 vars in 1376 bytes} [Sun Oct 9 00:42:20 2022] GET /identity/v3/role_assignments?group.id=8d42d332b621439ea2323e96a92e0d04&scope.project.id=01e5c679ba5842a3830c8b9335e2cb07&role.id=afb0a01183d9497795eaa4fa1a4046ae => generated 611 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:42:20.842551 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d489577-cc04-4e64-aad1-a34fc1e08d25 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:20.863090 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e93a949-a4fe-4909-8b35-de808d077348 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:20.863756 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e93a949-a4fe-4909-8b35-de808d077348 None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:20.864031 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e93a949-a4fe-4909-8b35-de808d077348 None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:20.864296 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e93a949-a4fe-4909-8b35-de808d077348 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:20.865050 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e93a949-a4fe-4909-8b35-de808d077348 None admin] RBAC: Adding query filter params (group.id=8d42d332b621439ea2323e96a92e0d04, role.id=afb0a01183d9497795eaa4fa1a4046ae, scope.project.id=3fcf2f5182c445929c38948df6235040) {{(pid=81525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:42:20.865360 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e93a949-a4fe-4909-8b35-de808d077348 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:20.866846 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e93a949-a4fe-4909-8b35-de808d077348 None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:20.874213 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 228/439] 10.222.0.15 () {56 vars in 1376 bytes} [Sun Oct 9 00:42:20 2022] GET /identity/v3/role_assignments?group.id=8d42d332b621439ea2323e96a92e0d04&scope.project.id=3fcf2f5182c445929c38948df6235040&role.id=afb0a01183d9497795eaa4fa1a4046ae => generated 611 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:42:20.875627 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7e9c54-fc7e-4722-bdf8-02f84a17330e None None] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:20.875912 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7e9c54-fc7e-4722-bdf8-02f84a17330e None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:20.876185 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7e9c54-fc7e-4722-bdf8-02f84a17330e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:20.918991 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.auth.core [None req-8f7e9c54-fc7e-4722-bdf8-02f84a17330e None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:42:20.920999 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-8f7e9c54-fc7e-4722-bdf8-02f84a17330e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:42:21.006823 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d489577-cc04-4e64-aad1-a34fc1e08d25 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:21.007457 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:21.020945 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 229/440] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Oct 9 00:42:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 09 00:42:21.022913 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b743797f-815d-4a12-8e27-d486c2b8bc0e None None] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:21.027317 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:21.028484 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b743797f-815d-4a12-8e27-d486c2b8bc0e None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:21.030017 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b743797f-815d-4a12-8e27-d486c2b8bc0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:21.049236 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70509f8-f31c-4967-a923-6ac26740aa98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:21.049921 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70509f8-f31c-4967-a923-6ac26740aa98 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:21.050193 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70509f8-f31c-4967-a923-6ac26740aa98 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:21.050457 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70509f8-f31c-4967-a923-6ac26740aa98 None admin] PATH_INFO: `/v3/groups/8d42d332b621439ea2323e96a92e0d04` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:21.051633 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70509f8-f31c-4967-a923-6ac26740aa98 None admin] RBAC: Authorizing `identity:get_group(group_id=8d42d332b621439ea2323e96a92e0d04)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:21.053226 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70509f8-f31c-4967-a923-6ac26740aa98 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:21.054851 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 212/441] 10.222.0.15 () {56 vars in 1180 bytes} [Sun Oct 9 00:42:20 2022] GET /identity/v3/groups/8d42d332b621439ea2323e96a92e0d04 => generated 226 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:42:21.061178 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70509f8-f31c-4967-a923-6ac26740aa98 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:21.061589 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.auth.core [None req-b743797f-815d-4a12-8e27-d486c2b8bc0e None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:42:21.063215 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-b743797f-815d-4a12-8e27-d486c2b8bc0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:42:21.148666 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 230/442] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Oct 9 00:42:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 09 00:42:21.177554 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70509f8-f31c-4967-a923-6ac26740aa98 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:21.213267 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87871d03-5743-470e-a631-c624aebb2ce8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:21.214044 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87871d03-5743-470e-a631-c624aebb2ce8 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:21.214361 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87871d03-5743-470e-a631-c624aebb2ce8 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:21.214646 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87871d03-5743-470e-a631-c624aebb2ce8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:21.215552 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87871d03-5743-470e-a631-c624aebb2ce8 None admin] RBAC: Adding query filter params (group.id=8d42d332b621439ea2323e96a92e0d04, role.id=93f141c2a808407dae6f9704941d0cb2, scope.project.id=3fcf2f5182c445929c38948df6235040) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:42:21.216019 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87871d03-5743-470e-a631-c624aebb2ce8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:21.217640 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87871d03-5743-470e-a631-c624aebb2ce8 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:21.224177 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 213/443] 10.222.0.15 () {56 vars in 1376 bytes} [Sun Oct 9 00:42:21 2022] GET /identity/v3/role_assignments?group.id=8d42d332b621439ea2323e96a92e0d04&scope.project.id=3fcf2f5182c445929c38948df6235040&role.id=93f141c2a808407dae6f9704941d0cb2 => generated 611 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 09 00:42:21.316314 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b743797f-815d-4a12-8e27-d486c2b8bc0e None None] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:21.427045 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87871d03-5743-470e-a631-c624aebb2ce8 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:21.431110 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b743797f-815d-4a12-8e27-d486c2b8bc0e None None] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:21.455205 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:21.473703 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf9b85d-8494-4483-aa7a-551327bd7818 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:21.474354 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf9b85d-8494-4483-aa7a-551327bd7818 None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:21.474625 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf9b85d-8494-4483-aa7a-551327bd7818 None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:21.474901 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf9b85d-8494-4483-aa7a-551327bd7818 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:21.488003 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf9b85d-8494-4483-aa7a-551327bd7818 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 09 00:42:21.489111 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:21.494392 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application [None req-acf9b85d-8494-4483-aa7a-551327bd7818 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 09 00:42:21.494392 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:42:21.494392 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:42:21.494392 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:42:21.494392 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:42:21.494392 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:42:21.494392 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:42:21.494392 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:42:21.494392 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:42:21.494392 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:42:21.494392 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:42:21.494392 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:42:21.494392 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 09 00:42:21.494392 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 09 00:42:21.494392 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 09 00:42:21.494392 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 09 00:42:21.495368 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 09 00:42:21.495368 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 09 00:42:21.495368 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 09 00:42:21.495368 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 09 00:42:21.495368 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:42:21.495368 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:42:21.495368 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:42:21.495368 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:42:21.495368 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:42:21.495368 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:42:21.495368 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:42:21.495368 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application with Lock( Oct 09 00:42:21.495368 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:42:21.495368 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:42:21.495368 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:42:21.495368 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:42:21.496189 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:42:21.496189 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:42:21.496189 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:42:21.496189 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:42:21.496189 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 09 00:42:21.496189 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 09 00:42:21.496189 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 09 00:42:21.496189 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 09 00:42:21.496189 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 09 00:42:21.496189 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 09 00:42:21.496189 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 09 00:42:21.496189 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Oct 09 00:42:21.496189 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 231/444] 10.222.0.15 () {56 vars in 1114 bytes} [Sun Oct 9 00:42:21 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:42:21.502060 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf9b85d-8494-4483-aa7a-551327bd7818 None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:21.560421 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87871d03-5743-470e-a631-c624aebb2ce8 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:21.612404 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c290d49-6b25-4a7b-9352-aca234da505b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:21.612954 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c290d49-6b25-4a7b-9352-aca234da505b None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:21.613202 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c290d49-6b25-4a7b-9352-aca234da505b None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:21.613496 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c290d49-6b25-4a7b-9352-aca234da505b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:21.626252 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c290d49-6b25-4a7b-9352-aca234da505b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 09 00:42:21.626909 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf9b85d-8494-4483-aa7a-551327bd7818 None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:21.631406 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application [None req-1c290d49-6b25-4a7b-9352-aca234da505b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 09 00:42:21.631406 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:42:21.631406 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:42:21.631406 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:42:21.631406 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:42:21.631406 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:42:21.631406 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:42:21.631406 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:42:21.631406 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:42:21.631406 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:42:21.631406 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:42:21.631406 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:42:21.631406 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 09 00:42:21.631406 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 09 00:42:21.631406 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 09 00:42:21.631406 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 09 00:42:21.632306 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 09 00:42:21.632306 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 09 00:42:21.632306 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 09 00:42:21.632306 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 09 00:42:21.632306 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:42:21.632306 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:42:21.632306 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:42:21.632306 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:42:21.632306 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:42:21.632306 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:42:21.632306 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:42:21.632306 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application with Lock( Oct 09 00:42:21.632306 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:42:21.632306 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:42:21.632306 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:42:21.632306 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:42:21.633098 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:42:21.633098 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:42:21.633098 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:42:21.633098 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:42:21.633098 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 09 00:42:21.633098 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 09 00:42:21.633098 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 09 00:42:21.633098 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 09 00:42:21.633098 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 09 00:42:21.633098 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 09 00:42:21.633098 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 09 00:42:21.633098 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application Oct 09 00:42:21.633098 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 214/445] 10.222.0.15 () {56 vars in 1096 bytes} [Sun Oct 9 00:42:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 09 00:42:21.638814 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c290d49-6b25-4a7b-9352-aca234da505b None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:21.671417 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d558775e-0405-4460-a7a2-6c58a87ef61d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:21.672036 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d558775e-0405-4460-a7a2-6c58a87ef61d None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:21.672313 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d558775e-0405-4460-a7a2-6c58a87ef61d None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:21.672584 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d558775e-0405-4460-a7a2-6c58a87ef61d None admin] PATH_INFO: `/v3/roles` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:21.673321 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d558775e-0405-4460-a7a2-6c58a87ef61d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:42:21.673624 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d558775e-0405-4460-a7a2-6c58a87ef61d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:21.675124 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d558775e-0405-4460-a7a2-6c58a87ef61d None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:21.684653 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 232/446] 10.222.0.15 () {56 vars in 1111 bytes} [Sun Oct 9 00:42:21 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 09 00:42:21.690527 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d558775e-0405-4460-a7a2-6c58a87ef61d None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:21.737264 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:21.771240 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c290d49-6b25-4a7b-9352-aca234da505b None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:21.780589 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:21.812851 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e1bea2-7857-4e37-9d52-5371532e1139 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:21.813104 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e1bea2-7857-4e37-9d52-5371532e1139 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:21.813359 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e1bea2-7857-4e37-9d52-5371532e1139 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:21.813584 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d558775e-0405-4460-a7a2-6c58a87ef61d None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:21.813747 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e1bea2-7857-4e37-9d52-5371532e1139 None admin] PATH_INFO: `/v3/roles` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:21.814201 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e1bea2-7857-4e37-9d52-5371532e1139 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:42:21.814501 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e1bea2-7857-4e37-9d52-5371532e1139 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:21.816002 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e1bea2-7857-4e37-9d52-5371532e1139 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:21.825862 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 215/447] 10.222.0.15 () {56 vars in 1099 bytes} [Sun Oct 9 00:42:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 09 00:42:21.831958 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e1bea2-7857-4e37-9d52-5371532e1139 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:21.857289 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cb9d28-2adf-4464-8aa8-afb2bd69d6a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:21.857916 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cb9d28-2adf-4464-8aa8-afb2bd69d6a2 None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:21.858191 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cb9d28-2adf-4464-8aa8-afb2bd69d6a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:21.858499 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cb9d28-2adf-4464-8aa8-afb2bd69d6a2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:21.940072 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cb9d28-2adf-4464-8aa8-afb2bd69d6a2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:21.941547 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cb9d28-2adf-4464-8aa8-afb2bd69d6a2 None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:21.959207 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e1bea2-7857-4e37-9d52-5371532e1139 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:21.994491 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:22.003107 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301d8d0d-831f-4767-94fe-3ef78caf54ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:22.003787 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301d8d0d-831f-4767-94fe-3ef78caf54ca None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:22.004062 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301d8d0d-831f-4767-94fe-3ef78caf54ca None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:22.004337 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301d8d0d-831f-4767-94fe-3ef78caf54ca None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:22.047425 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:22.058830 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 233/448] 10.222.0.15 () {58 vars in 1282 bytes} [Sun Oct 9 00:42:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 09 00:42:22.064719 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cb9d28-2adf-4464-8aa8-afb2bd69d6a2 None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:22.087014 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301d8d0d-831f-4767-94fe-3ef78caf54ca None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:22.088524 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301d8d0d-831f-4767-94fe-3ef78caf54ca None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:22.164124 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cb9d28-2adf-4464-8aa8-afb2bd69d6a2 None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:22.193309 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 216/449] 10.222.0.15 () {58 vars in 1282 bytes} [Sun Oct 9 00:42:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 09 00:42:22.199072 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301d8d0d-831f-4767-94fe-3ef78caf54ca None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:22.203697 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4356ff-6fd9-4816-b8ba-bde3e10d7536 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:22.204332 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4356ff-6fd9-4816-b8ba-bde3e10d7536 None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:22.204604 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4356ff-6fd9-4816-b8ba-bde3e10d7536 None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:22.204869 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4356ff-6fd9-4816-b8ba-bde3e10d7536 None admin] PATH_INFO: `/v3/projects/01e5c679ba5842a3830c8b9335e2cb07` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:22.205977 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4356ff-6fd9-4816-b8ba-bde3e10d7536 None admin] RBAC: Authorizing `identity:get_project(project_id=01e5c679ba5842a3830c8b9335e2cb07)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:22.207450 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4356ff-6fd9-4816-b8ba-bde3e10d7536 None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:22.209073 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 234/450] 10.222.0.15 () {56 vars in 1186 bytes} [Sun Oct 9 00:42:22 2022] GET /identity/v3/projects/01e5c679ba5842a3830c8b9335e2cb07 => generated 302 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 09 00:42:22.214479 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4356ff-6fd9-4816-b8ba-bde3e10d7536 None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:22.227001 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:22.266112 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:22.301006 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301d8d0d-831f-4767-94fe-3ef78caf54ca None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:22.315865 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4356ff-6fd9-4816-b8ba-bde3e10d7536 None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:22.340367 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f9c6e7-18e2-40f6-9862-280df774d8ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:22.341009 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f9c6e7-18e2-40f6-9862-280df774d8ea None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:22.341283 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f9c6e7-18e2-40f6-9862-280df774d8ea None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:22.341549 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f9c6e7-18e2-40f6-9862-280df774d8ea None admin] PATH_INFO: `/v3/projects/4024dc4bc9484e24953f0b564215ab2a` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:22.343138 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f9c6e7-18e2-40f6-9862-280df774d8ea None admin] RBAC: Authorizing `identity:get_project(project_id=4024dc4bc9484e24953f0b564215ab2a)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:22.344630 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f9c6e7-18e2-40f6-9862-280df774d8ea None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:22.346238 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 217/451] 10.222.0.15 () {56 vars in 1186 bytes} [Sun Oct 9 00:42:22 2022] GET /identity/v3/projects/4024dc4bc9484e24953f0b564215ab2a => generated 344 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:42:22.350165 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c81c80-e6f5-473f-91c8-e85739b2e632 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:22.350802 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c81c80-e6f5-473f-91c8-e85739b2e632 None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:22.351077 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c81c80-e6f5-473f-91c8-e85739b2e632 None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:22.351385 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c81c80-e6f5-473f-91c8-e85739b2e632 None admin] PATH_INFO: `/v3/groups/8d42d332b621439ea2323e96a92e0d04` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:22.351833 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f9c6e7-18e2-40f6-9862-280df774d8ea None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:22.352549 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c81c80-e6f5-473f-91c8-e85739b2e632 None admin] RBAC: Authorizing `identity:get_group(group_id=8d42d332b621439ea2323e96a92e0d04)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:22.354023 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c81c80-e6f5-473f-91c8-e85739b2e632 None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:22.355630 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 235/452] 10.222.0.15 () {56 vars in 1180 bytes} [Sun Oct 9 00:42:22 2022] GET /identity/v3/groups/8d42d332b621439ea2323e96a92e0d04 => generated 226 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:42:22.361370 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c81c80-e6f5-473f-91c8-e85739b2e632 None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:22.441865 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:22.455300 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f9c6e7-18e2-40f6-9862-280df774d8ea None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:22.464405 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c81c80-e6f5-473f-91c8-e85739b2e632 None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:22.489563 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4f8f6d-ba27-4837-8f11-3ab93ca447c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:22.490351 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4f8f6d-ba27-4837-8f11-3ab93ca447c2 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:22.490943 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4f8f6d-ba27-4837-8f11-3ab93ca447c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:22.491214 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4f8f6d-ba27-4837-8f11-3ab93ca447c2 None admin] PATH_INFO: `/v3/groups/bfd589775c1842f4aaf9e1e51f657fbe` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:22.492496 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4f8f6d-ba27-4837-8f11-3ab93ca447c2 None admin] RBAC: Authorizing `identity:get_group(group_id=bfd589775c1842f4aaf9e1e51f657fbe)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:22.494050 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4f8f6d-ba27-4837-8f11-3ab93ca447c2 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:22.495649 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 218/453] 10.222.0.15 () {56 vars in 1180 bytes} [Sun Oct 9 00:42:22 2022] GET /identity/v3/groups/bfd589775c1842f4aaf9e1e51f657fbe => generated 229 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 09 00:42:22.498307 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5644e8d0-974b-4b33-8342-1555beafe4d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:22.499253 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5644e8d0-974b-4b33-8342-1555beafe4d1 None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:22.499553 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5644e8d0-974b-4b33-8342-1555beafe4d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:22.499819 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5644e8d0-974b-4b33-8342-1555beafe4d1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:22.500542 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5644e8d0-974b-4b33-8342-1555beafe4d1 None admin] RBAC: Adding query filter params (group.id=8d42d332b621439ea2323e96a92e0d04, role.id=93f141c2a808407dae6f9704941d0cb2, scope.project.id=01e5c679ba5842a3830c8b9335e2cb07) {{(pid=81525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:42:22.501246 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5644e8d0-974b-4b33-8342-1555beafe4d1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:22.501805 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4f8f6d-ba27-4837-8f11-3ab93ca447c2 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:22.502743 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5644e8d0-974b-4b33-8342-1555beafe4d1 None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:22.505389 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:22.509024 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 236/454] 10.222.0.15 () {56 vars in 1376 bytes} [Sun Oct 9 00:42:22 2022] GET /identity/v3/role_assignments?group.id=8d42d332b621439ea2323e96a92e0d04&scope.project.id=01e5c679ba5842a3830c8b9335e2cb07&role.id=93f141c2a808407dae6f9704941d0cb2 => generated 611 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 09 00:42:22.610708 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4f8f6d-ba27-4837-8f11-3ab93ca447c2 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:22.651668 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af06873f-14e9-4a2b-a612-fb144fb2f6db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:22.652307 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af06873f-14e9-4a2b-a612-fb144fb2f6db None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:22.652582 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af06873f-14e9-4a2b-a612-fb144fb2f6db None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:22.652845 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af06873f-14e9-4a2b-a612-fb144fb2f6db None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:22.653614 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af06873f-14e9-4a2b-a612-fb144fb2f6db None admin] RBAC: Adding query filter params (group.id=bfd589775c1842f4aaf9e1e51f657fbe, role.id=f69dddf26daf4dd79d4c962beb877af5, scope.project.id=4024dc4bc9484e24953f0b564215ab2a) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:42:22.653915 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af06873f-14e9-4a2b-a612-fb144fb2f6db None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:22.655457 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af06873f-14e9-4a2b-a612-fb144fb2f6db None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:22.662384 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 219/455] 10.222.0.15 () {56 vars in 1376 bytes} [Sun Oct 9 00:42:22 2022] GET /identity/v3/role_assignments?group.id=bfd589775c1842f4aaf9e1e51f657fbe&scope.project.id=4024dc4bc9484e24953f0b564215ab2a&role.id=f69dddf26daf4dd79d4c962beb877af5 => generated 611 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 09 00:42:25.492870 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2af36c9-1559-44ff-ba27-244714a1bf5c None None] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:25.494015 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2af36c9-1559-44ff-ba27-244714a1bf5c None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:25.494483 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2af36c9-1559-44ff-ba27-244714a1bf5c None None] PATH_INFO: `/` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:25.496088 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 237/456] 10.222.0.15 () {54 vars in 927 bytes} [Sun Oct 9 00:42:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:42:25.502197 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48965a31-baaa-4f30-be4a-5e818881546c None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:25.503084 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48965a31-baaa-4f30-be4a-5e818881546c None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:25.503615 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48965a31-baaa-4f30-be4a-5e818881546c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:25.531415 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-48965a31-baaa-4f30-be4a-5e818881546c None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:42:25.533045 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-48965a31-baaa-4f30-be4a-5e818881546c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:42:25.628274 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:25.636925 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 220/457] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Oct 9 00:42:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 09 00:42:25.660123 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb4834f-2261-4021-8001-c5363a118905 None None] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:25.660465 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb4834f-2261-4021-8001-c5363a118905 None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:25.660669 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb4834f-2261-4021-8001-c5363a118905 None None] PATH_INFO: `/` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:25.662169 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 238/458] 10.222.0.15 () {54 vars in 927 bytes} [Sun Oct 9 00:42:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:42:25.667509 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9680e845-f96e-4c4c-8418-c34b76fc9d49 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:25.667792 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9680e845-f96e-4c4c-8418-c34b76fc9d49 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:25.668062 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9680e845-f96e-4c4c-8418-c34b76fc9d49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:25.696499 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-9680e845-f96e-4c4c-8418-c34b76fc9d49 None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:42:25.697714 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-9680e845-f96e-4c4c-8418-c34b76fc9d49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:42:25.703796 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ae3098-401d-4df2-ac09-7f5137860fa0 None None] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:25.704365 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ae3098-401d-4df2-ac09-7f5137860fa0 None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:25.704853 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ae3098-401d-4df2-ac09-7f5137860fa0 None None] PATH_INFO: `/` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:25.706368 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 239/459] 10.222.0.15 () {54 vars in 927 bytes} [Sun Oct 9 00:42:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 09 00:42:25.712063 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1cb5fc-ddf1-4281-a19a-93b68f97139c None None] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:25.712630 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1cb5fc-ddf1-4281-a19a-93b68f97139c None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:25.713129 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1cb5fc-ddf1-4281-a19a-93b68f97139c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:25.752447 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.auth.core [None req-5d1cb5fc-ddf1-4281-a19a-93b68f97139c None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:42:25.754003 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-5d1cb5fc-ddf1-4281-a19a-93b68f97139c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:42:25.779867 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 221/460] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Oct 9 00:42:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 09 00:42:25.866825 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 240/461] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Oct 9 00:42:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 09 00:42:25.933996 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9680e845-f96e-4c4c-8418-c34b76fc9d49 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:26.058627 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9680e845-f96e-4c4c-8418-c34b76fc9d49 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:26.084876 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:26.090946 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead80b09-5dd8-44ab-b1b2-8bf81d32f1f7 None None] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:26.091465 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead80b09-5dd8-44ab-b1b2-8bf81d32f1f7 None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:26.091877 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead80b09-5dd8-44ab-b1b2-8bf81d32f1f7 None None] PATH_INFO: `/` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:26.097465 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 241/462] 10.222.0.15 () {54 vars in 927 bytes} [Sun Oct 9 00:42:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:42:26.098195 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4757f1ee-1314-4664-ade3-4e130150ff3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:26.098831 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4757f1ee-1314-4664-ade3-4e130150ff3c None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:26.099102 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4757f1ee-1314-4664-ade3-4e130150ff3c None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:26.099388 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4757f1ee-1314-4664-ade3-4e130150ff3c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:26.099912 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6dc677-d283-434e-9b11-40fb362fc6cf None None] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:26.100407 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6dc677-d283-434e-9b11-40fb362fc6cf None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:26.100867 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6dc677-d283-434e-9b11-40fb362fc6cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:26.114120 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4757f1ee-1314-4664-ade3-4e130150ff3c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:26.115693 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4757f1ee-1314-4664-ade3-4e130150ff3c None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:26.120372 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.auth.core [None req-de6dc677-d283-434e-9b11-40fb362fc6cf None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:42:26.123035 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-de6dc677-d283-434e-9b11-40fb362fc6cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:42:26.143095 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application [None req-4757f1ee-1314-4664-ade3-4e130150ff3c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:42:26.143095 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:42:26.143095 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:42:26.143095 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:42:26.143095 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:42:26.143095 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:42:26.143095 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:42:26.143095 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:42:26.143095 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:42:26.143095 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:42:26.143095 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:42:26.143095 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:42:26.143095 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 09 00:42:26.143095 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 09 00:42:26.143095 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 09 00:42:26.143095 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 09 00:42:26.144068 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:42:26.144068 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:42:26.144068 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:42:26.144068 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:42:26.144068 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:42:26.144068 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:42:26.144068 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:42:26.144068 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application with Lock( Oct 09 00:42:26.144068 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:42:26.144068 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:42:26.144068 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:42:26.144068 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:42:26.144068 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:42:26.144068 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:42:26.144068 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:42:26.144068 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:42:26.144068 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 09 00:42:26.144917 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 09 00:42:26.144917 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:42:26.144917 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application Oct 09 00:42:26.150845 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 222/463] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Oct 9 00:42:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:42:26.157182 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4757f1ee-1314-4664-ade3-4e130150ff3c None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:26.223152 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 242/464] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Oct 9 00:42:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 09 00:42:26.224278 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6dc677-d283-434e-9b11-40fb362fc6cf None None] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:26.226617 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:26.271292 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4757f1ee-1314-4664-ade3-4e130150ff3c None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:26.306224 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c8db62-8939-4dde-92fc-d46d7a5c7bcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:26.307115 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c8db62-8939-4dde-92fc-d46d7a5c7bcb None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:26.307579 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c8db62-8939-4dde-92fc-d46d7a5c7bcb None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:26.307994 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c8db62-8939-4dde-92fc-d46d7a5c7bcb None admin] PATH_INFO: `/v3/domains` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:26.308685 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c8db62-8939-4dde-92fc-d46d7a5c7bcb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:42:26.309184 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c8db62-8939-4dde-92fc-d46d7a5c7bcb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:26.310567 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c8db62-8939-4dde-92fc-d46d7a5c7bcb None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:26.329427 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 223/465] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Oct 9 00:42:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:42:26.335028 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c8db62-8939-4dde-92fc-d46d7a5c7bcb None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:26.356405 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6dc677-d283-434e-9b11-40fb362fc6cf None None] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:26.386414 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:26.402864 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2596d8c8-dec8-4846-b4c6-c7305d7e2f35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:26.403865 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2596d8c8-dec8-4846-b4c6-c7305d7e2f35 None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:26.404320 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2596d8c8-dec8-4846-b4c6-c7305d7e2f35 None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:26.404760 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2596d8c8-dec8-4846-b4c6-c7305d7e2f35 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:26.416322 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2596d8c8-dec8-4846-b4c6-c7305d7e2f35 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:26.418047 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2596d8c8-dec8-4846-b4c6-c7305d7e2f35 None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:26.435464 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application [None req-2596d8c8-dec8-4846-b4c6-c7305d7e2f35 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:42:26.435464 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:42:26.435464 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:42:26.435464 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:42:26.435464 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:42:26.435464 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:42:26.435464 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:42:26.435464 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:42:26.435464 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:42:26.435464 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:42:26.435464 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:42:26.435464 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:42:26.435464 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 09 00:42:26.435464 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 09 00:42:26.435464 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 09 00:42:26.435464 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 09 00:42:26.436397 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:42:26.436397 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:42:26.436397 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:42:26.436397 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:42:26.436397 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:42:26.436397 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:42:26.436397 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:42:26.436397 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application with Lock( Oct 09 00:42:26.436397 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:42:26.436397 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:42:26.436397 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:42:26.436397 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:42:26.436397 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:42:26.436397 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:42:26.436397 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:42:26.436397 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:42:26.436397 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 09 00:42:26.437268 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 09 00:42:26.437268 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:42:26.437268 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Oct 09 00:42:26.445000 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 243/466] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Oct 9 00:42:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:42:26.446391 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2596d8c8-dec8-4846-b4c6-c7305d7e2f35 None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:26.466059 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c8db62-8939-4dde-92fc-d46d7a5c7bcb None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:26.510994 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652b9df1-359e-411a-94e1-878c756b5320 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:26.511817 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652b9df1-359e-411a-94e1-878c756b5320 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:26.512212 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652b9df1-359e-411a-94e1-878c756b5320 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:26.512492 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652b9df1-359e-411a-94e1-878c756b5320 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:26.513228 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:26.526549 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652b9df1-359e-411a-94e1-878c756b5320 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:26.528314 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652b9df1-359e-411a-94e1-878c756b5320 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:26.548126 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application [None req-652b9df1-359e-411a-94e1-878c756b5320 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:42:26.548126 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:42:26.548126 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:42:26.548126 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:42:26.548126 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:42:26.548126 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:42:26.548126 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:42:26.548126 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:42:26.548126 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:42:26.548126 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:42:26.548126 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:42:26.548126 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:42:26.548126 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 09 00:42:26.548126 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 09 00:42:26.548126 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 09 00:42:26.548126 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 09 00:42:26.549126 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:42:26.549126 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:42:26.549126 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:42:26.549126 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:42:26.549126 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:42:26.549126 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:42:26.549126 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:42:26.549126 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application with Lock( Oct 09 00:42:26.549126 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:42:26.549126 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:42:26.549126 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:42:26.549126 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:42:26.549126 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:42:26.549126 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:42:26.549126 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:42:26.549126 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:42:26.549126 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 09 00:42:26.555392 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 09 00:42:26.555392 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:42:26.555392 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application Oct 09 00:42:26.555392 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 224/467] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Oct 9 00:42:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:42:26.555392 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652b9df1-359e-411a-94e1-878c756b5320 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:26.558885 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2596d8c8-dec8-4846-b4c6-c7305d7e2f35 None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:26.597247 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f425715-8eb4-4b02-addb-9a08664420b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:26.597865 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f425715-8eb4-4b02-addb-9a08664420b0 None admin] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:26.598140 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f425715-8eb4-4b02-addb-9a08664420b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:26.598429 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f425715-8eb4-4b02-addb-9a08664420b0 None admin] PATH_INFO: `/v3/users` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:26.599070 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f425715-8eb4-4b02-addb-9a08664420b0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:26.600619 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f425715-8eb4-4b02-addb-9a08664420b0 None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:26.623380 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 244/468] 10.222.0.15 () {60 vars in 1132 bytes} [Sun Oct 9 00:42:26 2022] POST /identity/v3/users => generated 248 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 09 00:42:26.625649 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f425715-8eb4-4b02-addb-9a08664420b0 None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:26.670594 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:26.680914 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652b9df1-359e-411a-94e1-878c756b5320 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:26.724438 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e3521a-765a-4e69-912c-8776c11b5535 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:26.725852 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e3521a-765a-4e69-912c-8776c11b5535 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:26.726840 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e3521a-765a-4e69-912c-8776c11b5535 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:26.727304 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e3521a-765a-4e69-912c-8776c11b5535 None admin] PATH_INFO: `/v3/domains` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:26.728456 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e3521a-765a-4e69-912c-8776c11b5535 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:42:26.728971 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e3521a-765a-4e69-912c-8776c11b5535 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:26.731757 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e3521a-765a-4e69-912c-8776c11b5535 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:26.746020 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f425715-8eb4-4b02-addb-9a08664420b0 None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:26.748206 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 225/469] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Oct 9 00:42:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:42:26.750629 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e3521a-765a-4e69-912c-8776c11b5535 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:26.761079 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:26.796567 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1ac58f-4a7b-420a-ac30-71a7feef2f7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:26.797719 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1ac58f-4a7b-420a-ac30-71a7feef2f7e None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:26.798140 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1ac58f-4a7b-420a-ac30-71a7feef2f7e None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:26.799561 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1ac58f-4a7b-420a-ac30-71a7feef2f7e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:26.815175 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1ac58f-4a7b-420a-ac30-71a7feef2f7e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:26.817243 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1ac58f-4a7b-420a-ac30-71a7feef2f7e None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:26.838209 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application [None req-9d1ac58f-4a7b-420a-ac30-71a7feef2f7e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:42:26.838209 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:42:26.838209 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:42:26.838209 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:42:26.838209 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:42:26.838209 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:42:26.838209 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:42:26.838209 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:42:26.838209 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:42:26.838209 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:42:26.838209 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:42:26.838209 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:42:26.838209 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 09 00:42:26.838209 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 09 00:42:26.838209 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 09 00:42:26.838209 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 09 00:42:26.839183 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:42:26.839183 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:42:26.839183 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:42:26.839183 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:42:26.839183 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:42:26.839183 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:42:26.839183 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:42:26.839183 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application with Lock( Oct 09 00:42:26.839183 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:42:26.839183 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:42:26.839183 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:42:26.839183 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:42:26.839183 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:42:26.839183 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:42:26.839183 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:42:26.839183 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:42:26.839183 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 09 00:42:26.840033 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 09 00:42:26.840033 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:42:26.840033 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Oct 09 00:42:26.844429 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 245/470] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Oct 9 00:42:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:42:26.845289 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1ac58f-4a7b-420a-ac30-71a7feef2f7e None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:26.880698 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e3521a-765a-4e69-912c-8776c11b5535 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:26.926205 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9aade75-6a1b-486a-a97d-1a5cae631b08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:26.926819 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9aade75-6a1b-486a-a97d-1a5cae631b08 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:26.927091 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9aade75-6a1b-486a-a97d-1a5cae631b08 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:26.927448 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9aade75-6a1b-486a-a97d-1a5cae631b08 None admin] PATH_INFO: `/v3/domains` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:26.928093 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9aade75-6a1b-486a-a97d-1a5cae631b08 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:42:26.928391 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9aade75-6a1b-486a-a97d-1a5cae631b08 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:26.930221 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9aade75-6a1b-486a-a97d-1a5cae631b08 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:26.942146 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 226/471] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Oct 9 00:42:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:42:26.943471 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a723f70d-22cd-4531-99bd-65a96b025b6b None None] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:26.943750 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a723f70d-22cd-4531-99bd-65a96b025b6b None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:26.944024 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a723f70d-22cd-4531-99bd-65a96b025b6b None None] PATH_INFO: `/` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:26.945236 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 227/472] 10.222.0.15 () {54 vars in 927 bytes} [Sun Oct 9 00:42:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:42:26.945932 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a723f70d-22cd-4531-99bd-65a96b025b6b None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:26.961163 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1ac58f-4a7b-420a-ac30-71a7feef2f7e None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:26.964914 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:26.996620 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f704e6-daeb-49ca-ac06-c6bca6db285f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:26.997236 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f704e6-daeb-49ca-ac06-c6bca6db285f None admin] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:26.997510 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f704e6-daeb-49ca-ac06-c6bca6db285f None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:26.997785 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f704e6-daeb-49ca-ac06-c6bca6db285f None admin] PATH_INFO: `/v3/users` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:26.998463 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f704e6-daeb-49ca-ac06-c6bca6db285f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:27.000297 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f704e6-daeb-49ca-ac06-c6bca6db285f None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:27.023385 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 246/473] 10.222.0.15 () {60 vars in 1132 bytes} [Sun Oct 9 00:42:26 2022] POST /identity/v3/users => generated 248 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 09 00:42:27.023385 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f704e6-daeb-49ca-ac06-c6bca6db285f None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:27.060544 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:27.071316 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a723f70d-22cd-4531-99bd-65a96b025b6b None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:27.112764 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb40e2c4-fcbd-4698-85ff-e5c6628e45b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:27.113781 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb40e2c4-fcbd-4698-85ff-e5c6628e45b8 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:27.114333 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb40e2c4-fcbd-4698-85ff-e5c6628e45b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:27.114800 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb40e2c4-fcbd-4698-85ff-e5c6628e45b8 None admin] PATH_INFO: `/v3/domains` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:27.115690 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb40e2c4-fcbd-4698-85ff-e5c6628e45b8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:42:27.116215 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb40e2c4-fcbd-4698-85ff-e5c6628e45b8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:27.117721 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb40e2c4-fcbd-4698-85ff-e5c6628e45b8 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:27.139289 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 228/474] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Oct 9 00:42:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:42:27.139289 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90354900-442e-4a61-a468-c5c888f77710 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:27.139289 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90354900-442e-4a61-a468-c5c888f77710 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:27.139289 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90354900-442e-4a61-a468-c5c888f77710 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:27.158257 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-90354900-442e-4a61-a468-c5c888f77710 None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:42:27.160119 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-90354900-442e-4a61-a468-c5c888f77710 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:42:27.179156 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f704e6-daeb-49ca-ac06-c6bca6db285f None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:27.231246 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da8aea6-0118-4444-8f1f-54ec3cd0a33b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:27.232161 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da8aea6-0118-4444-8f1f-54ec3cd0a33b None admin] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:27.232518 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da8aea6-0118-4444-8f1f-54ec3cd0a33b None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:27.232797 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da8aea6-0118-4444-8f1f-54ec3cd0a33b None admin] PATH_INFO: `/v3/users` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:27.233743 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da8aea6-0118-4444-8f1f-54ec3cd0a33b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:27.235973 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da8aea6-0118-4444-8f1f-54ec3cd0a33b None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:27.242696 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 229/475] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Oct 9 00:42:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 09 00:42:27.243674 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90354900-442e-4a61-a468-c5c888f77710 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:27.248537 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:27.270040 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 247/476] 10.222.0.15 () {60 vars in 1132 bytes} [Sun Oct 9 00:42:27 2022] POST /identity/v3/users => generated 246 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 09 00:42:27.370990 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90354900-442e-4a61-a468-c5c888f77710 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:27.414023 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a89cf4f-20ab-4bc0-84e0-ff53e3d48dae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:27.415159 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a89cf4f-20ab-4bc0-84e0-ff53e3d48dae None admin] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:27.416032 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a89cf4f-20ab-4bc0-84e0-ff53e3d48dae None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:27.416504 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a89cf4f-20ab-4bc0-84e0-ff53e3d48dae None admin] PATH_INFO: `/v3/users` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:27.417389 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a89cf4f-20ab-4bc0-84e0-ff53e3d48dae None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:27.419180 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a89cf4f-20ab-4bc0-84e0-ff53e3d48dae None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:27.451293 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 230/477] 10.222.0.15 () {60 vars in 1132 bytes} [Sun Oct 9 00:42:27 2022] POST /identity/v3/users => generated 249 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 09 00:42:27.536189 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da8aea6-0118-4444-8f1f-54ec3cd0a33b None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:27.642732 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:27.675861 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da8aea6-0118-4444-8f1f-54ec3cd0a33b None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:27.712930 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6310b847-fca6-425c-b7f3-cc19275efeb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:27.713553 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6310b847-fca6-425c-b7f3-cc19275efeb3 None admin] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:27.713838 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6310b847-fca6-425c-b7f3-cc19275efeb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:27.714167 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6310b847-fca6-425c-b7f3-cc19275efeb3 None admin] PATH_INFO: `/v3/roles` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:27.714860 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6310b847-fca6-425c-b7f3-cc19275efeb3 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:27.716311 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6310b847-fca6-425c-b7f3-cc19275efeb3 None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:27.725200 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.sql.core [None req-6310b847-fca6-425c-b7f3-cc19275efeb3 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Oct 09 00:42:27.725200 dv-cinder-master-3-smb devstack@keystone.service[81525]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Oct 09 00:42:27.725200 dv-cinder-master-3-smb devstack@keystone.service[81525]: [parameters: {'id': '025e84dac24c4f708ab2ce34b0dfb27a', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Oct 09 00:42:27.725200 dv-cinder-master-3-smb devstack@keystone.service[81525]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81525) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 09 00:42:27.743171 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application [None req-6310b847-fca6-425c-b7f3-cc19275efeb3 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Oct 09 00:42:27.743171 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:42:27.743171 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 09 00:42:27.743171 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 09 00:42:27.743171 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 09 00:42:27.743171 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 09 00:42:27.743171 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 09 00:42:27.743171 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application result = self._query(query) Oct 09 00:42:27.743171 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 09 00:42:27.743171 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application conn.query(q) Oct 09 00:42:27.743171 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 09 00:42:27.743171 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 09 00:42:27.743171 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 09 00:42:27.743171 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application result.read() Oct 09 00:42:27.743171 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 09 00:42:27.744227 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 09 00:42:27.744227 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 09 00:42:27.744227 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 09 00:42:27.744227 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 09 00:42:27.744227 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 09 00:42:27.744227 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 09 00:42:27.744227 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 09 00:42:27.744227 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Oct 09 00:42:27.744227 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Oct 09 00:42:27.744227 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 09 00:42:27.744227 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Oct 09 00:42:27.744227 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:42:27.744227 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 09 00:42:27.744227 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 09 00:42:27.744227 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Oct 09 00:42:27.744227 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return ref.to_dict() Oct 09 00:42:27.744227 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 09 00:42:27.744227 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application next(self.gen) Oct 09 00:42:27.745110 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Oct 09 00:42:27.745110 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application yield resource Oct 09 00:42:27.745110 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 09 00:42:27.745110 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application next(self.gen) Oct 09 00:42:27.745110 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Oct 09 00:42:27.745110 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application self.session.rollback() Oct 09 00:42:27.745110 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 09 00:42:27.745110 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application self.force_reraise() Oct 09 00:42:27.745110 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 09 00:42:27.745110 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application raise self.value Oct 09 00:42:27.745110 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Oct 09 00:42:27.745110 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 09 00:42:27.745110 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Oct 09 00:42:27.745110 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application session.commit() Oct 09 00:42:27.745110 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 09 00:42:27.745110 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 09 00:42:27.745110 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 09 00:42:27.745974 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application self._prepare_impl() Oct 09 00:42:27.745974 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 09 00:42:27.745974 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application self.session.flush() Oct 09 00:42:27.745974 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 09 00:42:27.745974 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application self._flush(objects) Oct 09 00:42:27.745974 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 09 00:42:27.745974 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 09 00:42:27.745974 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 09 00:42:27.745974 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application compat.raise_( Oct 09 00:42:27.745974 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 09 00:42:27.745974 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application raise exception Oct 09 00:42:27.745974 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 09 00:42:27.745974 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application flush_context.execute() Oct 09 00:42:27.745974 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 09 00:42:27.745974 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application rec.execute(self) Oct 09 00:42:27.745974 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 09 00:42:27.745974 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 09 00:42:27.746842 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 09 00:42:27.746842 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 09 00:42:27.746842 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 09 00:42:27.746842 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 09 00:42:27.746842 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 09 00:42:27.746842 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 09 00:42:27.746842 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 09 00:42:27.746842 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 09 00:42:27.746842 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 09 00:42:27.746842 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 09 00:42:27.746842 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 09 00:42:27.746842 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 09 00:42:27.746842 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 09 00:42:27.746842 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 09 00:42:27.746842 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 09 00:42:27.746842 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application raise exception Oct 09 00:42:27.747690 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 09 00:42:27.747690 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 09 00:42:27.747690 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 09 00:42:27.747690 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 09 00:42:27.747690 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 09 00:42:27.747690 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application result = self._query(query) Oct 09 00:42:27.747690 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 09 00:42:27.747690 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application conn.query(q) Oct 09 00:42:27.747690 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 09 00:42:27.747690 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 09 00:42:27.747690 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 09 00:42:27.747690 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application result.read() Oct 09 00:42:27.747690 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 09 00:42:27.747690 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 09 00:42:27.747690 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 09 00:42:27.747690 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 09 00:42:27.750191 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 09 00:42:27.750191 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 09 00:42:27.750191 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 09 00:42:27.750191 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 09 00:42:27.750191 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Oct 09 00:42:27.750191 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Oct 09 00:42:27.750191 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application [parameters: {'id': '025e84dac24c4f708ab2ce34b0dfb27a', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Oct 09 00:42:27.750191 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 09 00:42:27.750191 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Oct 09 00:42:27.750191 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 09 00:42:27.750191 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Oct 09 00:42:27.750191 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:42:27.750191 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:42:27.750191 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:42:27.750191 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:42:27.750191 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:42:27.752079 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:42:27.752079 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:42:27.752079 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:42:27.752079 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:42:27.752079 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:42:27.752079 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:42:27.752079 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Oct 09 00:42:27.752079 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Oct 09 00:42:27.752079 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:42:27.752079 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:42:27.752079 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Oct 09 00:42:27.752079 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Oct 09 00:42:27.752079 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 09 00:42:27.752079 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 09 00:42:27.752079 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Oct 09 00:42:27.752079 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Oct 09 00:42:27.754037 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 248/478] 10.222.0.15 () {60 vars in 1131 bytes} [Sun Oct 9 00:42:27 2022] POST /identity/v3/roles => generated 144 bytes in 209 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:42:27.754167 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a89cf4f-20ab-4bc0-84e0-ff53e3d48dae None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:27.820764 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:27.862764 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a89cf4f-20ab-4bc0-84e0-ff53e3d48dae None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:27.898323 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e08a92-a46f-4660-8bf7-3e97e98ef41a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:27.898890 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e08a92-a46f-4660-8bf7-3e97e98ef41a None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:27.899169 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e08a92-a46f-4660-8bf7-3e97e98ef41a None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:27.899472 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e08a92-a46f-4660-8bf7-3e97e98ef41a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:27.910535 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e08a92-a46f-4660-8bf7-3e97e98ef41a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 09 00:42:27.915979 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application [None req-85e08a92-a46f-4660-8bf7-3e97e98ef41a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 09 00:42:27.915979 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:42:27.915979 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:42:27.915979 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:42:27.915979 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:42:27.915979 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:42:27.915979 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:42:27.915979 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:42:27.915979 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:42:27.915979 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:42:27.915979 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:42:27.915979 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:42:27.915979 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 09 00:42:27.915979 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 09 00:42:27.915979 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 09 00:42:27.915979 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 09 00:42:27.917965 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 09 00:42:27.917965 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 09 00:42:27.917965 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 09 00:42:27.917965 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 09 00:42:27.917965 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:42:27.917965 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:42:27.917965 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:42:27.917965 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:42:27.917965 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:42:27.917965 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:42:27.917965 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:42:27.917965 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application with Lock( Oct 09 00:42:27.917965 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:42:27.917965 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:42:27.917965 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:42:27.917965 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:42:27.919952 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:42:27.919952 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:42:27.919952 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:42:27.919952 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:42:27.919952 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 09 00:42:27.919952 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 09 00:42:27.919952 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 09 00:42:27.919952 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 09 00:42:27.919952 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 09 00:42:27.919952 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 09 00:42:27.919952 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 09 00:42:27.919952 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application Oct 09 00:42:27.919952 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 231/479] 10.222.0.15 () {56 vars in 1114 bytes} [Sun Oct 9 00:42:27 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:42:27.923424 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6310b847-fca6-425c-b7f3-cc19275efeb3 None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:28.082512 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6310b847-fca6-425c-b7f3-cc19275efeb3 None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:28.132941 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a530ce-0d8c-41d6-809a-304628655636 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:28.133576 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a530ce-0d8c-41d6-809a-304628655636 None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:28.133857 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a530ce-0d8c-41d6-809a-304628655636 None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:28.134221 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a530ce-0d8c-41d6-809a-304628655636 None admin] PATH_INFO: `/v3/roles` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:28.134909 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a530ce-0d8c-41d6-809a-304628655636 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:42:28.135208 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a530ce-0d8c-41d6-809a-304628655636 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:28.136793 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a530ce-0d8c-41d6-809a-304628655636 None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:28.144169 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:28.151672 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 249/480] 10.222.0.15 () {56 vars in 1111 bytes} [Sun Oct 9 00:42:27 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:42:29.202645 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75828975-3d74-405e-8035-37a8d1dcac85 None None] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:29.203363 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75828975-3d74-405e-8035-37a8d1dcac85 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:29.203363 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75828975-3d74-405e-8035-37a8d1dcac85 None None] PATH_INFO: `/` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:29.204787 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 232/481] 10.222.0.15 () {54 vars in 927 bytes} [Sun Oct 9 00:42:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:42:29.223817 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51602f85-2965-419c-ac7d-2da3c90aa4a8 None None] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:29.224340 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51602f85-2965-419c-ac7d-2da3c90aa4a8 None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:29.224340 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51602f85-2965-419c-ac7d-2da3c90aa4a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:29.249817 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.auth.core [None req-51602f85-2965-419c-ac7d-2da3c90aa4a8 None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:42:29.251071 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-51602f85-2965-419c-ac7d-2da3c90aa4a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:42:29.337651 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 250/482] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Oct 9 00:42:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 09 00:42:29.659611 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75828975-3d74-405e-8035-37a8d1dcac85 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:29.791964 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75828975-3d74-405e-8035-37a8d1dcac85 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:29.811347 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e8f06d-39de-423a-91a0-e64d961bf2e4 None None] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:29.811347 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e8f06d-39de-423a-91a0-e64d961bf2e4 None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:29.811347 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e8f06d-39de-423a-91a0-e64d961bf2e4 None None] PATH_INFO: `/` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:29.812118 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 251/483] 10.222.0.15 () {54 vars in 927 bytes} [Sun Oct 9 00:42:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:42:29.813751 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:29.817917 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86494802-7fb1-4963-89f4-cbc91fa8dc53 None None] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:29.818196 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86494802-7fb1-4963-89f4-cbc91fa8dc53 None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:29.818469 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86494802-7fb1-4963-89f4-cbc91fa8dc53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:29.832548 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60218e25-13d2-4b75-86b2-1782de78a8b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:29.833190 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60218e25-13d2-4b75-86b2-1782de78a8b0 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:29.833470 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60218e25-13d2-4b75-86b2-1782de78a8b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:29.833743 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60218e25-13d2-4b75-86b2-1782de78a8b0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:29.845242 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60218e25-13d2-4b75-86b2-1782de78a8b0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 09 00:42:29.850232 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application [None req-60218e25-13d2-4b75-86b2-1782de78a8b0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 09 00:42:29.850232 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:42:29.850232 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:42:29.850232 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:42:29.850232 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:42:29.850232 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:42:29.850232 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:42:29.850232 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:42:29.850232 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:42:29.850232 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:42:29.850232 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:42:29.850232 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:42:29.850232 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 09 00:42:29.850232 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 09 00:42:29.850232 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 09 00:42:29.850232 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 09 00:42:29.852381 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 09 00:42:29.852381 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 09 00:42:29.852381 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 09 00:42:29.852381 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 09 00:42:29.852381 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:42:29.852381 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:42:29.852381 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:42:29.852381 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:42:29.852381 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:42:29.852381 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:42:29.852381 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:42:29.852381 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application with Lock( Oct 09 00:42:29.852381 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:42:29.852381 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:42:29.852381 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:42:29.852381 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:42:29.854336 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:42:29.854336 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:42:29.854336 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:42:29.854336 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:42:29.854336 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 09 00:42:29.854336 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 09 00:42:29.854336 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 09 00:42:29.854336 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 09 00:42:29.854336 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 09 00:42:29.854336 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 09 00:42:29.854336 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 09 00:42:29.854336 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application Oct 09 00:42:29.855764 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 233/484] 10.222.0.15 () {56 vars in 1102 bytes} [Sun Oct 9 00:42:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:42:29.860261 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.auth.core [None req-86494802-7fb1-4963-89f4-cbc91fa8dc53 None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:42:29.861487 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-86494802-7fb1-4963-89f4-cbc91fa8dc53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:42:29.861823 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60218e25-13d2-4b75-86b2-1782de78a8b0 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:29.982850 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60218e25-13d2-4b75-86b2-1782de78a8b0 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:30.021557 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29adc28-dd38-4e11-8987-2c5542fe3565 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:30.022552 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29adc28-dd38-4e11-8987-2c5542fe3565 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:30.023026 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29adc28-dd38-4e11-8987-2c5542fe3565 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:30.023541 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29adc28-dd38-4e11-8987-2c5542fe3565 None admin] PATH_INFO: `/v3/roles` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:30.024480 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29adc28-dd38-4e11-8987-2c5542fe3565 None admin] RBAC: Adding query filter params (name=service) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:42:30.025154 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29adc28-dd38-4e11-8987-2c5542fe3565 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:30.026772 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29adc28-dd38-4e11-8987-2c5542fe3565 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:30.037473 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 252/485] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Oct 9 00:42:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 09 00:42:30.043281 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 234/486] 10.222.0.15 () {56 vars in 1103 bytes} [Sun Oct 9 00:42:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:42:30.045039 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86494802-7fb1-4963-89f4-cbc91fa8dc53 None None] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:30.079040 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347aa46e-87d6-49eb-a911-88c454be5cd8 None None] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:30.079391 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347aa46e-87d6-49eb-a911-88c454be5cd8 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:30.079612 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347aa46e-87d6-49eb-a911-88c454be5cd8 None None] PATH_INFO: `/` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:30.081214 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 235/487] 10.222.0.15 () {54 vars in 927 bytes} [Sun Oct 9 00:42:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 09 00:42:30.089985 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94b1976-fc23-4d07-8993-851cce3bc3c5 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:30.089985 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94b1976-fc23-4d07-8993-851cce3bc3c5 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:30.089985 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94b1976-fc23-4d07-8993-851cce3bc3c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:30.125025 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-c94b1976-fc23-4d07-8993-851cce3bc3c5 None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:42:30.126237 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-c94b1976-fc23-4d07-8993-851cce3bc3c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:42:30.140816 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:30.181355 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:30.217185 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86494802-7fb1-4963-89f4-cbc91fa8dc53 None None] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:30.244282 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 236/488] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Oct 9 00:42:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 09 00:42:30.255527 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dea19ef-b2af-4887-8c11-e859b87a9bd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:30.256778 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dea19ef-b2af-4887-8c11-e859b87a9bd6 None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:30.257316 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dea19ef-b2af-4887-8c11-e859b87a9bd6 None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:30.257775 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dea19ef-b2af-4887-8c11-e859b87a9bd6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:30.268518 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dea19ef-b2af-4887-8c11-e859b87a9bd6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:30.270346 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dea19ef-b2af-4887-8c11-e859b87a9bd6 None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:30.285821 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application [None req-8dea19ef-b2af-4887-8c11-e859b87a9bd6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:42:30.285821 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:42:30.285821 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:42:30.285821 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:42:30.285821 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:42:30.285821 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:42:30.285821 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:42:30.285821 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:42:30.285821 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:42:30.285821 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:42:30.285821 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:42:30.285821 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:42:30.285821 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 09 00:42:30.285821 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 09 00:42:30.285821 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 09 00:42:30.285821 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 09 00:42:30.286744 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:42:30.286744 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:42:30.286744 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:42:30.286744 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:42:30.286744 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:42:30.286744 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:42:30.286744 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:42:30.286744 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application with Lock( Oct 09 00:42:30.286744 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:42:30.286744 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:42:30.286744 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:42:30.286744 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:42:30.286744 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:42:30.286744 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:42:30.286744 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:42:30.286744 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:42:30.286744 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 09 00:42:30.287711 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 09 00:42:30.287711 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:42:30.287711 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Oct 09 00:42:30.294206 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 253/489] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Oct 9 00:42:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 09 00:42:30.295850 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94b1976-fc23-4d07-8993-851cce3bc3c5 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:30.406049 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94b1976-fc23-4d07-8993-851cce3bc3c5 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:30.458846 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dea19ef-b2af-4887-8c11-e859b87a9bd6 None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:30.460920 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89531b17-1234-4f15-b0e2-300a0f193891 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:30.461535 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89531b17-1234-4f15-b0e2-300a0f193891 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:30.461805 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89531b17-1234-4f15-b0e2-300a0f193891 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:30.462304 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89531b17-1234-4f15-b0e2-300a0f193891 None admin] PATH_INFO: `/v3/domains` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:30.462982 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89531b17-1234-4f15-b0e2-300a0f193891 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:42:30.464219 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89531b17-1234-4f15-b0e2-300a0f193891 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:30.465623 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89531b17-1234-4f15-b0e2-300a0f193891 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:30.479615 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 237/490] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Oct 9 00:42:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:42:30.481227 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e41107c-78d8-4704-9a59-a94b495ad3f0 None None] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:30.481504 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e41107c-78d8-4704-9a59-a94b495ad3f0 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:30.481773 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e41107c-78d8-4704-9a59-a94b495ad3f0 None None] PATH_INFO: `/` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:30.483305 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 238/491] 10.222.0.15 () {54 vars in 927 bytes} [Sun Oct 9 00:42:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:42:30.488644 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e41107c-78d8-4704-9a59-a94b495ad3f0 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:30.530618 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:30.583232 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dea19ef-b2af-4887-8c11-e859b87a9bd6 None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:30.600349 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:30.609379 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e41107c-78d8-4704-9a59-a94b495ad3f0 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:30.626708 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e5743f-3758-493e-adfe-16cd05f80c17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:30.627787 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e5743f-3758-493e-adfe-16cd05f80c17 None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:30.628251 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e5743f-3758-493e-adfe-16cd05f80c17 None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:30.628739 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e5743f-3758-493e-adfe-16cd05f80c17 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:30.640316 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e5743f-3758-493e-adfe-16cd05f80c17 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 09 00:42:30.643617 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2af2ee4-cf15-40cc-a7da-866fc2a01518 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:30.644230 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2af2ee4-cf15-40cc-a7da-866fc2a01518 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:30.644508 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2af2ee4-cf15-40cc-a7da-866fc2a01518 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:30.644775 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2af2ee4-cf15-40cc-a7da-866fc2a01518 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:30.645304 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application [None req-72e5743f-3758-493e-adfe-16cd05f80c17 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 09 00:42:30.645304 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:42:30.645304 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:42:30.645304 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:42:30.645304 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:42:30.645304 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:42:30.645304 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:42:30.645304 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:42:30.645304 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:42:30.645304 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:42:30.645304 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:42:30.645304 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:42:30.645304 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 09 00:42:30.645304 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 09 00:42:30.645304 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 09 00:42:30.645304 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 09 00:42:30.646160 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 09 00:42:30.646160 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 09 00:42:30.646160 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 09 00:42:30.646160 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 09 00:42:30.646160 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:42:30.646160 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:42:30.646160 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:42:30.646160 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:42:30.646160 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:42:30.646160 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:42:30.646160 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:42:30.646160 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application with Lock( Oct 09 00:42:30.646160 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:42:30.646160 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:42:30.646160 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:42:30.646160 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:42:30.646941 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:42:30.646941 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:42:30.646941 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:42:30.646941 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:42:30.646941 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 09 00:42:30.646941 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 09 00:42:30.646941 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 09 00:42:30.646941 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 09 00:42:30.646941 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 09 00:42:30.646941 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 09 00:42:30.646941 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 09 00:42:30.646941 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Oct 09 00:42:30.646941 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 254/492] 10.222.0.15 () {56 vars in 1102 bytes} [Sun Oct 9 00:42:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:42:30.647621 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e5bf2b-e775-46b0-8fdb-d656b4f88818 None None] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:30.648237 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e5bf2b-e775-46b0-8fdb-d656b4f88818 None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:30.648237 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e5bf2b-e775-46b0-8fdb-d656b4f88818 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:30.659346 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2af2ee4-cf15-40cc-a7da-866fc2a01518 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:30.660821 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2af2ee4-cf15-40cc-a7da-866fc2a01518 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:30.667460 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.auth.core [None req-a2e5bf2b-e775-46b0-8fdb-d656b4f88818 None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:42:30.668664 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-a2e5bf2b-e775-46b0-8fdb-d656b4f88818 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:42:30.674827 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application [None req-a2af2ee4-cf15-40cc-a7da-866fc2a01518 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Oct 09 00:42:30.674827 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:42:30.674827 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:42:30.674827 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:42:30.674827 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:42:30.674827 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:42:30.674827 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:42:30.674827 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:42:30.674827 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:42:30.674827 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:42:30.674827 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:42:30.674827 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:42:30.674827 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 09 00:42:30.674827 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 09 00:42:30.674827 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 09 00:42:30.674827 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 09 00:42:30.675768 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:42:30.675768 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:42:30.675768 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 09 00:42:30.675768 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 09 00:42:30.675768 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 09 00:42:30.675768 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 09 00:42:30.675768 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:42:30.675768 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:42:30.675768 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:42:30.675768 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:42:30.675768 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:42:30.675768 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application with Lock( Oct 09 00:42:30.675768 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:42:30.675768 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:42:30.675768 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:42:30.675768 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:42:30.675768 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:42:30.675768 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:42:30.676658 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:42:30.676658 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:42:30.676658 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 09 00:42:30.676658 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 09 00:42:30.676658 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 09 00:42:30.676658 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 09 00:42:30.676658 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 09 00:42:30.676658 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 09 00:42:30.676658 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Oct 09 00:42:30.676658 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application Oct 09 00:42:30.677892 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 239/493] 10.222.0.15 () {56 vars in 1099 bytes} [Sun Oct 9 00:42:30 2022] GET /identity/v3/users/glance => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:42:30.678736 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2af2ee4-cf15-40cc-a7da-866fc2a01518 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:30.745921 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 255/494] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Oct 9 00:42:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 09 00:42:30.747109 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e5bf2b-e775-46b0-8fdb-d656b4f88818 None None] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:30.774413 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:30.784953 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2af2ee4-cf15-40cc-a7da-866fc2a01518 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:30.821307 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef88b806-2707-4045-b2af-74bded5c52d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:30.821891 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef88b806-2707-4045-b2af-74bded5c52d6 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:30.822164 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef88b806-2707-4045-b2af-74bded5c52d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:30.822431 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef88b806-2707-4045-b2af-74bded5c52d6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:30.833263 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef88b806-2707-4045-b2af-74bded5c52d6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 09 00:42:30.838658 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application [None req-ef88b806-2707-4045-b2af-74bded5c52d6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 09 00:42:30.838658 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:42:30.838658 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:42:30.838658 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:42:30.838658 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:42:30.838658 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:42:30.838658 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:42:30.838658 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:42:30.838658 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:42:30.838658 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:42:30.838658 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:42:30.838658 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:42:30.838658 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 09 00:42:30.838658 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 09 00:42:30.838658 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 09 00:42:30.838658 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 09 00:42:30.839575 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 09 00:42:30.839575 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 09 00:42:30.839575 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 09 00:42:30.839575 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 09 00:42:30.839575 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:42:30.839575 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:42:30.839575 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:42:30.839575 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:42:30.839575 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:42:30.839575 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:42:30.839575 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:42:30.839575 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application with Lock( Oct 09 00:42:30.839575 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:42:30.839575 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:42:30.839575 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:42:30.839575 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:42:30.840372 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:42:30.840372 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:42:30.840372 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:42:30.840372 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:42:30.840372 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 09 00:42:30.840372 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 09 00:42:30.840372 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 09 00:42:30.840372 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 09 00:42:30.840372 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 09 00:42:30.840372 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 09 00:42:30.840372 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 09 00:42:30.840372 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application Oct 09 00:42:30.840372 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 240/495] 10.222.0.15 () {56 vars in 1102 bytes} [Sun Oct 9 00:42:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:42:30.841010 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef88b806-2707-4045-b2af-74bded5c52d6 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:30.886971 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e5bf2b-e775-46b0-8fdb-d656b4f88818 None None] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:30.899761 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:30.927095 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84bca0e-1177-4ee1-aab2-c954a5bf2ec5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:30.927778 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84bca0e-1177-4ee1-aab2-c954a5bf2ec5 None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:30.928051 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84bca0e-1177-4ee1-aab2-c954a5bf2ec5 None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:30.928315 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84bca0e-1177-4ee1-aab2-c954a5bf2ec5 None admin] PATH_INFO: `/v3/roles` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:30.929001 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84bca0e-1177-4ee1-aab2-c954a5bf2ec5 None admin] RBAC: Adding query filter params (name=service) {{(pid=81525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:42:30.929334 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84bca0e-1177-4ee1-aab2-c954a5bf2ec5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:30.931149 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84bca0e-1177-4ee1-aab2-c954a5bf2ec5 None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:30.941041 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 256/496] 10.222.0.15 () {56 vars in 1103 bytes} [Sun Oct 9 00:42:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:42:30.941909 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84bca0e-1177-4ee1-aab2-c954a5bf2ec5 None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:30.969059 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef88b806-2707-4045-b2af-74bded5c52d6 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:31.006780 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371da937-cb02-4cc4-a338-5b1120748ea5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:31.007419 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371da937-cb02-4cc4-a338-5b1120748ea5 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:31.007699 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371da937-cb02-4cc4-a338-5b1120748ea5 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:31.007974 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371da937-cb02-4cc4-a338-5b1120748ea5 None admin] PATH_INFO: `/v3/users` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:31.008716 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371da937-cb02-4cc4-a338-5b1120748ea5 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:42:31.009107 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371da937-cb02-4cc4-a338-5b1120748ea5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:31.010737 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371da937-cb02-4cc4-a338-5b1120748ea5 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:31.051552 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84bca0e-1177-4ee1-aab2-c954a5bf2ec5 None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:31.052029 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 241/497] 10.222.0.15 () {56 vars in 1137 bytes} [Sun Oct 9 00:42:30 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:42:31.052900 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371da937-cb02-4cc4-a338-5b1120748ea5 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:31.064867 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:31.090462 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3cdd21-3d2d-47d0-87ec-018c119b5087 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:31.091074 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3cdd21-3d2d-47d0-87ec-018c119b5087 None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:31.091386 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3cdd21-3d2d-47d0-87ec-018c119b5087 None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:31.091655 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3cdd21-3d2d-47d0-87ec-018c119b5087 None admin] PATH_INFO: `/v3/roles` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:31.092346 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3cdd21-3d2d-47d0-87ec-018c119b5087 None admin] RBAC: Adding query filter params (name=service) {{(pid=81525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:42:31.092646 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3cdd21-3d2d-47d0-87ec-018c119b5087 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:31.094026 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3cdd21-3d2d-47d0-87ec-018c119b5087 None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:31.102223 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 257/498] 10.222.0.15 () {56 vars in 1103 bytes} [Sun Oct 9 00:42:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:42:31.103616 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71276eab-8c87-4213-9122-1c89ddf272fb None None] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:31.103903 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71276eab-8c87-4213-9122-1c89ddf272fb None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:31.104169 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71276eab-8c87-4213-9122-1c89ddf272fb None None] PATH_INFO: `/` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:31.105356 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 258/499] 10.222.0.15 () {54 vars in 927 bytes} [Sun Oct 9 00:42:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:42:31.106036 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71276eab-8c87-4213-9122-1c89ddf272fb None None] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:31.133785 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:31.161688 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371da937-cb02-4cc4-a338-5b1120748ea5 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:31.195125 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acba2b21-6fc0-4f74-8f96-8adbd6d86aa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:31.195786 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acba2b21-6fc0-4f74-8f96-8adbd6d86aa3 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:31.196060 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acba2b21-6fc0-4f74-8f96-8adbd6d86aa3 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:31.196351 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acba2b21-6fc0-4f74-8f96-8adbd6d86aa3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:31.206148 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acba2b21-6fc0-4f74-8f96-8adbd6d86aa3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:31.206681 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71276eab-8c87-4213-9122-1c89ddf272fb None None] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:31.207654 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acba2b21-6fc0-4f74-8f96-8adbd6d86aa3 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:31.222329 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application [None req-acba2b21-6fc0-4f74-8f96-8adbd6d86aa3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:42:31.222329 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:42:31.222329 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:42:31.222329 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:42:31.222329 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:42:31.222329 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:42:31.222329 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:42:31.222329 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:42:31.222329 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:42:31.222329 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:42:31.222329 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:42:31.222329 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:42:31.222329 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 09 00:42:31.222329 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 09 00:42:31.222329 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 09 00:42:31.222329 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 09 00:42:31.223242 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:42:31.223242 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:42:31.223242 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:42:31.223242 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:42:31.223242 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:42:31.223242 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:42:31.223242 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:42:31.223242 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application with Lock( Oct 09 00:42:31.223242 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:42:31.223242 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:42:31.223242 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:42:31.223242 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:42:31.223242 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:42:31.223242 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:42:31.223242 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:42:31.223242 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:42:31.223242 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 09 00:42:31.224156 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 09 00:42:31.224156 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:42:31.224156 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application Oct 09 00:42:31.224156 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 242/500] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Oct 9 00:42:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:42:31.224376 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acba2b21-6fc0-4f74-8f96-8adbd6d86aa3 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:31.243231 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7ba89f-e903-44c2-9b7b-8aa7cea75245 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:31.243881 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7ba89f-e903-44c2-9b7b-8aa7cea75245 None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:31.244157 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7ba89f-e903-44c2-9b7b-8aa7cea75245 None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:31.244423 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7ba89f-e903-44c2-9b7b-8aa7cea75245 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:31.256141 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7ba89f-e903-44c2-9b7b-8aa7cea75245 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 09 00:42:31.261306 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application [None req-3c7ba89f-e903-44c2-9b7b-8aa7cea75245 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 09 00:42:31.261306 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:42:31.261306 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:42:31.261306 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:42:31.261306 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:42:31.261306 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:42:31.261306 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:42:31.261306 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:42:31.261306 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:42:31.261306 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:42:31.261306 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:42:31.261306 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:42:31.261306 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 09 00:42:31.261306 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 09 00:42:31.261306 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 09 00:42:31.261306 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 09 00:42:31.262445 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 09 00:42:31.262445 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 09 00:42:31.262445 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 09 00:42:31.262445 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 09 00:42:31.262445 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:42:31.262445 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:42:31.262445 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:42:31.262445 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:42:31.262445 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:42:31.262445 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:42:31.262445 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:42:31.262445 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application with Lock( Oct 09 00:42:31.262445 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:42:31.262445 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:42:31.262445 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:42:31.262445 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:42:31.263449 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:42:31.263449 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:42:31.263449 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:42:31.263449 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:42:31.263449 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 09 00:42:31.263449 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 09 00:42:31.263449 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 09 00:42:31.263449 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 09 00:42:31.263449 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 09 00:42:31.263449 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 09 00:42:31.263449 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 09 00:42:31.263449 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Oct 09 00:42:31.263449 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 259/501] 10.222.0.15 () {56 vars in 1102 bytes} [Sun Oct 9 00:42:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:42:31.263449 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7ba89f-e903-44c2-9b7b-8aa7cea75245 None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:31.291066 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:31.334857 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acba2b21-6fc0-4f74-8f96-8adbd6d86aa3 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:31.353112 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:31.368106 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7ba89f-e903-44c2-9b7b-8aa7cea75245 None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:31.369537 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52d0738-6aec-4007-9ae3-59f661f10401 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:31.370144 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52d0738-6aec-4007-9ae3-59f661f10401 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:31.370441 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52d0738-6aec-4007-9ae3-59f661f10401 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:31.370706 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52d0738-6aec-4007-9ae3-59f661f10401 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:31.402147 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b167c163-4519-4a85-acd1-0750f4ac68a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:31.402773 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b167c163-4519-4a85-acd1-0750f4ac68a1 None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:31.403045 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b167c163-4519-4a85-acd1-0750f4ac68a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:31.403343 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b167c163-4519-4a85-acd1-0750f4ac68a1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:31.413069 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b167c163-4519-4a85-acd1-0750f4ac68a1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:31.414556 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b167c163-4519-4a85-acd1-0750f4ac68a1 None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:31.429485 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application [None req-b167c163-4519-4a85-acd1-0750f4ac68a1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:42:31.429485 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:42:31.429485 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:42:31.429485 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:42:31.429485 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:42:31.429485 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:42:31.429485 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:42:31.429485 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:42:31.429485 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:42:31.429485 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:42:31.429485 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:42:31.429485 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:42:31.429485 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 09 00:42:31.429485 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 09 00:42:31.429485 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 09 00:42:31.429485 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 09 00:42:31.430439 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:42:31.430439 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:42:31.430439 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:42:31.430439 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:42:31.430439 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:42:31.430439 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:42:31.430439 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:42:31.430439 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application with Lock( Oct 09 00:42:31.430439 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:42:31.430439 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:42:31.430439 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:42:31.430439 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:42:31.430439 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:42:31.430439 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:42:31.430439 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:42:31.430439 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:42:31.430439 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 09 00:42:31.431390 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 09 00:42:31.431390 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:42:31.431390 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Oct 09 00:42:31.431390 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 260/502] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Oct 9 00:42:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:42:31.432130 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f14a60b-b1ac-4659-97dc-1c21da8e0f00 None None] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:31.432130 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f14a60b-b1ac-4659-97dc-1c21da8e0f00 None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:31.432378 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f14a60b-b1ac-4659-97dc-1c21da8e0f00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:31.444470 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52d0738-6aec-4007-9ae3-59f661f10401 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:31.445971 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52d0738-6aec-4007-9ae3-59f661f10401 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:31.451183 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.auth.core [None req-4f14a60b-b1ac-4659-97dc-1c21da8e0f00 None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:42:31.452409 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-4f14a60b-b1ac-4659-97dc-1c21da8e0f00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:42:31.504188 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:31.517925 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 261/503] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Oct 9 00:42:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 09 00:42:31.531482 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f14a60b-b1ac-4659-97dc-1c21da8e0f00 None None] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:31.549717 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 243/504] 10.222.0.15 () {58 vars in 1282 bytes} [Sun Oct 9 00:42:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 09 00:42:31.550578 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52d0738-6aec-4007-9ae3-59f661f10401 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:31.590773 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:31.628941 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f14a60b-b1ac-4659-97dc-1c21da8e0f00 None None] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:31.660363 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52d0738-6aec-4007-9ae3-59f661f10401 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:31.663448 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8d2b4c-1af5-42b1-8d1b-b0fa83a6b7f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:31.664060 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8d2b4c-1af5-42b1-8d1b-b0fa83a6b7f8 None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:31.664337 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8d2b4c-1af5-42b1-8d1b-b0fa83a6b7f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:31.664599 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8d2b4c-1af5-42b1-8d1b-b0fa83a6b7f8 None admin] PATH_INFO: `/v3/domains` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:31.665326 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8d2b4c-1af5-42b1-8d1b-b0fa83a6b7f8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:42:31.665626 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8d2b4c-1af5-42b1-8d1b-b0fa83a6b7f8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:31.667063 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8d2b4c-1af5-42b1-8d1b-b0fa83a6b7f8 None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:31.682912 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 262/505] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Oct 9 00:42:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:42:31.682912 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8d2b4c-1af5-42b1-8d1b-b0fa83a6b7f8 None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:31.703647 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684b2958-e6f2-418a-af0b-154b7a098ec9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:31.704348 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684b2958-e6f2-418a-af0b-154b7a098ec9 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:31.704733 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684b2958-e6f2-418a-af0b-154b7a098ec9 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:31.705002 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684b2958-e6f2-418a-af0b-154b7a098ec9 None admin] PATH_INFO: `/v3/roles` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:31.705666 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684b2958-e6f2-418a-af0b-154b7a098ec9 None admin] RBAC: Adding query filter params (name=service) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:42:31.705964 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684b2958-e6f2-418a-af0b-154b7a098ec9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:31.707651 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684b2958-e6f2-418a-af0b-154b7a098ec9 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:31.717387 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 244/506] 10.222.0.15 () {56 vars in 1103 bytes} [Sun Oct 9 00:42:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:42:31.718325 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684b2958-e6f2-418a-af0b-154b7a098ec9 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:31.748928 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:31.786695 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8d2b4c-1af5-42b1-8d1b-b0fa83a6b7f8 None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:31.812195 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:31.820503 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356a05b3-faa1-417f-804c-10bd95ce5e2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:31.821118 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356a05b3-faa1-417f-804c-10bd95ce5e2a None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:31.821429 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356a05b3-faa1-417f-804c-10bd95ce5e2a None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:31.821738 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356a05b3-faa1-417f-804c-10bd95ce5e2a None admin] PATH_INFO: `/v3/domains` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:31.822384 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356a05b3-faa1-417f-804c-10bd95ce5e2a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:42:31.822690 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356a05b3-faa1-417f-804c-10bd95ce5e2a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:31.824140 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356a05b3-faa1-417f-804c-10bd95ce5e2a None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:31.826518 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684b2958-e6f2-418a-af0b-154b7a098ec9 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:31.835895 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 263/507] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Oct 9 00:42:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:42:31.836725 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356a05b3-faa1-417f-804c-10bd95ce5e2a None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:31.861035 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57b2a4d-ed8e-4392-82e6-8e82d08b19ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:31.861591 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57b2a4d-ed8e-4392-82e6-8e82d08b19ee None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:31.861864 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57b2a4d-ed8e-4392-82e6-8e82d08b19ee None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:31.862140 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57b2a4d-ed8e-4392-82e6-8e82d08b19ee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:31.872715 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57b2a4d-ed8e-4392-82e6-8e82d08b19ee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:31.874578 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57b2a4d-ed8e-4392-82e6-8e82d08b19ee None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:31.890094 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application [None req-a57b2a4d-ed8e-4392-82e6-8e82d08b19ee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:42:31.890094 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:42:31.890094 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:42:31.890094 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:42:31.890094 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:42:31.890094 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:42:31.890094 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:42:31.890094 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:42:31.890094 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:42:31.890094 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:42:31.890094 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:42:31.890094 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:42:31.890094 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 09 00:42:31.890094 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 09 00:42:31.890094 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 09 00:42:31.890094 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 09 00:42:31.896042 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:42:31.896042 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:42:31.896042 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:42:31.896042 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:42:31.896042 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:42:31.896042 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:42:31.896042 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:42:31.896042 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application with Lock( Oct 09 00:42:31.896042 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:42:31.896042 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:42:31.896042 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:42:31.896042 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:42:31.896042 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:42:31.896042 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:42:31.896042 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:42:31.896042 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:42:31.896042 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 09 00:42:31.897155 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 09 00:42:31.897155 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:42:31.897155 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application Oct 09 00:42:31.897155 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 245/508] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Oct 9 00:42:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:42:31.897155 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57b2a4d-ed8e-4392-82e6-8e82d08b19ee None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:31.936107 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356a05b3-faa1-417f-804c-10bd95ce5e2a None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:31.969427 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:31.971410 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7249fa82-c4c8-416c-a753-bcef6d4ed0a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:31.972376 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7249fa82-c4c8-416c-a753-bcef6d4ed0a8 None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:31.972376 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7249fa82-c4c8-416c-a753-bcef6d4ed0a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:31.972589 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7249fa82-c4c8-416c-a753-bcef6d4ed0a8 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:31.980438 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7249fa82-c4c8-416c-a753-bcef6d4ed0a8 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:31.981899 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7249fa82-c4c8-416c-a753-bcef6d4ed0a8 None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:31.995124 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application [None req-7249fa82-c4c8-416c-a753-bcef6d4ed0a8 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 09 00:42:31.995124 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:42:31.995124 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:42:31.995124 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:42:31.995124 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:42:31.995124 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:42:31.995124 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:42:31.995124 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:42:31.995124 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:42:31.995124 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:42:31.995124 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:42:31.995124 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:42:31.995124 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 09 00:42:31.995124 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 09 00:42:31.995124 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 09 00:42:31.995124 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 09 00:42:31.996077 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:42:31.996077 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:42:31.996077 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 09 00:42:31.996077 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 09 00:42:31.996077 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 09 00:42:31.996077 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 09 00:42:31.996077 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:42:31.996077 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:42:31.996077 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:42:31.996077 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:42:31.996077 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:42:31.996077 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application with Lock( Oct 09 00:42:31.996077 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:42:31.996077 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:42:31.996077 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:42:31.996077 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:42:31.996077 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:42:31.996077 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:42:31.996940 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:42:31.996940 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:42:31.996940 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 09 00:42:31.996940 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 09 00:42:31.996940 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 09 00:42:31.996940 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 09 00:42:31.996940 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 09 00:42:31.996940 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 09 00:42:31.996940 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 09 00:42:31.996940 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Oct 09 00:42:31.997430 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57b2a4d-ed8e-4392-82e6-8e82d08b19ee None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:31.997499 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 264/509] 10.222.0.15 () {56 vars in 1099 bytes} [Sun Oct 9 00:42:31 2022] GET /identity/v3/users/cinder => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:42:31.997499 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7249fa82-c4c8-416c-a753-bcef6d4ed0a8 None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:32.035721 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da962ae2-f472-47c3-bc66-fc4c5805a67e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:32.036410 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da962ae2-f472-47c3-bc66-fc4c5805a67e None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:32.036693 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da962ae2-f472-47c3-bc66-fc4c5805a67e None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:32.036967 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da962ae2-f472-47c3-bc66-fc4c5805a67e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:32.046047 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:32.048492 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da962ae2-f472-47c3-bc66-fc4c5805a67e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:32.050089 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da962ae2-f472-47c3-bc66-fc4c5805a67e None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:32.064859 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application [None req-da962ae2-f472-47c3-bc66-fc4c5805a67e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:42:32.064859 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:42:32.064859 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:42:32.064859 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:42:32.064859 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:42:32.064859 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:42:32.064859 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:42:32.064859 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:42:32.064859 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:42:32.064859 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:42:32.064859 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:42:32.064859 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:42:32.064859 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 09 00:42:32.064859 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 09 00:42:32.064859 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 09 00:42:32.064859 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 09 00:42:32.065873 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:42:32.065873 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:42:32.065873 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:42:32.065873 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:42:32.065873 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:42:32.065873 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:42:32.065873 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:42:32.065873 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application with Lock( Oct 09 00:42:32.065873 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:42:32.065873 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:42:32.065873 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:42:32.065873 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:42:32.065873 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:42:32.065873 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:42:32.065873 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:42:32.065873 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:42:32.065873 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 09 00:42:32.066830 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 09 00:42:32.066830 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:42:32.066830 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application Oct 09 00:42:32.066830 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 246/510] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Oct 9 00:42:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:42:32.067123 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da962ae2-f472-47c3-bc66-fc4c5805a67e None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:32.105408 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7249fa82-c4c8-416c-a753-bcef6d4ed0a8 None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:32.140796 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c83baa3-b437-45bf-9df2-965c74b71ede None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:32.141432 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c83baa3-b437-45bf-9df2-965c74b71ede None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:32.141702 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c83baa3-b437-45bf-9df2-965c74b71ede None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:32.141967 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c83baa3-b437-45bf-9df2-965c74b71ede None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:32.152765 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c83baa3-b437-45bf-9df2-965c74b71ede None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:32.154420 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c83baa3-b437-45bf-9df2-965c74b71ede None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:32.165107 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da962ae2-f472-47c3-bc66-fc4c5805a67e None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:32.168265 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application [None req-8c83baa3-b437-45bf-9df2-965c74b71ede None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:42:32.168265 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:42:32.168265 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:42:32.168265 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:42:32.168265 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:42:32.168265 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:42:32.168265 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:42:32.168265 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:42:32.168265 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:42:32.168265 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:42:32.168265 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:42:32.168265 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:42:32.168265 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 09 00:42:32.168265 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 09 00:42:32.168265 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 09 00:42:32.168265 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 09 00:42:32.169137 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:42:32.169137 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:42:32.169137 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:42:32.169137 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:42:32.169137 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:42:32.169137 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:42:32.169137 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:42:32.169137 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application with Lock( Oct 09 00:42:32.169137 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:42:32.169137 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:42:32.169137 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:42:32.169137 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:42:32.169137 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:42:32.169137 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:42:32.169137 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:42:32.169137 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:42:32.169137 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 09 00:42:32.169958 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 09 00:42:32.169958 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:42:32.169958 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Oct 09 00:42:32.169958 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 265/511] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Oct 9 00:42:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:42:32.170166 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c83baa3-b437-45bf-9df2-965c74b71ede None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:32.192800 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:32.202615 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a41ee7d-9a77-44a2-885c-a610236bd1ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:32.203433 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a41ee7d-9a77-44a2-885c-a610236bd1ec None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:32.204456 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a41ee7d-9a77-44a2-885c-a610236bd1ec None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:32.204735 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a41ee7d-9a77-44a2-885c-a610236bd1ec None admin] PATH_INFO: `/v3/users/nova` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:32.213480 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a41ee7d-9a77-44a2-885c-a610236bd1ec None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:32.214949 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a41ee7d-9a77-44a2-885c-a610236bd1ec None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:32.225932 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application [None req-3a41ee7d-9a77-44a2-885c-a610236bd1ec None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 09 00:42:32.225932 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:42:32.225932 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:42:32.225932 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:42:32.225932 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:42:32.225932 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:42:32.225932 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:42:32.225932 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:42:32.225932 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:42:32.225932 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:42:32.225932 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:42:32.225932 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:42:32.225932 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 09 00:42:32.225932 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 09 00:42:32.225932 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 09 00:42:32.225932 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 09 00:42:32.226972 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:42:32.226972 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:42:32.226972 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 09 00:42:32.226972 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 09 00:42:32.226972 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 09 00:42:32.226972 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 09 00:42:32.226972 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:42:32.226972 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:42:32.226972 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:42:32.226972 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:42:32.226972 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:42:32.226972 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application with Lock( Oct 09 00:42:32.226972 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:42:32.226972 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:42:32.226972 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:42:32.226972 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:42:32.226972 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:42:32.226972 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:42:32.228104 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:42:32.228104 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:42:32.228104 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 09 00:42:32.228104 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 09 00:42:32.228104 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 09 00:42:32.228104 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 09 00:42:32.228104 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 09 00:42:32.228104 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 09 00:42:32.228104 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 09 00:42:32.228104 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application Oct 09 00:42:32.228104 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 247/512] 10.222.0.15 () {56 vars in 1093 bytes} [Sun Oct 9 00:42:32 2022] GET /identity/v3/users/nova => generated 82 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:42:32.228104 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a41ee7d-9a77-44a2-885c-a610236bd1ec None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:32.269413 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:32.272787 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c83baa3-b437-45bf-9df2-965c74b71ede None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:32.307229 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31f8af4-deff-4259-b039-da913d673619 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:32.307977 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31f8af4-deff-4259-b039-da913d673619 None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:32.308254 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31f8af4-deff-4259-b039-da913d673619 None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:32.308531 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31f8af4-deff-4259-b039-da913d673619 None admin] PATH_INFO: `/v3/domains` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:32.309169 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31f8af4-deff-4259-b039-da913d673619 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:42:32.309472 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31f8af4-deff-4259-b039-da913d673619 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:32.310859 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31f8af4-deff-4259-b039-da913d673619 None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:32.322962 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 266/513] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Oct 9 00:42:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:42:32.323820 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31f8af4-deff-4259-b039-da913d673619 None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:32.334106 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a41ee7d-9a77-44a2-885c-a610236bd1ec None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:32.368118 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a95154-dd86-45d5-8025-5a86da6bb142 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:32.368772 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a95154-dd86-45d5-8025-5a86da6bb142 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:32.369052 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a95154-dd86-45d5-8025-5a86da6bb142 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:32.369345 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a95154-dd86-45d5-8025-5a86da6bb142 None admin] PATH_INFO: `/v3/users` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:32.370077 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a95154-dd86-45d5-8025-5a86da6bb142 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:42:32.370375 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a95154-dd86-45d5-8025-5a86da6bb142 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:32.371889 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a95154-dd86-45d5-8025-5a86da6bb142 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:32.389666 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 248/514] 10.222.0.15 () {56 vars in 1137 bytes} [Sun Oct 9 00:42:32 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:42:32.390498 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a95154-dd86-45d5-8025-5a86da6bb142 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:32.422560 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31f8af4-deff-4259-b039-da913d673619 None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:32.441091 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:32.460314 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab667dd-6da6-4893-b7f5-ced15f9b2e74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:32.460927 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab667dd-6da6-4893-b7f5-ced15f9b2e74 None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:32.461246 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab667dd-6da6-4893-b7f5-ced15f9b2e74 None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:32.461525 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab667dd-6da6-4893-b7f5-ced15f9b2e74 None admin] PATH_INFO: `/v3/domains` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:32.462185 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab667dd-6da6-4893-b7f5-ced15f9b2e74 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:42:32.462481 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab667dd-6da6-4893-b7f5-ced15f9b2e74 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:32.463908 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab667dd-6da6-4893-b7f5-ced15f9b2e74 None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:32.475233 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 267/515] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Oct 9 00:42:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:42:32.476064 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab667dd-6da6-4893-b7f5-ced15f9b2e74 None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:32.497337 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:32.497677 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a95154-dd86-45d5-8025-5a86da6bb142 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:32.534285 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3deea1eb-370d-42b4-a986-dc801bd533f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:32.534897 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3deea1eb-370d-42b4-a986-dc801bd533f1 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:32.535176 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3deea1eb-370d-42b4-a986-dc801bd533f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:32.535470 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3deea1eb-370d-42b4-a986-dc801bd533f1 None admin] PATH_INFO: `/v3/domains` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:32.536107 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3deea1eb-370d-42b4-a986-dc801bd533f1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:42:32.536405 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3deea1eb-370d-42b4-a986-dc801bd533f1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:32.537788 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3deea1eb-370d-42b4-a986-dc801bd533f1 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:32.549302 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 249/516] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Oct 9 00:42:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:42:32.550210 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3deea1eb-370d-42b4-a986-dc801bd533f1 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:32.579015 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab667dd-6da6-4893-b7f5-ced15f9b2e74 None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:32.611240 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cc6f74-525a-4a0e-94f9-9532b5c93a6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:32.611888 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cc6f74-525a-4a0e-94f9-9532b5c93a6a None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:32.612168 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cc6f74-525a-4a0e-94f9-9532b5c93a6a None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:32.612435 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cc6f74-525a-4a0e-94f9-9532b5c93a6a None admin] PATH_INFO: `/v3/users` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:32.613157 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cc6f74-525a-4a0e-94f9-9532b5c93a6a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:42:32.613452 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cc6f74-525a-4a0e-94f9-9532b5c93a6a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:32.614907 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cc6f74-525a-4a0e-94f9-9532b5c93a6a None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:32.646208 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3deea1eb-370d-42b4-a986-dc801bd533f1 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:32.648612 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:32.652463 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 268/517] 10.222.0.15 () {56 vars in 1133 bytes} [Sun Oct 9 00:42:32 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:42:32.653337 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cc6f74-525a-4a0e-94f9-9532b5c93a6a None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:32.687182 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da47ef04-a814-441c-b553-c077b439a54e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:32.687767 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da47ef04-a814-441c-b553-c077b439a54e None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:32.688050 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da47ef04-a814-441c-b553-c077b439a54e None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:32.688319 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da47ef04-a814-441c-b553-c077b439a54e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:32.694977 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da47ef04-a814-441c-b553-c077b439a54e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:32.696552 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da47ef04-a814-441c-b553-c077b439a54e None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:32.708553 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application [None req-da47ef04-a814-441c-b553-c077b439a54e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 09 00:42:32.708553 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:42:32.708553 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:42:32.708553 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:42:32.708553 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:42:32.708553 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:42:32.708553 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:42:32.708553 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:42:32.708553 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:42:32.708553 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:42:32.708553 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:42:32.708553 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:42:32.708553 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 09 00:42:32.708553 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 09 00:42:32.708553 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 09 00:42:32.709455 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 09 00:42:32.709455 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:42:32.709455 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:42:32.709455 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:42:32.709455 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:42:32.709455 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:42:32.709455 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:42:32.709455 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:42:32.709455 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application with Lock( Oct 09 00:42:32.709455 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:42:32.709455 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:42:32.709455 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:42:32.709455 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:42:32.709455 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:42:32.709455 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:42:32.709455 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:42:32.709455 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:42:32.710291 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 09 00:42:32.710291 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 09 00:42:32.710291 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 09 00:42:32.710291 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 09 00:42:32.710291 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 09 00:42:32.710291 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 09 00:42:32.710291 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 09 00:42:32.710291 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application Oct 09 00:42:32.710291 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 250/518] 10.222.0.15 () {56 vars in 1111 bytes} [Sun Oct 9 00:42:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:42:32.710745 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da47ef04-a814-441c-b553-c077b439a54e None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:32.737889 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:32.761134 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cc6f74-525a-4a0e-94f9-9532b5c93a6a None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:32.795370 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d359b70-a02a-44ec-8fce-e86082f0a81e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:32.795979 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d359b70-a02a-44ec-8fce-e86082f0a81e None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:32.796250 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d359b70-a02a-44ec-8fce-e86082f0a81e None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:32.796513 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d359b70-a02a-44ec-8fce-e86082f0a81e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:32.809087 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da47ef04-a814-441c-b553-c077b439a54e None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:32.842382 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c0ab4c-89cc-4234-a093-2d1ca1fa7c42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:32.843016 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c0ab4c-89cc-4234-a093-2d1ca1fa7c42 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:32.843280 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c0ab4c-89cc-4234-a093-2d1ca1fa7c42 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:32.843575 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c0ab4c-89cc-4234-a093-2d1ca1fa7c42 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:32.850840 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c0ab4c-89cc-4234-a093-2d1ca1fa7c42 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:32.852332 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c0ab4c-89cc-4234-a093-2d1ca1fa7c42 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:32.863224 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application [None req-34c0ab4c-89cc-4234-a093-2d1ca1fa7c42 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Oct 09 00:42:32.863224 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:42:32.863224 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:42:32.863224 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:42:32.863224 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:42:32.863224 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:42:32.863224 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:42:32.863224 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:42:32.863224 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:42:32.863224 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:42:32.863224 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:42:32.863224 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:42:32.863224 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 09 00:42:32.863224 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 09 00:42:32.863224 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 09 00:42:32.863224 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 09 00:42:32.864144 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:42:32.864144 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:42:32.864144 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 09 00:42:32.864144 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 09 00:42:32.864144 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 09 00:42:32.864144 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 09 00:42:32.864144 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:42:32.864144 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:42:32.864144 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:42:32.864144 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:42:32.864144 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:42:32.864144 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application with Lock( Oct 09 00:42:32.864144 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:42:32.864144 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:42:32.864144 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:42:32.864144 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:42:32.864144 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:42:32.864144 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:42:32.865037 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:42:32.865037 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:42:32.865037 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 09 00:42:32.865037 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 09 00:42:32.865037 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 09 00:42:32.865037 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 09 00:42:32.865037 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 09 00:42:32.865037 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 09 00:42:32.865037 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Oct 09 00:42:32.865037 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application Oct 09 00:42:32.865710 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d359b70-a02a-44ec-8fce-e86082f0a81e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:32.865790 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 251/519] 10.222.0.15 () {56 vars in 1102 bytes} [Sun Oct 9 00:42:32 2022] GET /identity/v3/users/neutron => generated 85 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:42:32.865854 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d359b70-a02a-44ec-8fce-e86082f0a81e None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:32.865917 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c0ab4c-89cc-4234-a093-2d1ca1fa7c42 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:32.897396 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:32.947490 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:32.969238 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 269/520] 10.222.0.15 () {58 vars in 1282 bytes} [Sun Oct 9 00:42:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 09 00:42:32.970333 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d359b70-a02a-44ec-8fce-e86082f0a81e None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:32.971148 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c0ab4c-89cc-4234-a093-2d1ca1fa7c42 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:33.008009 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1972d8ac-56ee-4379-8e45-44f242ed72ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:33.008648 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1972d8ac-56ee-4379-8e45-44f242ed72ed None admin] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:33.008941 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1972d8ac-56ee-4379-8e45-44f242ed72ed None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:33.009206 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1972d8ac-56ee-4379-8e45-44f242ed72ed None admin] PATH_INFO: `/v3/users` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:33.009855 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1972d8ac-56ee-4379-8e45-44f242ed72ed None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:33.011332 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1972d8ac-56ee-4379-8e45-44f242ed72ed None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:33.032360 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 252/521] 10.222.0.15 () {60 vars in 1132 bytes} [Sun Oct 9 00:42:32 2022] POST /identity/v3/users => generated 247 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 09 00:42:33.033508 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1972d8ac-56ee-4379-8e45-44f242ed72ed None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:33.082267 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d359b70-a02a-44ec-8fce-e86082f0a81e None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:33.120246 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6929fd-e7a5-4fd3-af56-a3e559b54013 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:33.120878 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6929fd-e7a5-4fd3-af56-a3e559b54013 None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:33.121152 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6929fd-e7a5-4fd3-af56-a3e559b54013 None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:33.121426 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6929fd-e7a5-4fd3-af56-a3e559b54013 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:33.126724 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:33.151402 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1972d8ac-56ee-4379-8e45-44f242ed72ed None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:33.171560 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:33.189986 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e802b1a8-d021-4932-88a1-d0a441c3cbb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:33.190627 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e802b1a8-d021-4932-88a1-d0a441c3cbb3 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:33.190889 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e802b1a8-d021-4932-88a1-d0a441c3cbb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:33.191162 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e802b1a8-d021-4932-88a1-d0a441c3cbb3 None admin] PATH_INFO: `/v3/projects` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:33.191908 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e802b1a8-d021-4932-88a1-d0a441c3cbb3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:42:33.192207 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e802b1a8-d021-4932-88a1-d0a441c3cbb3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:33.193684 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e802b1a8-d021-4932-88a1-d0a441c3cbb3 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:33.197685 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6929fd-e7a5-4fd3-af56-a3e559b54013 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:33.199118 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6929fd-e7a5-4fd3-af56-a3e559b54013 None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:33.213806 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 253/522] 10.222.0.15 () {56 vars in 1148 bytes} [Sun Oct 9 00:42:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:42:33.214571 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e802b1a8-d021-4932-88a1-d0a441c3cbb3 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:33.310787 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 270/523] 10.222.0.15 () {58 vars in 1282 bytes} [Sun Oct 9 00:42:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 09 00:42:33.311757 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6929fd-e7a5-4fd3-af56-a3e559b54013 None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:33.324813 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e802b1a8-d021-4932-88a1-d0a441c3cbb3 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:33.360993 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59541c07-3c27-47de-8243-f0e9f48b8cae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:33.361651 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59541c07-3c27-47de-8243-f0e9f48b8cae None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:33.361854 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59541c07-3c27-47de-8243-f0e9f48b8cae None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:33.362120 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59541c07-3c27-47de-8243-f0e9f48b8cae None admin] PATH_INFO: `/v3/users` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:33.362868 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59541c07-3c27-47de-8243-f0e9f48b8cae None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:42:33.363158 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59541c07-3c27-47de-8243-f0e9f48b8cae None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:33.364672 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59541c07-3c27-47de-8243-f0e9f48b8cae None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:33.374732 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:33.389964 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 254/524] 10.222.0.15 () {56 vars in 1139 bytes} [Sun Oct 9 00:42:33 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:42:33.389964 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59541c07-3c27-47de-8243-f0e9f48b8cae None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:33.400540 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:33.426833 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6929fd-e7a5-4fd3-af56-a3e559b54013 None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:33.466353 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bebaa15-c422-4093-b828-6422fadd15fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:33.466891 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bebaa15-c422-4093-b828-6422fadd15fd None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:33.467177 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bebaa15-c422-4093-b828-6422fadd15fd None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:33.467466 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bebaa15-c422-4093-b828-6422fadd15fd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:33.477859 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bebaa15-c422-4093-b828-6422fadd15fd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:33.479860 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bebaa15-c422-4093-b828-6422fadd15fd None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:33.495092 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application [None req-3bebaa15-c422-4093-b828-6422fadd15fd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:42:33.495092 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:42:33.495092 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:42:33.495092 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:42:33.495092 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:42:33.495092 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:42:33.495092 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:42:33.495092 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:42:33.495092 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:42:33.495092 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:42:33.495092 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:42:33.495092 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:42:33.495092 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 09 00:42:33.495092 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 09 00:42:33.495092 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 09 00:42:33.495092 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 09 00:42:33.496064 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:42:33.496064 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:42:33.496064 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:42:33.496064 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:42:33.496064 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:42:33.496064 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:42:33.496064 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:42:33.496064 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application with Lock( Oct 09 00:42:33.496064 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:42:33.496064 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:42:33.496064 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:42:33.496064 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:42:33.496064 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:42:33.496064 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:42:33.496064 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:42:33.496064 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:42:33.496064 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 09 00:42:33.496997 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 09 00:42:33.496997 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:42:33.496997 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Oct 09 00:42:33.497160 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59541c07-3c27-47de-8243-f0e9f48b8cae None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:33.501134 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 271/525] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Oct 9 00:42:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:42:33.502337 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bebaa15-c422-4093-b828-6422fadd15fd None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:33.532815 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e62002-af0d-4a9a-8394-6294356eebc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:33.533721 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e62002-af0d-4a9a-8394-6294356eebc2 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:33.533998 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e62002-af0d-4a9a-8394-6294356eebc2 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:33.534263 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e62002-af0d-4a9a-8394-6294356eebc2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:33.534991 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e62002-af0d-4a9a-8394-6294356eebc2 None admin] RBAC: Adding query filter params (role.id=6fe3faf520bd402f9bd78d3ed08eec34, scope.project.id=f148d39ced534860abfbe8fc3f98ace4, user.id=d88a9f3d154c4cf98369972a0561b2b5) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:42:33.535323 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e62002-af0d-4a9a-8394-6294356eebc2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:33.536806 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e62002-af0d-4a9a-8394-6294356eebc2 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:33.542303 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 255/526] 10.222.0.15 () {56 vars in 1374 bytes} [Sun Oct 9 00:42:33 2022] GET /identity/v3/role_assignments?user.id=d88a9f3d154c4cf98369972a0561b2b5&scope.project.id=f148d39ced534860abfbe8fc3f98ace4&role.id=6fe3faf520bd402f9bd78d3ed08eec34 => generated 259 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:42:33.543104 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e62002-af0d-4a9a-8394-6294356eebc2 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:33.619868 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:33.629410 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bebaa15-c422-4093-b828-6422fadd15fd None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:33.663179 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:33.670365 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e62002-af0d-4a9a-8394-6294356eebc2 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:33.671379 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246968ae-d817-40db-9394-4d9b5399e06b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:33.672858 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246968ae-d817-40db-9394-4d9b5399e06b None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:33.673388 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246968ae-d817-40db-9394-4d9b5399e06b None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:33.673903 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246968ae-d817-40db-9394-4d9b5399e06b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:33.686833 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246968ae-d817-40db-9394-4d9b5399e06b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:33.688964 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246968ae-d817-40db-9394-4d9b5399e06b None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:33.705864 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application [None req-246968ae-d817-40db-9394-4d9b5399e06b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:42:33.705864 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:42:33.705864 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:42:33.705864 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:42:33.705864 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:42:33.705864 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:42:33.705864 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:42:33.705864 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:42:33.705864 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:42:33.705864 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:42:33.705864 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:42:33.705864 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:42:33.705864 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 09 00:42:33.705864 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 09 00:42:33.705864 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 09 00:42:33.705864 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 09 00:42:33.706864 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:42:33.706864 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:42:33.706864 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:42:33.706864 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:42:33.706864 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:42:33.706864 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:42:33.706864 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:42:33.706864 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application with Lock( Oct 09 00:42:33.706864 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:42:33.706864 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:42:33.706864 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:42:33.706864 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:42:33.706864 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:42:33.706864 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:42:33.706864 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:42:33.706864 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:42:33.706864 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 09 00:42:33.707847 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 09 00:42:33.707847 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:42:33.707847 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Oct 09 00:42:33.713302 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 272/527] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Oct 9 00:42:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:42:33.713302 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246968ae-d817-40db-9394-4d9b5399e06b None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:33.717203 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eadccfb-174e-4bea-877c-98d2f360e418 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:33.717770 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eadccfb-174e-4bea-877c-98d2f360e418 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:33.718046 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eadccfb-174e-4bea-877c-98d2f360e418 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:33.718320 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eadccfb-174e-4bea-877c-98d2f360e418 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:33.802724 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eadccfb-174e-4bea-877c-98d2f360e418 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:33.804743 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eadccfb-174e-4bea-877c-98d2f360e418 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:33.829328 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246968ae-d817-40db-9394-4d9b5399e06b None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:33.869108 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fd515b-edcf-45e4-b841-4f35339cb6b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:33.869734 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fd515b-edcf-45e4-b841-4f35339cb6b6 None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:33.870005 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fd515b-edcf-45e4-b841-4f35339cb6b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:33.870270 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fd515b-edcf-45e4-b841-4f35339cb6b6 None admin] PATH_INFO: `/v3/domains` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:33.870950 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fd515b-edcf-45e4-b841-4f35339cb6b6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:42:33.871345 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fd515b-edcf-45e4-b841-4f35339cb6b6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:33.872844 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fd515b-edcf-45e4-b841-4f35339cb6b6 None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:33.886695 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:33.887245 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 273/528] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Oct 9 00:42:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:42:33.889266 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fd515b-edcf-45e4-b841-4f35339cb6b6 None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:33.937772 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:33.942299 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 256/529] 10.222.0.15 () {58 vars in 1282 bytes} [Sun Oct 9 00:42:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 09 00:42:33.944164 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eadccfb-174e-4bea-877c-98d2f360e418 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:34.028824 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fd515b-edcf-45e4-b841-4f35339cb6b6 None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:34.056869 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eadccfb-174e-4bea-877c-98d2f360e418 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:34.078781 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedcf3fa-dfbf-4fe4-bd97-8f3c33fe68b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:34.079444 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedcf3fa-dfbf-4fe4-bd97-8f3c33fe68b1 None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:34.079723 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedcf3fa-dfbf-4fe4-bd97-8f3c33fe68b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:34.079992 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedcf3fa-dfbf-4fe4-bd97-8f3c33fe68b1 None admin] PATH_INFO: `/v3/domains` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:34.080645 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedcf3fa-dfbf-4fe4-bd97-8f3c33fe68b1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:42:34.080947 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedcf3fa-dfbf-4fe4-bd97-8f3c33fe68b1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:34.082905 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedcf3fa-dfbf-4fe4-bd97-8f3c33fe68b1 None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:34.096493 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 274/530] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Oct 9 00:42:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:42:34.097622 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedcf3fa-dfbf-4fe4-bd97-8f3c33fe68b1 None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:34.105926 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55caa4f1-d17e-4b7d-8130-4c4155664c7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:34.106576 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55caa4f1-d17e-4b7d-8130-4c4155664c7d None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:34.106852 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55caa4f1-d17e-4b7d-8130-4c4155664c7d None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:34.107334 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55caa4f1-d17e-4b7d-8130-4c4155664c7d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:34.117807 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55caa4f1-d17e-4b7d-8130-4c4155664c7d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:34.119974 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55caa4f1-d17e-4b7d-8130-4c4155664c7d None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:34.136135 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application [None req-55caa4f1-d17e-4b7d-8130-4c4155664c7d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 09 00:42:34.136135 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:42:34.136135 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:42:34.136135 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:42:34.136135 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:42:34.136135 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:42:34.136135 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:42:34.136135 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:42:34.136135 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:42:34.136135 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:42:34.136135 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:42:34.136135 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:42:34.136135 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 09 00:42:34.136135 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 09 00:42:34.136135 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 09 00:42:34.137175 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 09 00:42:34.137175 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:42:34.137175 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:42:34.137175 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:42:34.137175 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:42:34.137175 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:42:34.137175 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:42:34.137175 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:42:34.137175 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application with Lock( Oct 09 00:42:34.137175 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:42:34.137175 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:42:34.137175 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:42:34.137175 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:42:34.137175 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:42:34.137175 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:42:34.137175 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:42:34.137175 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:42:34.138148 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 09 00:42:34.138148 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 09 00:42:34.138148 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 09 00:42:34.138148 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 09 00:42:34.138148 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 09 00:42:34.138148 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 09 00:42:34.138148 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 09 00:42:34.138148 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application Oct 09 00:42:34.138148 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 257/531] 10.222.0.15 () {56 vars in 1111 bytes} [Sun Oct 9 00:42:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:42:34.138606 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55caa4f1-d17e-4b7d-8130-4c4155664c7d None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:34.164520 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:34.224662 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedcf3fa-dfbf-4fe4-bd97-8f3c33fe68b1 None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:34.226863 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:34.249918 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55caa4f1-d17e-4b7d-8130-4c4155664c7d None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:34.266987 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837a9be1-3de3-4a87-b25d-982f3c47baae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:34.268004 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837a9be1-3de3-4a87-b25d-982f3c47baae None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:34.268557 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837a9be1-3de3-4a87-b25d-982f3c47baae None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:34.268958 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837a9be1-3de3-4a87-b25d-982f3c47baae None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:34.281086 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837a9be1-3de3-4a87-b25d-982f3c47baae None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:34.282878 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837a9be1-3de3-4a87-b25d-982f3c47baae None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:34.292803 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06531b6-89e1-43de-80f1-4a5a8ae2915d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:34.293766 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06531b6-89e1-43de-80f1-4a5a8ae2915d None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:34.294052 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06531b6-89e1-43de-80f1-4a5a8ae2915d None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:34.294325 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06531b6-89e1-43de-80f1-4a5a8ae2915d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:34.299278 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application [None req-837a9be1-3de3-4a87-b25d-982f3c47baae None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:42:34.299278 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:42:34.299278 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:42:34.299278 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:42:34.299278 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:42:34.299278 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:42:34.299278 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:42:34.299278 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:42:34.299278 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:42:34.299278 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:42:34.299278 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:42:34.299278 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:42:34.299278 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 09 00:42:34.299278 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 09 00:42:34.299278 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 09 00:42:34.299278 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 09 00:42:34.300343 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:42:34.300343 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:42:34.300343 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:42:34.300343 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:42:34.300343 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:42:34.300343 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:42:34.300343 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:42:34.300343 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application with Lock( Oct 09 00:42:34.300343 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:42:34.300343 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:42:34.300343 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:42:34.300343 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:42:34.300343 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:42:34.300343 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:42:34.300343 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:42:34.300343 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:42:34.300343 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 09 00:42:34.301289 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 09 00:42:34.301289 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:42:34.301289 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Oct 09 00:42:34.301459 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06531b6-89e1-43de-80f1-4a5a8ae2915d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:34.302986 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06531b6-89e1-43de-80f1-4a5a8ae2915d None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:34.303136 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 275/532] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Oct 9 00:42:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:42:34.304116 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837a9be1-3de3-4a87-b25d-982f3c47baae None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:34.326066 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application [None req-d06531b6-89e1-43de-80f1-4a5a8ae2915d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 09 00:42:34.326066 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:42:34.326066 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:42:34.326066 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:42:34.326066 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:42:34.326066 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:42:34.326066 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:42:34.326066 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:42:34.326066 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:42:34.326066 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:42:34.326066 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:42:34.326066 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:42:34.326066 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 09 00:42:34.326066 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 09 00:42:34.326066 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 09 00:42:34.326961 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 09 00:42:34.326961 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:42:34.326961 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:42:34.326961 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:42:34.326961 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:42:34.326961 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:42:34.326961 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:42:34.326961 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:42:34.326961 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application with Lock( Oct 09 00:42:34.326961 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:42:34.326961 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:42:34.326961 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:42:34.326961 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:42:34.326961 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:42:34.326961 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:42:34.326961 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:42:34.326961 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:42:34.328247 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 09 00:42:34.328247 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 09 00:42:34.328247 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 09 00:42:34.328247 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 09 00:42:34.328247 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 09 00:42:34.328247 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 09 00:42:34.328247 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 09 00:42:34.328247 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application Oct 09 00:42:34.328247 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 258/533] 10.222.0.15 () {56 vars in 1111 bytes} [Sun Oct 9 00:42:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:42:34.328702 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06531b6-89e1-43de-80f1-4a5a8ae2915d None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:34.420274 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837a9be1-3de3-4a87-b25d-982f3c47baae None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:34.431688 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:34.446908 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06531b6-89e1-43de-80f1-4a5a8ae2915d None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:34.467407 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0df737e-eb71-4eea-8961-b5a15382400e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:34.468410 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0df737e-eb71-4eea-8961-b5a15382400e None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:34.468943 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0df737e-eb71-4eea-8961-b5a15382400e None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:34.469268 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0df737e-eb71-4eea-8961-b5a15382400e None admin] PATH_INFO: `/v3/projects` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:34.469983 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0df737e-eb71-4eea-8961-b5a15382400e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:42:34.470283 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0df737e-eb71-4eea-8961-b5a15382400e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:34.471774 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0df737e-eb71-4eea-8961-b5a15382400e None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:34.487339 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e703be6-9ef2-458d-9346-2941dcebeffb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:34.488338 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e703be6-9ef2-458d-9346-2941dcebeffb None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:34.488799 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e703be6-9ef2-458d-9346-2941dcebeffb None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:34.489276 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e703be6-9ef2-458d-9346-2941dcebeffb None admin] PATH_INFO: `/v3/domains` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:34.490102 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e703be6-9ef2-458d-9346-2941dcebeffb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:42:34.490593 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e703be6-9ef2-458d-9346-2941dcebeffb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:34.492181 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e703be6-9ef2-458d-9346-2941dcebeffb None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:34.496048 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 276/534] 10.222.0.15 () {56 vars in 1148 bytes} [Sun Oct 9 00:42:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:42:34.496975 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0df737e-eb71-4eea-8961-b5a15382400e None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:34.506070 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 259/535] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Oct 9 00:42:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:42:34.507285 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e703be6-9ef2-458d-9346-2941dcebeffb None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:34.514437 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:34.603282 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0df737e-eb71-4eea-8961-b5a15382400e None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:34.625895 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e703be6-9ef2-458d-9346-2941dcebeffb None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:34.638675 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45355083-c863-47af-9b7e-3eeca02e8c5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:34.639620 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45355083-c863-47af-9b7e-3eeca02e8c5c None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:34.640189 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45355083-c863-47af-9b7e-3eeca02e8c5c None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:34.640699 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45355083-c863-47af-9b7e-3eeca02e8c5c None admin] PATH_INFO: `/v3/projects` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:34.641738 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45355083-c863-47af-9b7e-3eeca02e8c5c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:42:34.642233 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45355083-c863-47af-9b7e-3eeca02e8c5c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:34.644138 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45355083-c863-47af-9b7e-3eeca02e8c5c None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:34.657203 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 277/536] 10.222.0.15 () {56 vars in 1148 bytes} [Sun Oct 9 00:42:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:42:34.658393 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45355083-c863-47af-9b7e-3eeca02e8c5c None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:34.663912 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b61f713-27e2-4a4c-a19c-d958693f993f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:34.664529 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b61f713-27e2-4a4c-a19c-d958693f993f None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:34.664803 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b61f713-27e2-4a4c-a19c-d958693f993f None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:34.665138 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b61f713-27e2-4a4c-a19c-d958693f993f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:34.665873 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b61f713-27e2-4a4c-a19c-d958693f993f None admin] RBAC: Adding query filter params (role.id=6fe3faf520bd402f9bd78d3ed08eec34, scope.project.id=f148d39ced534860abfbe8fc3f98ace4, user.id=ff7cb78bcd91467abe5c2e2b48aedd1b) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:42:34.666177 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b61f713-27e2-4a4c-a19c-d958693f993f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:34.667669 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b61f713-27e2-4a4c-a19c-d958693f993f None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:34.674840 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 260/537] 10.222.0.15 () {56 vars in 1374 bytes} [Sun Oct 9 00:42:34 2022] GET /identity/v3/role_assignments?user.id=ff7cb78bcd91467abe5c2e2b48aedd1b&scope.project.id=f148d39ced534860abfbe8fc3f98ace4&role.id=6fe3faf520bd402f9bd78d3ed08eec34 => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:42:34.680205 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b61f713-27e2-4a4c-a19c-d958693f993f None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:34.698541 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:34.805926 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:34.865982 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45355083-c863-47af-9b7e-3eeca02e8c5c None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:34.869702 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b61f713-27e2-4a4c-a19c-d958693f993f None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:34.932018 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e2c67b-41b7-4b19-b9b6-1dc0af01d44c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:34.932631 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e2c67b-41b7-4b19-b9b6-1dc0af01d44c None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:34.932908 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e2c67b-41b7-4b19-b9b6-1dc0af01d44c None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:34.933179 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e2c67b-41b7-4b19-b9b6-1dc0af01d44c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:34.933919 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e2c67b-41b7-4b19-b9b6-1dc0af01d44c None admin] RBAC: Adding query filter params (role.id=6fe3faf520bd402f9bd78d3ed08eec34, scope.project.id=f148d39ced534860abfbe8fc3f98ace4, user.id=4ac83d57fba841e0a666710732249c49) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:42:34.934226 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e2c67b-41b7-4b19-b9b6-1dc0af01d44c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:34.935713 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e2c67b-41b7-4b19-b9b6-1dc0af01d44c None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:34.942038 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 261/538] 10.222.0.15 () {56 vars in 1374 bytes} [Sun Oct 9 00:42:34 2022] GET /identity/v3/role_assignments?user.id=4ac83d57fba841e0a666710732249c49&scope.project.id=f148d39ced534860abfbe8fc3f98ace4&role.id=6fe3faf520bd402f9bd78d3ed08eec34 => generated 259 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:42:34.943238 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203dc80f-b1c1-4d84-9142-41c46b198cb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:34.943931 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203dc80f-b1c1-4d84-9142-41c46b198cb3 None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:34.944203 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203dc80f-b1c1-4d84-9142-41c46b198cb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:34.944472 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203dc80f-b1c1-4d84-9142-41c46b198cb3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:34.968746 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203dc80f-b1c1-4d84-9142-41c46b198cb3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:34.970293 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203dc80f-b1c1-4d84-9142-41c46b198cb3 None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:34.993847 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application [None req-203dc80f-b1c1-4d84-9142-41c46b198cb3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 09 00:42:34.993847 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:42:34.993847 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:42:34.993847 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:42:34.993847 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:42:34.993847 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:42:34.993847 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:42:34.993847 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:42:34.993847 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:42:34.993847 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:42:34.993847 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:42:34.993847 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:42:34.993847 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 09 00:42:34.993847 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 09 00:42:34.993847 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 09 00:42:34.994755 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 09 00:42:34.994755 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:42:34.994755 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:42:34.994755 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:42:34.994755 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:42:34.994755 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:42:34.994755 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:42:34.994755 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:42:34.994755 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application with Lock( Oct 09 00:42:34.994755 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:42:34.994755 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:42:34.994755 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:42:34.994755 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:42:34.994755 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:42:34.994755 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:42:34.994755 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:42:34.994755 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:42:34.995632 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 09 00:42:34.995632 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 09 00:42:34.995632 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 09 00:42:34.995632 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 09 00:42:34.995632 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 09 00:42:34.995632 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 09 00:42:34.995632 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 09 00:42:34.995632 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Oct 09 00:42:34.999411 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 278/539] 10.222.0.15 () {56 vars in 1111 bytes} [Sun Oct 9 00:42:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 337 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:42:35.001340 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e2c67b-41b7-4b19-b9b6-1dc0af01d44c None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:35.098769 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:35.131769 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e2c67b-41b7-4b19-b9b6-1dc0af01d44c None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:35.166884 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a24935-0dc5-424b-8eea-5241318ef4d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:35.167533 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a24935-0dc5-424b-8eea-5241318ef4d2 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:35.167812 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a24935-0dc5-424b-8eea-5241318ef4d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:35.168085 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a24935-0dc5-424b-8eea-5241318ef4d2 None admin] PATH_INFO: `/v3/projects` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:35.168787 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a24935-0dc5-424b-8eea-5241318ef4d2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:42:35.169090 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a24935-0dc5-424b-8eea-5241318ef4d2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:35.170534 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a24935-0dc5-424b-8eea-5241318ef4d2 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:35.183570 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 262/540] 10.222.0.15 () {56 vars in 1148 bytes} [Sun Oct 9 00:42:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:42:35.189530 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203dc80f-b1c1-4d84-9142-41c46b198cb3 None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:35.315026 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203dc80f-b1c1-4d84-9142-41c46b198cb3 None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:35.363183 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a432a1-911b-4abc-a8a1-93434c6933aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:35.363835 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a432a1-911b-4abc-a8a1-93434c6933aa None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:35.364110 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a432a1-911b-4abc-a8a1-93434c6933aa None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:35.364378 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a432a1-911b-4abc-a8a1-93434c6933aa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:35.365112 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a432a1-911b-4abc-a8a1-93434c6933aa None admin] RBAC: Adding query filter params (role.id=6fe3faf520bd402f9bd78d3ed08eec34, scope.project.id=f148d39ced534860abfbe8fc3f98ace4, user.id=f4ef90d456d2483e8ddafbe2d4d4fb5e) {{(pid=81525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:42:35.365418 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a432a1-911b-4abc-a8a1-93434c6933aa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:35.366875 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a432a1-911b-4abc-a8a1-93434c6933aa None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:35.368853 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:35.373899 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 279/541] 10.222.0.15 () {56 vars in 1374 bytes} [Sun Oct 9 00:42:35 2022] GET /identity/v3/role_assignments?user.id=f4ef90d456d2483e8ddafbe2d4d4fb5e&scope.project.id=f148d39ced534860abfbe8fc3f98ace4&role.id=6fe3faf520bd402f9bd78d3ed08eec34 => generated 259 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:42:35.423882 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af35c03-9f40-4157-be2e-80edfbbfd226 None None] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:35.424266 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af35c03-9f40-4157-be2e-80edfbbfd226 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:35.424430 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af35c03-9f40-4157-be2e-80edfbbfd226 None None] PATH_INFO: `/` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:35.426286 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 263/542] 10.222.0.15 () {54 vars in 927 bytes} [Sun Oct 9 00:42:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:42:35.432881 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef87e323-a876-42ed-886b-2c82a7384efb None None] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:35.433459 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef87e323-a876-42ed-886b-2c82a7384efb None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:35.433459 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef87e323-a876-42ed-886b-2c82a7384efb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:35.460477 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.auth.core [None req-ef87e323-a876-42ed-886b-2c82a7384efb None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:42:35.461732 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-ef87e323-a876-42ed-886b-2c82a7384efb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:42:35.575693 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 280/543] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Oct 9 00:42:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 09 00:42:35.861034 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af35c03-9f40-4157-be2e-80edfbbfd226 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:35.979753 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ff9640-f83f-48ab-99ad-9e76a515b63b None None] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:35.980091 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ff9640-f83f-48ab-99ad-9e76a515b63b None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:35.980308 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ff9640-f83f-48ab-99ad-9e76a515b63b None None] PATH_INFO: `/` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:35.982834 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 281/544] 10.222.0.15 () {54 vars in 927 bytes} [Sun Oct 9 00:42:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:42:35.989784 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9557c95-1c3f-42e0-ba0e-9b4d047574f5 None None] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:35.990130 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9557c95-1c3f-42e0-ba0e-9b4d047574f5 None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:35.990337 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9557c95-1c3f-42e0-ba0e-9b4d047574f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:36.000787 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af35c03-9f40-4157-be2e-80edfbbfd226 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:36.026530 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.auth.core [None req-e9557c95-1c3f-42e0-ba0e-9b4d047574f5 None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:42:36.027802 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-e9557c95-1c3f-42e0-ba0e-9b4d047574f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:42:36.055698 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:36.061303 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedf749d-4f63-40da-baeb-be99d2d05a2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:36.063570 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedf749d-4f63-40da-baeb-be99d2d05a2e None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:36.063849 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedf749d-4f63-40da-baeb-be99d2d05a2e None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:36.064120 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedf749d-4f63-40da-baeb-be99d2d05a2e None admin] PATH_INFO: `/v3/roles/service` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:36.088849 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedf749d-4f63-40da-baeb-be99d2d05a2e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 09 00:42:36.093878 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application [None req-cedf749d-4f63-40da-baeb-be99d2d05a2e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 09 00:42:36.093878 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:42:36.093878 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:42:36.093878 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:42:36.093878 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:42:36.093878 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:42:36.093878 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:42:36.093878 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:42:36.093878 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:42:36.093878 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:42:36.093878 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:42:36.093878 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:42:36.093878 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 09 00:42:36.093878 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 09 00:42:36.093878 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 09 00:42:36.093878 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 09 00:42:36.094733 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 09 00:42:36.094733 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 09 00:42:36.094733 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 09 00:42:36.094733 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 09 00:42:36.094733 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:42:36.094733 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:42:36.094733 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:42:36.094733 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:42:36.094733 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:42:36.094733 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:42:36.094733 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:42:36.094733 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application with Lock( Oct 09 00:42:36.094733 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:42:36.094733 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:42:36.094733 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:42:36.094733 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:42:36.095556 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:42:36.095556 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:42:36.095556 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:42:36.095556 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:42:36.095556 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 09 00:42:36.095556 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 09 00:42:36.095556 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 09 00:42:36.095556 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 09 00:42:36.095556 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 09 00:42:36.095556 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 09 00:42:36.095556 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 09 00:42:36.095556 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application Oct 09 00:42:36.099657 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 264/545] 10.222.0.15 () {56 vars in 1102 bytes} [Sun Oct 9 00:42:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:42:36.102299 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedf749d-4f63-40da-baeb-be99d2d05a2e None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:36.209880 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedf749d-4f63-40da-baeb-be99d2d05a2e None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:36.224562 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 282/546] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Oct 9 00:42:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 09 00:42:36.260871 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41ac26c-ed54-41c1-8e1a-e24e17bc7bc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:36.261497 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41ac26c-ed54-41c1-8e1a-e24e17bc7bc2 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:36.261770 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41ac26c-ed54-41c1-8e1a-e24e17bc7bc2 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:36.262037 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41ac26c-ed54-41c1-8e1a-e24e17bc7bc2 None admin] PATH_INFO: `/v3/roles` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:36.262717 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41ac26c-ed54-41c1-8e1a-e24e17bc7bc2 None admin] RBAC: Adding query filter params (name=service) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:42:36.263014 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41ac26c-ed54-41c1-8e1a-e24e17bc7bc2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:36.264498 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41ac26c-ed54-41c1-8e1a-e24e17bc7bc2 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:36.277816 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 265/547] 10.222.0.15 () {56 vars in 1103 bytes} [Sun Oct 9 00:42:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 09 00:42:36.283673 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9557c95-1c3f-42e0-ba0e-9b4d047574f5 None None] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:36.372193 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:36.423399 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9557c95-1c3f-42e0-ba0e-9b4d047574f5 None None] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:36.480294 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0c1bf8-bec7-4de2-9e27-fcd2f35a72e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:36.480905 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0c1bf8-bec7-4de2-9e27-fcd2f35a72e8 None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:36.481211 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0c1bf8-bec7-4de2-9e27-fcd2f35a72e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:36.481382 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0c1bf8-bec7-4de2-9e27-fcd2f35a72e8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:36.502508 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0c1bf8-bec7-4de2-9e27-fcd2f35a72e8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:36.504017 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0c1bf8-bec7-4de2-9e27-fcd2f35a72e8 None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:36.519105 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application [None req-cd0c1bf8-bec7-4de2-9e27-fcd2f35a72e8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:42:36.519105 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:42:36.519105 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:42:36.519105 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:42:36.519105 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:42:36.519105 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:42:36.519105 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:42:36.519105 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:42:36.519105 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:42:36.519105 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:42:36.519105 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:42:36.519105 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:42:36.519105 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 09 00:42:36.519105 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 09 00:42:36.519105 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 09 00:42:36.519105 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 09 00:42:36.520058 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:42:36.520058 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:42:36.520058 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:42:36.520058 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:42:36.520058 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:42:36.520058 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:42:36.520058 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:42:36.520058 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application with Lock( Oct 09 00:42:36.520058 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:42:36.520058 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:42:36.520058 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:42:36.520058 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:42:36.520058 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:42:36.520058 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:42:36.520058 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:42:36.520058 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:42:36.520058 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 09 00:42:36.520907 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 09 00:42:36.520907 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:42:36.520907 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Oct 09 00:42:36.520907 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 283/548] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Oct 9 00:42:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:42:36.527316 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41ac26c-ed54-41c1-8e1a-e24e17bc7bc2 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:36.597857 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0c1bf8-bec7-4de2-9e27-fcd2f35a72e8 None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:36.616307 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:36.663735 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41ac26c-ed54-41c1-8e1a-e24e17bc7bc2 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:36.697054 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ca4b6d-70c6-4dc2-8ff8-671047c53d82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:36.697666 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ca4b6d-70c6-4dc2-8ff8-671047c53d82 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:36.697939 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ca4b6d-70c6-4dc2-8ff8-671047c53d82 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:36.698203 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ca4b6d-70c6-4dc2-8ff8-671047c53d82 None admin] PATH_INFO: `/v3/domains` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:36.698842 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ca4b6d-70c6-4dc2-8ff8-671047c53d82 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:42:36.699135 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ca4b6d-70c6-4dc2-8ff8-671047c53d82 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:36.700568 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ca4b6d-70c6-4dc2-8ff8-671047c53d82 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:36.712810 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 266/549] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Oct 9 00:42:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:42:36.718899 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ca4b6d-70c6-4dc2-8ff8-671047c53d82 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:36.775399 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0c1bf8-bec7-4de2-9e27-fcd2f35a72e8 None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:36.784364 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:36.811207 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd2e1c8-6308-4c08-85a9-3e104797a0ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:36.811966 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd2e1c8-6308-4c08-85a9-3e104797a0ee None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:36.812245 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd2e1c8-6308-4c08-85a9-3e104797a0ee None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:36.812613 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd2e1c8-6308-4c08-85a9-3e104797a0ee None admin] PATH_INFO: `/v3/roles/service` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:36.824021 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd2e1c8-6308-4c08-85a9-3e104797a0ee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 09 00:42:36.829718 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application [None req-8dd2e1c8-6308-4c08-85a9-3e104797a0ee None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 09 00:42:36.829718 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:42:36.829718 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:42:36.829718 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:42:36.829718 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:42:36.829718 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:42:36.829718 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:42:36.829718 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:42:36.829718 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:42:36.829718 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:42:36.829718 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:42:36.829718 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:42:36.829718 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 09 00:42:36.829718 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 09 00:42:36.829718 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 09 00:42:36.829718 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 09 00:42:36.831300 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 09 00:42:36.831300 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 09 00:42:36.831300 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 09 00:42:36.831300 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 09 00:42:36.831300 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:42:36.831300 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:42:36.831300 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:42:36.831300 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:42:36.831300 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:42:36.831300 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:42:36.831300 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:42:36.831300 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application with Lock( Oct 09 00:42:36.831300 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:42:36.831300 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:42:36.831300 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:42:36.831300 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:42:36.832214 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:42:36.832214 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:42:36.832214 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:42:36.832214 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:42:36.832214 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 09 00:42:36.832214 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 09 00:42:36.832214 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 09 00:42:36.832214 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 09 00:42:36.832214 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 09 00:42:36.832214 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 09 00:42:36.832214 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 09 00:42:36.832214 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Oct 09 00:42:36.832214 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 284/550] 10.222.0.15 () {56 vars in 1102 bytes} [Sun Oct 9 00:42:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 09 00:42:36.836859 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd2e1c8-6308-4c08-85a9-3e104797a0ee None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:36.869365 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ca4b6d-70c6-4dc2-8ff8-671047c53d82 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:36.899629 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:36.928792 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96772349-ec26-436a-93bd-5282165a01bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:36.929832 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96772349-ec26-436a-93bd-5282165a01bf None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:36.930299 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96772349-ec26-436a-93bd-5282165a01bf None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:36.930795 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96772349-ec26-436a-93bd-5282165a01bf None admin] PATH_INFO: `/v3/users/swift` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:36.939031 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96772349-ec26-436a-93bd-5282165a01bf None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:36.940875 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96772349-ec26-436a-93bd-5282165a01bf None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:36.954503 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application [None req-96772349-ec26-436a-93bd-5282165a01bf None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 09 00:42:36.954503 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:42:36.954503 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:42:36.954503 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:42:36.954503 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:42:36.954503 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:42:36.954503 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:42:36.954503 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:42:36.954503 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:42:36.954503 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:42:36.954503 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:42:36.954503 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:42:36.954503 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 09 00:42:36.954503 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 09 00:42:36.954503 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 09 00:42:36.954503 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 09 00:42:36.955525 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:42:36.955525 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:42:36.955525 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 09 00:42:36.955525 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 09 00:42:36.955525 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 09 00:42:36.955525 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 09 00:42:36.955525 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:42:36.955525 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:42:36.955525 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:42:36.955525 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:42:36.955525 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:42:36.955525 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application with Lock( Oct 09 00:42:36.955525 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:42:36.955525 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:42:36.955525 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:42:36.955525 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:42:36.955525 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:42:36.955525 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:42:36.956617 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:42:36.956617 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:42:36.956617 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 09 00:42:36.956617 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 09 00:42:36.956617 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 09 00:42:36.956617 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 09 00:42:36.956617 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 09 00:42:36.956617 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 09 00:42:36.956617 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 09 00:42:36.956617 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application Oct 09 00:42:36.959301 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 267/551] 10.222.0.15 () {56 vars in 1096 bytes} [Sun Oct 9 00:42:36 2022] GET /identity/v3/users/swift => generated 83 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:42:36.965747 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96772349-ec26-436a-93bd-5282165a01bf None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:37.078432 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd2e1c8-6308-4c08-85a9-3e104797a0ee None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:37.106091 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96772349-ec26-436a-93bd-5282165a01bf None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:37.143519 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db4b1d3-0b4b-48bb-aac7-71b84b3adf98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:37.144636 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db4b1d3-0b4b-48bb-aac7-71b84b3adf98 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:37.145180 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db4b1d3-0b4b-48bb-aac7-71b84b3adf98 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:37.145690 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db4b1d3-0b4b-48bb-aac7-71b84b3adf98 None admin] PATH_INFO: `/v3/users` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:37.146615 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db4b1d3-0b4b-48bb-aac7-71b84b3adf98 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:42:37.147102 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db4b1d3-0b4b-48bb-aac7-71b84b3adf98 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:37.148859 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db4b1d3-0b4b-48bb-aac7-71b84b3adf98 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:37.166819 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c3d504-4cfb-4c82-a2ea-ac5bc157c22c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:37.167473 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c3d504-4cfb-4c82-a2ea-ac5bc157c22c None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:37.167749 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c3d504-4cfb-4c82-a2ea-ac5bc157c22c None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:37.168134 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c3d504-4cfb-4c82-a2ea-ac5bc157c22c None admin] PATH_INFO: `/v3/roles` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:37.168684 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c3d504-4cfb-4c82-a2ea-ac5bc157c22c None admin] RBAC: Adding query filter params (name=service) {{(pid=81525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:42:37.168985 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c3d504-4cfb-4c82-a2ea-ac5bc157c22c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:37.170382 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c3d504-4cfb-4c82-a2ea-ac5bc157c22c None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:37.171498 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 268/552] 10.222.0.15 () {56 vars in 1135 bytes} [Sun Oct 9 00:42:36 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:42:37.180669 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db4b1d3-0b4b-48bb-aac7-71b84b3adf98 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:37.193328 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 285/553] 10.222.0.15 () {56 vars in 1103 bytes} [Sun Oct 9 00:42:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 357 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:42:37.198971 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c3d504-4cfb-4c82-a2ea-ac5bc157c22c None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:37.245326 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:37.266983 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:37.386807 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c3d504-4cfb-4c82-a2ea-ac5bc157c22c None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:37.423968 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db4b1d3-0b4b-48bb-aac7-71b84b3adf98 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:37.458919 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ed5a84-9230-4c32-9022-e24ec664ff2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:37.460555 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ed5a84-9230-4c32-9022-e24ec664ff2c None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:37.461162 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ed5a84-9230-4c32-9022-e24ec664ff2c None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:37.461758 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ed5a84-9230-4c32-9022-e24ec664ff2c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:37.465725 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944d2cfd-dd9d-4c10-92b7-ba144468ccb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:37.466425 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944d2cfd-dd9d-4c10-92b7-ba144468ccb1 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:37.466790 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944d2cfd-dd9d-4c10-92b7-ba144468ccb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:37.467125 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944d2cfd-dd9d-4c10-92b7-ba144468ccb1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:37.477743 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ed5a84-9230-4c32-9022-e24ec664ff2c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:37.479654 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ed5a84-9230-4c32-9022-e24ec664ff2c None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:37.496446 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application [None req-32ed5a84-9230-4c32-9022-e24ec664ff2c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:42:37.496446 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:42:37.496446 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:42:37.496446 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:42:37.496446 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:42:37.496446 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:42:37.496446 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:42:37.496446 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:42:37.496446 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:42:37.496446 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:42:37.496446 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:42:37.496446 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:42:37.496446 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 09 00:42:37.496446 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 09 00:42:37.496446 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 09 00:42:37.496446 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 09 00:42:37.498016 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:42:37.498016 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:42:37.498016 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:42:37.498016 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:42:37.498016 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:42:37.498016 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:42:37.498016 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:42:37.498016 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application with Lock( Oct 09 00:42:37.498016 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:42:37.498016 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:42:37.498016 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:42:37.498016 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:42:37.498016 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:42:37.498016 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:42:37.498016 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:42:37.498016 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:42:37.498016 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 09 00:42:37.499239 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 09 00:42:37.499239 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:42:37.499239 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Oct 09 00:42:37.499239 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 286/554] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Oct 9 00:42:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 09 00:42:37.499963 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c9d0ca-f796-49cb-a7ad-a5f6c34a8dc9 None None] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:37.499963 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c9d0ca-f796-49cb-a7ad-a5f6c34a8dc9 None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:37.499963 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c9d0ca-f796-49cb-a7ad-a5f6c34a8dc9 None None] PATH_INFO: `/` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:37.501333 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 287/555] 10.222.0.15 () {54 vars in 927 bytes} [Sun Oct 9 00:42:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:42:37.503525 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd80120-c9a0-48e5-b368-ecde7cf9f534 None None] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:37.503807 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd80120-c9a0-48e5-b368-ecde7cf9f534 None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:37.504080 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd80120-c9a0-48e5-b368-ecde7cf9f534 None None] PATH_INFO: `/` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:37.506689 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 288/556] 10.222.0.15 () {54 vars in 927 bytes} [Sun Oct 9 00:42:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:42:37.506689 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd80120-c9a0-48e5-b368-ecde7cf9f534 None None] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:37.550453 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944d2cfd-dd9d-4c10-92b7-ba144468ccb1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:37.551967 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944d2cfd-dd9d-4c10-92b7-ba144468ccb1 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:37.582945 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:37.600712 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:37.618811 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd80120-c9a0-48e5-b368-ecde7cf9f534 None None] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:37.654813 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5322f07f-fc60-4acc-92d9-1f0cdb0de162 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:37.655473 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5322f07f-fc60-4acc-92d9-1f0cdb0de162 None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:37.655743 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5322f07f-fc60-4acc-92d9-1f0cdb0de162 None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:37.656011 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5322f07f-fc60-4acc-92d9-1f0cdb0de162 None admin] PATH_INFO: `/v3/domains` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:37.656662 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5322f07f-fc60-4acc-92d9-1f0cdb0de162 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:42:37.656959 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5322f07f-fc60-4acc-92d9-1f0cdb0de162 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:37.658357 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5322f07f-fc60-4acc-92d9-1f0cdb0de162 None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:37.669547 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 269/557] 10.222.0.15 () {58 vars in 1282 bytes} [Sun Oct 9 00:42:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 485 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 09 00:42:37.669547 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc31666-2e91-4231-9ca3-14cf0e845d36 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:37.669547 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc31666-2e91-4231-9ca3-14cf0e845d36 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:37.669547 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc31666-2e91-4231-9ca3-14cf0e845d36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:37.680874 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 289/558] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Oct 9 00:42:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:42:37.680874 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07a8dce-336e-4eba-ae6a-6cc155afdd2e None None] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:37.680874 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07a8dce-336e-4eba-ae6a-6cc155afdd2e None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:37.680874 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07a8dce-336e-4eba-ae6a-6cc155afdd2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:37.688696 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-3dc31666-2e91-4231-9ca3-14cf0e845d36 None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:42:37.689913 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-3dc31666-2e91-4231-9ca3-14cf0e845d36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:42:37.698859 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.auth.core [None req-f07a8dce-336e-4eba-ae6a-6cc155afdd2e None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:42:37.700078 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-f07a8dce-336e-4eba-ae6a-6cc155afdd2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:42:37.762054 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 270/559] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Oct 9 00:42:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 09 00:42:37.762836 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc31666-2e91-4231-9ca3-14cf0e845d36 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:37.783316 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 290/560] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Oct 9 00:42:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 09 00:42:37.783316 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07a8dce-336e-4eba-ae6a-6cc155afdd2e None None] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:37.878580 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:37.928120 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:37.960660 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07a8dce-336e-4eba-ae6a-6cc155afdd2e None None] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:37.990598 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc31666-2e91-4231-9ca3-14cf0e845d36 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:38.008797 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45227d9-3f5b-47ea-9fc8-3dec64bd225c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:38.009454 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45227d9-3f5b-47ea-9fc8-3dec64bd225c None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:38.009731 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45227d9-3f5b-47ea-9fc8-3dec64bd225c None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:38.010003 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45227d9-3f5b-47ea-9fc8-3dec64bd225c None admin] PATH_INFO: `/v3/users/glance` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:38.028491 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45227d9-3f5b-47ea-9fc8-3dec64bd225c None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:38.029976 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45227d9-3f5b-47ea-9fc8-3dec64bd225c None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:38.041911 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8e19df-e737-43f3-96a6-392f7f676cda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:38.042550 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application [None req-d45227d9-3f5b-47ea-9fc8-3dec64bd225c None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Oct 09 00:42:38.042550 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:42:38.042550 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:42:38.042550 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:42:38.042550 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:42:38.042550 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:42:38.042550 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:42:38.042550 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:42:38.042550 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:42:38.042550 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:42:38.042550 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:42:38.042550 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:42:38.042550 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 09 00:42:38.042550 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 09 00:42:38.042550 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 09 00:42:38.042550 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 09 00:42:38.043710 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:42:38.043710 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:42:38.043710 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 09 00:42:38.043710 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 09 00:42:38.043710 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 09 00:42:38.043710 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 09 00:42:38.043710 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:42:38.043710 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:42:38.043710 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:42:38.043710 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:42:38.043710 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:42:38.043710 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application with Lock( Oct 09 00:42:38.043710 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:42:38.043710 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:42:38.043710 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:42:38.043710 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:42:38.043710 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:42:38.043710 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:42:38.044831 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:42:38.044831 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:42:38.044831 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 09 00:42:38.044831 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 09 00:42:38.044831 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 09 00:42:38.044831 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 09 00:42:38.044831 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 09 00:42:38.044831 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 09 00:42:38.044831 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Oct 09 00:42:38.044831 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Oct 09 00:42:38.045554 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8e19df-e737-43f3-96a6-392f7f676cda None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:38.045554 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8e19df-e737-43f3-96a6-392f7f676cda None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:38.045554 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8e19df-e737-43f3-96a6-392f7f676cda None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:38.045774 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 291/561] 10.222.0.15 () {56 vars in 1099 bytes} [Sun Oct 9 00:42:37 2022] GET /identity/v3/users/glance => generated 84 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:42:38.045774 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45227d9-3f5b-47ea-9fc8-3dec64bd225c None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:38.058103 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8e19df-e737-43f3-96a6-392f7f676cda None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:38.059765 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8e19df-e737-43f3-96a6-392f7f676cda None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:38.075798 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application [None req-fe8e19df-e737-43f3-96a6-392f7f676cda None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:42:38.075798 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:42:38.075798 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:42:38.075798 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:42:38.075798 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:42:38.075798 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:42:38.075798 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:42:38.075798 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:42:38.075798 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:42:38.075798 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:42:38.075798 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:42:38.075798 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:42:38.075798 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 09 00:42:38.075798 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 09 00:42:38.075798 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 09 00:42:38.075798 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 09 00:42:38.076802 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:42:38.076802 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:42:38.076802 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:42:38.076802 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:42:38.076802 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:42:38.076802 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:42:38.076802 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:42:38.076802 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application with Lock( Oct 09 00:42:38.076802 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:42:38.076802 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:42:38.076802 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:42:38.076802 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:42:38.076802 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:42:38.076802 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:42:38.076802 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:42:38.076802 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:42:38.076802 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 09 00:42:38.077694 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 09 00:42:38.077694 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:42:38.077694 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application Oct 09 00:42:38.077694 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 271/562] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Oct 9 00:42:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 315 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:42:38.078336 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34da05d-02d6-478c-9c1b-af0172835127 None None] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:38.078431 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34da05d-02d6-478c-9c1b-af0172835127 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:38.078893 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34da05d-02d6-478c-9c1b-af0172835127 None None] PATH_INFO: `/` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:38.084186 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 272/563] 10.222.0.15 () {54 vars in 927 bytes} [Sun Oct 9 00:42:38 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:42:38.084923 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34da05d-02d6-478c-9c1b-af0172835127 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:38.153546 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45227d9-3f5b-47ea-9fc8-3dec64bd225c None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:38.185953 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102a33a9-4b92-49e1-8340-325b2e7f82f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:38.186502 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102a33a9-4b92-49e1-8340-325b2e7f82f1 None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:38.186772 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102a33a9-4b92-49e1-8340-325b2e7f82f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:38.187081 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102a33a9-4b92-49e1-8340-325b2e7f82f1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:38.188628 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34da05d-02d6-478c-9c1b-af0172835127 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:38.188964 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:38.198437 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102a33a9-4b92-49e1-8340-325b2e7f82f1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 09 00:42:38.202319 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:38.203830 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application [None req-102a33a9-4b92-49e1-8340-325b2e7f82f1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 09 00:42:38.203830 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:42:38.203830 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:42:38.203830 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:42:38.203830 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:42:38.203830 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:42:38.203830 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:42:38.203830 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:42:38.203830 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:42:38.203830 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:42:38.203830 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:42:38.203830 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:42:38.203830 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 09 00:42:38.203830 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 09 00:42:38.203830 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 09 00:42:38.203830 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 09 00:42:38.204803 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 09 00:42:38.204803 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 09 00:42:38.204803 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 09 00:42:38.204803 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 09 00:42:38.204803 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:42:38.204803 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:42:38.204803 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:42:38.204803 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:42:38.204803 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:42:38.204803 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:42:38.204803 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:42:38.204803 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application with Lock( Oct 09 00:42:38.204803 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:42:38.204803 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:42:38.204803 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:42:38.204803 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:42:38.208117 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:42:38.208117 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:42:38.208117 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:42:38.208117 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:42:38.208117 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 09 00:42:38.208117 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 09 00:42:38.208117 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 09 00:42:38.208117 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 09 00:42:38.208117 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 09 00:42:38.208117 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 09 00:42:38.208117 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 09 00:42:38.208117 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Oct 09 00:42:38.208117 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 292/564] 10.222.0.15 () {56 vars in 1102 bytes} [Sun Oct 9 00:42:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:42:38.208117 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102a33a9-4b92-49e1-8340-325b2e7f82f1 None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:38.225234 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf0e75d-7981-4bac-837f-cb05a8774bba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:38.225901 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf0e75d-7981-4bac-837f-cb05a8774bba None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:38.226125 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf0e75d-7981-4bac-837f-cb05a8774bba None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:38.226395 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf0e75d-7981-4bac-837f-cb05a8774bba None admin] PATH_INFO: `/v3/users` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:38.227135 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf0e75d-7981-4bac-837f-cb05a8774bba None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:42:38.227580 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf0e75d-7981-4bac-837f-cb05a8774bba None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:38.229016 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf0e75d-7981-4bac-837f-cb05a8774bba None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:38.246575 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 273/565] 10.222.0.15 () {56 vars in 1137 bytes} [Sun Oct 9 00:42:38 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:42:38.247876 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e64f43b-3a0d-4b74-91a7-e9e3ac7d73e9 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:38.248159 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e64f43b-3a0d-4b74-91a7-e9e3ac7d73e9 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:38.248788 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e64f43b-3a0d-4b74-91a7-e9e3ac7d73e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:38.267922 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-4e64f43b-3a0d-4b74-91a7-e9e3ac7d73e9 None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:42:38.269150 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-4e64f43b-3a0d-4b74-91a7-e9e3ac7d73e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:42:38.313793 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102a33a9-4b92-49e1-8340-325b2e7f82f1 None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:38.337190 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 274/566] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Oct 9 00:42:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 09 00:42:38.338092 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e64f43b-3a0d-4b74-91a7-e9e3ac7d73e9 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:38.363676 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8570731d-56bb-470f-8c71-cd81ce739a70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:38.364301 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8570731d-56bb-470f-8c71-cd81ce739a70 None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:38.364572 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8570731d-56bb-470f-8c71-cd81ce739a70 None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:38.364820 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8570731d-56bb-470f-8c71-cd81ce739a70 None admin] PATH_INFO: `/v3/domains` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:38.365458 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8570731d-56bb-470f-8c71-cd81ce739a70 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:42:38.365756 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8570731d-56bb-470f-8c71-cd81ce739a70 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:38.367134 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8570731d-56bb-470f-8c71-cd81ce739a70 None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:38.381243 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 293/567] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Oct 9 00:42:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:42:38.382104 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8570731d-56bb-470f-8c71-cd81ce739a70 None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:38.442934 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:38.445408 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:38.446972 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e64f43b-3a0d-4b74-91a7-e9e3ac7d73e9 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:38.484062 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f122ff4b-4e34-4113-b037-c3e2099e9fae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:38.484707 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f122ff4b-4e34-4113-b037-c3e2099e9fae None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:38.484980 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f122ff4b-4e34-4113-b037-c3e2099e9fae None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:38.485246 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f122ff4b-4e34-4113-b037-c3e2099e9fae None admin] PATH_INFO: `/v3/roles/service` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:38.493896 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8570731d-56bb-470f-8c71-cd81ce739a70 None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:38.496928 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f122ff4b-4e34-4113-b037-c3e2099e9fae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 09 00:42:38.501772 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application [None req-f122ff4b-4e34-4113-b037-c3e2099e9fae None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 09 00:42:38.501772 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:42:38.501772 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:42:38.501772 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:42:38.501772 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:42:38.501772 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:42:38.501772 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:42:38.501772 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:42:38.501772 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:42:38.501772 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:42:38.501772 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:42:38.501772 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:42:38.501772 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 09 00:42:38.501772 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 09 00:42:38.501772 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 09 00:42:38.501772 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 09 00:42:38.502761 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 09 00:42:38.502761 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 09 00:42:38.502761 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 09 00:42:38.502761 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 09 00:42:38.502761 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:42:38.502761 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:42:38.502761 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:42:38.502761 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:42:38.502761 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:42:38.502761 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:42:38.502761 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:42:38.502761 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application with Lock( Oct 09 00:42:38.502761 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:42:38.502761 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:42:38.502761 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:42:38.502761 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:42:38.503637 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:42:38.503637 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:42:38.503637 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:42:38.503637 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:42:38.503637 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 09 00:42:38.503637 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 09 00:42:38.503637 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 09 00:42:38.503637 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 09 00:42:38.503637 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 09 00:42:38.503637 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 09 00:42:38.503637 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 09 00:42:38.503637 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application Oct 09 00:42:38.503637 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 275/568] 10.222.0.15 () {56 vars in 1102 bytes} [Sun Oct 9 00:42:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:42:38.504323 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f122ff4b-4e34-4113-b037-c3e2099e9fae None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:38.537890 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7d0e4e-c7be-4902-97f6-e63e0ce6bb68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:38.538610 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7d0e4e-c7be-4902-97f6-e63e0ce6bb68 None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:38.538803 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7d0e4e-c7be-4902-97f6-e63e0ce6bb68 None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:38.539043 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7d0e4e-c7be-4902-97f6-e63e0ce6bb68 None admin] PATH_INFO: `/v3/roles` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:38.539746 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7d0e4e-c7be-4902-97f6-e63e0ce6bb68 None admin] RBAC: Adding query filter params (name=service) {{(pid=81525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:42:38.540121 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7d0e4e-c7be-4902-97f6-e63e0ce6bb68 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:38.541507 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7d0e4e-c7be-4902-97f6-e63e0ce6bb68 None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:38.550294 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 294/569] 10.222.0.15 () {56 vars in 1103 bytes} [Sun Oct 9 00:42:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:42:38.551180 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7d0e4e-c7be-4902-97f6-e63e0ce6bb68 None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:38.616695 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f122ff4b-4e34-4113-b037-c3e2099e9fae None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:38.653363 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a680168a-06a0-48be-a492-e14fad027e8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:38.654009 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a680168a-06a0-48be-a492-e14fad027e8b None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:38.654287 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a680168a-06a0-48be-a492-e14fad027e8b None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:38.654548 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7d0e4e-c7be-4902-97f6-e63e0ce6bb68 None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:38.654644 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a680168a-06a0-48be-a492-e14fad027e8b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:38.665383 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a680168a-06a0-48be-a492-e14fad027e8b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:38.666862 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a680168a-06a0-48be-a492-e14fad027e8b None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:38.671834 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:38.681632 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application [None req-a680168a-06a0-48be-a492-e14fad027e8b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:42:38.681632 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:42:38.681632 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:42:38.681632 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:42:38.681632 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:42:38.681632 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:42:38.681632 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:42:38.681632 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:42:38.681632 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:42:38.681632 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:42:38.681632 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:42:38.681632 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:42:38.681632 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 09 00:42:38.681632 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 09 00:42:38.681632 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 09 00:42:38.681632 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 09 00:42:38.682819 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:42:38.682819 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:42:38.682819 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:42:38.682819 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:42:38.682819 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:42:38.682819 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:42:38.682819 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:42:38.682819 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application with Lock( Oct 09 00:42:38.682819 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:42:38.682819 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:42:38.682819 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:42:38.682819 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:42:38.682819 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:42:38.682819 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:42:38.682819 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:42:38.682819 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:42:38.682819 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 09 00:42:38.683944 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 09 00:42:38.683944 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:42:38.683944 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application Oct 09 00:42:38.683944 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 276/570] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Oct 9 00:42:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:42:38.683944 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a680168a-06a0-48be-a492-e14fad027e8b None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:38.692658 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55b018a-c956-406f-a6a8-d94cd9a4ec1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:38.693222 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55b018a-c956-406f-a6a8-d94cd9a4ec1d None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:38.693495 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55b018a-c956-406f-a6a8-d94cd9a4ec1d None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:38.693761 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55b018a-c956-406f-a6a8-d94cd9a4ec1d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:38.699438 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:38.701618 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55b018a-c956-406f-a6a8-d94cd9a4ec1d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:38.703323 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55b018a-c956-406f-a6a8-d94cd9a4ec1d None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:38.716069 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application [None req-a55b018a-c956-406f-a6a8-d94cd9a4ec1d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 09 00:42:38.716069 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:42:38.716069 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:42:38.716069 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:42:38.716069 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:42:38.716069 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:42:38.716069 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:42:38.716069 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:42:38.716069 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:42:38.716069 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:42:38.716069 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:42:38.716069 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:42:38.716069 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 09 00:42:38.716069 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 09 00:42:38.716069 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 09 00:42:38.717046 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 09 00:42:38.717046 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:42:38.717046 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:42:38.717046 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:42:38.717046 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:42:38.717046 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:42:38.717046 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:42:38.717046 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:42:38.717046 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application with Lock( Oct 09 00:42:38.717046 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:42:38.717046 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:42:38.717046 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:42:38.717046 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:42:38.717046 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:42:38.717046 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:42:38.717046 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:42:38.717046 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:42:38.717932 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 09 00:42:38.717932 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 09 00:42:38.717932 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 09 00:42:38.717932 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 09 00:42:38.717932 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 09 00:42:38.717932 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 09 00:42:38.717932 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 09 00:42:38.717932 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Oct 09 00:42:38.717932 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 295/571] 10.222.0.15 () {56 vars in 1111 bytes} [Sun Oct 9 00:42:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:42:38.717932 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55b018a-c956-406f-a6a8-d94cd9a4ec1d None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:38.786923 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a680168a-06a0-48be-a492-e14fad027e8b None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:38.818099 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55b018a-c956-406f-a6a8-d94cd9a4ec1d None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:38.821373 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b465775a-fcea-44bf-aedc-fdd781619a02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:38.821994 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b465775a-fcea-44bf-aedc-fdd781619a02 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:38.822270 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b465775a-fcea-44bf-aedc-fdd781619a02 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:38.822539 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b465775a-fcea-44bf-aedc-fdd781619a02 None admin] PATH_INFO: `/v3/roles` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:38.823216 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b465775a-fcea-44bf-aedc-fdd781619a02 None admin] RBAC: Adding query filter params (name=service) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:42:38.823553 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b465775a-fcea-44bf-aedc-fdd781619a02 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:38.824935 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b465775a-fcea-44bf-aedc-fdd781619a02 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:38.834027 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 277/572] 10.222.0.15 () {56 vars in 1103 bytes} [Sun Oct 9 00:42:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:42:38.834870 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b465775a-fcea-44bf-aedc-fdd781619a02 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:38.853169 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6193b7-ec20-4b0b-b55e-951970ccefc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:38.854063 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6193b7-ec20-4b0b-b55e-951970ccefc3 None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:38.854528 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6193b7-ec20-4b0b-b55e-951970ccefc3 None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:38.854769 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6193b7-ec20-4b0b-b55e-951970ccefc3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:38.865878 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6193b7-ec20-4b0b-b55e-951970ccefc3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:38.867440 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6193b7-ec20-4b0b-b55e-951970ccefc3 None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:38.882519 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application [None req-cf6193b7-ec20-4b0b-b55e-951970ccefc3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:42:38.882519 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:42:38.882519 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:42:38.882519 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:42:38.882519 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:42:38.882519 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:42:38.882519 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:42:38.882519 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:42:38.882519 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:42:38.882519 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:42:38.882519 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:42:38.882519 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:42:38.882519 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 09 00:42:38.882519 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 09 00:42:38.882519 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 09 00:42:38.882519 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 09 00:42:38.883734 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:42:38.883734 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:42:38.883734 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:42:38.883734 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:42:38.883734 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:42:38.883734 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:42:38.883734 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:42:38.883734 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application with Lock( Oct 09 00:42:38.883734 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:42:38.883734 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:42:38.883734 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:42:38.883734 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:42:38.883734 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:42:38.883734 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:42:38.883734 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:42:38.883734 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:42:38.883734 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 09 00:42:38.884703 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 09 00:42:38.884703 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:42:38.884703 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Oct 09 00:42:38.884703 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 296/573] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Oct 9 00:42:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:42:38.884703 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6193b7-ec20-4b0b-b55e-951970ccefc3 None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:38.913381 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:38.913967 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:38.940551 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b465775a-fcea-44bf-aedc-fdd781619a02 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:38.976557 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a162662d-e04c-4270-aadc-8ab343097e22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:38.977103 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a162662d-e04c-4270-aadc-8ab343097e22 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:38.977376 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a162662d-e04c-4270-aadc-8ab343097e22 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:38.977644 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a162662d-e04c-4270-aadc-8ab343097e22 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:38.986783 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6193b7-ec20-4b0b-b55e-951970ccefc3 None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:38.988174 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a162662d-e04c-4270-aadc-8ab343097e22 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 09 00:42:38.993555 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application [None req-a162662d-e04c-4270-aadc-8ab343097e22 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 09 00:42:38.993555 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:42:38.993555 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:42:38.993555 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:42:38.993555 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:42:38.993555 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:42:38.993555 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:42:38.993555 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:42:38.993555 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:42:38.993555 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:42:38.993555 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:42:38.993555 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:42:38.993555 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 09 00:42:38.993555 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 09 00:42:38.993555 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 09 00:42:38.993555 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 09 00:42:38.994544 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 09 00:42:38.994544 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 09 00:42:38.994544 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 09 00:42:38.994544 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 09 00:42:38.994544 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:42:38.994544 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:42:38.994544 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:42:38.994544 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:42:38.994544 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:42:38.994544 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:42:38.994544 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:42:38.994544 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application with Lock( Oct 09 00:42:38.994544 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:42:38.994544 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:42:38.994544 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:42:38.994544 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:42:38.995415 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:42:38.995415 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:42:38.995415 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:42:38.995415 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:42:38.995415 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 09 00:42:38.995415 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 09 00:42:38.995415 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 09 00:42:38.995415 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 09 00:42:38.995415 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 09 00:42:38.995415 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 09 00:42:38.995415 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 09 00:42:38.995415 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application Oct 09 00:42:38.995415 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 278/574] 10.222.0.15 () {56 vars in 1102 bytes} [Sun Oct 9 00:42:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:42:38.996098 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a162662d-e04c-4270-aadc-8ab343097e22 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:39.026605 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5032b6-c6a2-4ab5-b283-db6010b18270 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:39.027223 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5032b6-c6a2-4ab5-b283-db6010b18270 None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:39.027540 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5032b6-c6a2-4ab5-b283-db6010b18270 None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:39.027809 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5032b6-c6a2-4ab5-b283-db6010b18270 None admin] PATH_INFO: `/v3/domains` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:39.028454 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5032b6-c6a2-4ab5-b283-db6010b18270 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:42:39.028814 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5032b6-c6a2-4ab5-b283-db6010b18270 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:39.030203 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5032b6-c6a2-4ab5-b283-db6010b18270 None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:39.042997 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 297/575] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Oct 9 00:42:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:42:39.043895 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5032b6-c6a2-4ab5-b283-db6010b18270 None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:39.099690 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a162662d-e04c-4270-aadc-8ab343097e22 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:39.129900 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:39.135791 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3a257b-392c-47ad-a3e0-1c402ab965b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:39.136500 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3a257b-392c-47ad-a3e0-1c402ab965b2 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:39.136836 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3a257b-392c-47ad-a3e0-1c402ab965b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:39.137135 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3a257b-392c-47ad-a3e0-1c402ab965b2 None admin] PATH_INFO: `/v3/projects` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:39.137878 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3a257b-392c-47ad-a3e0-1c402ab965b2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:42:39.138184 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3a257b-392c-47ad-a3e0-1c402ab965b2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:39.139660 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3a257b-392c-47ad-a3e0-1c402ab965b2 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:39.141315 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:39.142709 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5032b6-c6a2-4ab5-b283-db6010b18270 None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:39.152910 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 279/576] 10.222.0.15 () {56 vars in 1148 bytes} [Sun Oct 9 00:42:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:42:39.153759 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3a257b-392c-47ad-a3e0-1c402ab965b2 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:39.178512 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aaa421c-3c4e-4fd8-ba66-07520a653d6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:39.179148 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaa421c-3c4e-4fd8-ba66-07520a653d6b None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:39.179452 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaa421c-3c4e-4fd8-ba66-07520a653d6b None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:39.179733 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaa421c-3c4e-4fd8-ba66-07520a653d6b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:39.190057 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aaa421c-3c4e-4fd8-ba66-07520a653d6b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:39.191660 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aaa421c-3c4e-4fd8-ba66-07520a653d6b None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:39.206451 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application [None req-9aaa421c-3c4e-4fd8-ba66-07520a653d6b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:42:39.206451 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:42:39.206451 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:42:39.206451 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:42:39.206451 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:42:39.206451 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:42:39.206451 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:42:39.206451 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:42:39.206451 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:42:39.206451 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:42:39.206451 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:42:39.206451 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:42:39.206451 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 09 00:42:39.206451 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 09 00:42:39.206451 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 09 00:42:39.206451 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 09 00:42:39.207615 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:42:39.207615 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:42:39.207615 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:42:39.207615 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:42:39.207615 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:42:39.207615 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:42:39.207615 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:42:39.207615 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application with Lock( Oct 09 00:42:39.207615 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:42:39.207615 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:42:39.207615 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:42:39.207615 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:42:39.207615 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:42:39.207615 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:42:39.207615 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:42:39.207615 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:42:39.207615 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 09 00:42:39.208694 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 09 00:42:39.208694 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:42:39.208694 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Oct 09 00:42:39.208694 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 298/577] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Oct 9 00:42:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:42:39.208694 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aaa421c-3c4e-4fd8-ba66-07520a653d6b None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:39.256348 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3a257b-392c-47ad-a3e0-1c402ab965b2 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:39.292336 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a65078-b6a8-4ceb-96f7-1481a82e5908 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:39.292948 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a65078-b6a8-4ceb-96f7-1481a82e5908 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:39.293221 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a65078-b6a8-4ceb-96f7-1481a82e5908 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:39.293487 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a65078-b6a8-4ceb-96f7-1481a82e5908 None admin] PATH_INFO: `/v3/domains` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:39.294138 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a65078-b6a8-4ceb-96f7-1481a82e5908 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:42:39.294435 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a65078-b6a8-4ceb-96f7-1481a82e5908 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:39.295854 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a65078-b6a8-4ceb-96f7-1481a82e5908 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:39.307412 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 280/578] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Oct 9 00:42:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:42:39.308217 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a65078-b6a8-4ceb-96f7-1481a82e5908 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:39.308789 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aaa421c-3c4e-4fd8-ba66-07520a653d6b None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:39.344833 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8cf068-fc04-4f9b-aa01-b7abe53a8e57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:39.345482 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8cf068-fc04-4f9b-aa01-b7abe53a8e57 None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:39.345758 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8cf068-fc04-4f9b-aa01-b7abe53a8e57 None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:39.346024 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8cf068-fc04-4f9b-aa01-b7abe53a8e57 None admin] PATH_INFO: `/v3/roles` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:39.346715 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8cf068-fc04-4f9b-aa01-b7abe53a8e57 None admin] RBAC: Adding query filter params (name=service) {{(pid=81525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:42:39.347002 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8cf068-fc04-4f9b-aa01-b7abe53a8e57 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:39.348420 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8cf068-fc04-4f9b-aa01-b7abe53a8e57 None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:39.356392 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 299/579] 10.222.0.15 () {56 vars in 1103 bytes} [Sun Oct 9 00:42:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:42:39.356392 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8cf068-fc04-4f9b-aa01-b7abe53a8e57 None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:39.356392 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:39.366214 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:39.411525 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a65078-b6a8-4ceb-96f7-1481a82e5908 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:39.453860 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d0b58f-8531-492d-8532-a0b3f360e085 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:39.454494 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d0b58f-8531-492d-8532-a0b3f360e085 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:39.454775 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d0b58f-8531-492d-8532-a0b3f360e085 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:39.455044 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d0b58f-8531-492d-8532-a0b3f360e085 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:39.461773 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d0b58f-8531-492d-8532-a0b3f360e085 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:39.463241 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d0b58f-8531-492d-8532-a0b3f360e085 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:39.464895 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8cf068-fc04-4f9b-aa01-b7abe53a8e57 None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:39.474481 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application [None req-94d0b58f-8531-492d-8532-a0b3f360e085 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 09 00:42:39.474481 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:42:39.474481 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:42:39.474481 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:42:39.474481 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:42:39.474481 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:42:39.474481 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:42:39.474481 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:42:39.474481 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:42:39.474481 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:42:39.474481 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:42:39.474481 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:42:39.474481 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 09 00:42:39.474481 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 09 00:42:39.474481 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 09 00:42:39.475524 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 09 00:42:39.475524 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:42:39.475524 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:42:39.475524 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:42:39.475524 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:42:39.475524 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:42:39.475524 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:42:39.475524 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:42:39.475524 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application with Lock( Oct 09 00:42:39.475524 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:42:39.475524 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:42:39.475524 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:42:39.475524 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:42:39.475524 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:42:39.475524 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:42:39.475524 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:42:39.475524 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:42:39.476570 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 09 00:42:39.476570 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 09 00:42:39.476570 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 09 00:42:39.476570 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 09 00:42:39.476570 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 09 00:42:39.476570 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 09 00:42:39.476570 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 09 00:42:39.476570 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application Oct 09 00:42:39.476570 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 281/580] 10.222.0.15 () {56 vars in 1111 bytes} [Sun Oct 9 00:42:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:42:39.476570 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d0b58f-8531-492d-8532-a0b3f360e085 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:39.501208 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ea94f3-22c0-4982-b37e-7ea2f574e461 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:39.501823 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ea94f3-22c0-4982-b37e-7ea2f574e461 None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:39.502093 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ea94f3-22c0-4982-b37e-7ea2f574e461 None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:39.502378 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ea94f3-22c0-4982-b37e-7ea2f574e461 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:39.503093 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ea94f3-22c0-4982-b37e-7ea2f574e461 None admin] RBAC: Adding query filter params (role.id=6fe3faf520bd402f9bd78d3ed08eec34, scope.project.id=f148d39ced534860abfbe8fc3f98ace4, user.id=c4c467943b8f4d31a2f067ca6ed3b25c) {{(pid=81525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:42:39.503429 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ea94f3-22c0-4982-b37e-7ea2f574e461 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:39.504862 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ea94f3-22c0-4982-b37e-7ea2f574e461 None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:39.510197 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 300/581] 10.222.0.15 () {56 vars in 1374 bytes} [Sun Oct 9 00:42:39 2022] GET /identity/v3/role_assignments?user.id=c4c467943b8f4d31a2f067ca6ed3b25c&scope.project.id=f148d39ced534860abfbe8fc3f98ace4&role.id=6fe3faf520bd402f9bd78d3ed08eec34 => generated 259 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:42:39.510976 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ea94f3-22c0-4982-b37e-7ea2f574e461 None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:39.587467 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:39.593281 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d0b58f-8531-492d-8532-a0b3f360e085 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:39.609021 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:39.630086 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ea94f3-22c0-4982-b37e-7ea2f574e461 None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:39.632131 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b96e85-f360-4593-9f4c-2456a6e859c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:39.632756 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b96e85-f360-4593-9f4c-2456a6e859c1 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:39.633032 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b96e85-f360-4593-9f4c-2456a6e859c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:39.633300 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b96e85-f360-4593-9f4c-2456a6e859c1 None admin] PATH_INFO: `/v3/domains` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:39.633996 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b96e85-f360-4593-9f4c-2456a6e859c1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:42:39.634296 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b96e85-f360-4593-9f4c-2456a6e859c1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:39.635739 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b96e85-f360-4593-9f4c-2456a6e859c1 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:39.648849 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 282/582] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Oct 9 00:42:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:42:39.649890 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b96e85-f360-4593-9f4c-2456a6e859c1 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:39.674393 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8d5f85-99a2-4715-9f57-461e3a9187bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:39.675048 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8d5f85-99a2-4715-9f57-461e3a9187bb None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:39.675357 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8d5f85-99a2-4715-9f57-461e3a9187bb None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:39.675627 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8d5f85-99a2-4715-9f57-461e3a9187bb None admin] PATH_INFO: `/v3/users/nova` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:39.684136 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8d5f85-99a2-4715-9f57-461e3a9187bb None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:39.685626 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8d5f85-99a2-4715-9f57-461e3a9187bb None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:39.697937 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application [None req-3f8d5f85-99a2-4715-9f57-461e3a9187bb None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 09 00:42:39.697937 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:42:39.697937 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:42:39.697937 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:42:39.697937 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:42:39.697937 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:42:39.697937 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:42:39.697937 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:42:39.697937 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:42:39.697937 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:42:39.697937 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:42:39.697937 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:42:39.697937 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 09 00:42:39.697937 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 09 00:42:39.697937 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 09 00:42:39.697937 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 09 00:42:39.698928 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:42:39.698928 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:42:39.698928 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 09 00:42:39.698928 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 09 00:42:39.698928 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 09 00:42:39.698928 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 09 00:42:39.698928 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:42:39.698928 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:42:39.698928 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:42:39.698928 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:42:39.698928 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:42:39.698928 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application with Lock( Oct 09 00:42:39.698928 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:42:39.698928 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:42:39.698928 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:42:39.698928 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:42:39.698928 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:42:39.698928 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:42:39.700131 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:42:39.700131 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:42:39.700131 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 09 00:42:39.700131 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 09 00:42:39.700131 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 09 00:42:39.700131 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 09 00:42:39.700131 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 09 00:42:39.700131 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 09 00:42:39.700131 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 09 00:42:39.700131 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Oct 09 00:42:39.700131 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 301/583] 10.222.0.15 () {56 vars in 1093 bytes} [Sun Oct 9 00:42:39 2022] GET /identity/v3/users/nova => generated 82 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:42:39.700131 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8d5f85-99a2-4715-9f57-461e3a9187bb None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:39.764471 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b96e85-f360-4593-9f4c-2456a6e859c1 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:39.800272 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c959f05-fb89-44a5-b549-48595402c55d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:39.800918 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c959f05-fb89-44a5-b549-48595402c55d None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:39.801196 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c959f05-fb89-44a5-b549-48595402c55d None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:39.801469 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c959f05-fb89-44a5-b549-48595402c55d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:39.812599 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c959f05-fb89-44a5-b549-48595402c55d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:39.813393 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8d5f85-99a2-4715-9f57-461e3a9187bb None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:39.814071 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c959f05-fb89-44a5-b549-48595402c55d None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:39.830173 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application [None req-8c959f05-fb89-44a5-b549-48595402c55d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:42:39.830173 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:42:39.830173 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:42:39.830173 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:42:39.830173 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:42:39.830173 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:42:39.830173 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:42:39.830173 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:42:39.830173 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:42:39.830173 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:42:39.830173 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:42:39.830173 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:42:39.830173 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 09 00:42:39.830173 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 09 00:42:39.830173 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 09 00:42:39.830173 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 09 00:42:39.831185 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:42:39.831185 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:42:39.831185 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:42:39.831185 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:42:39.831185 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:42:39.831185 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:42:39.831185 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:42:39.831185 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application with Lock( Oct 09 00:42:39.831185 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:42:39.831185 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:42:39.831185 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:42:39.831185 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:42:39.831185 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:42:39.831185 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:42:39.831185 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:42:39.831185 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:42:39.831185 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 09 00:42:39.832231 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 09 00:42:39.832231 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:42:39.832231 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application Oct 09 00:42:39.838512 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 283/584] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Oct 9 00:42:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:42:39.839680 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c959f05-fb89-44a5-b549-48595402c55d None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:39.840340 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:39.852974 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039c6aeb-01bb-4a7a-ba73-c6a338c958cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:39.853685 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039c6aeb-01bb-4a7a-ba73-c6a338c958cc None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:39.854027 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039c6aeb-01bb-4a7a-ba73-c6a338c958cc None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:39.854348 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039c6aeb-01bb-4a7a-ba73-c6a338c958cc None admin] PATH_INFO: `/v3/projects` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:39.855129 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039c6aeb-01bb-4a7a-ba73-c6a338c958cc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:42:39.855514 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039c6aeb-01bb-4a7a-ba73-c6a338c958cc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:39.857024 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039c6aeb-01bb-4a7a-ba73-c6a338c958cc None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:39.869238 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:39.870185 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 302/585] 10.222.0.15 () {56 vars in 1148 bytes} [Sun Oct 9 00:42:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:42:39.871103 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039c6aeb-01bb-4a7a-ba73-c6a338c958cc None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:39.954977 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c959f05-fb89-44a5-b549-48595402c55d None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:39.977039 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039c6aeb-01bb-4a7a-ba73-c6a338c958cc None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:39.991613 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d43e4f-66e9-4b56-95aa-840c7203ad85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:39.992244 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d43e4f-66e9-4b56-95aa-840c7203ad85 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:39.992501 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d43e4f-66e9-4b56-95aa-840c7203ad85 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:39.992768 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d43e4f-66e9-4b56-95aa-840c7203ad85 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:40.001077 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d43e4f-66e9-4b56-95aa-840c7203ad85 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:40.002522 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d43e4f-66e9-4b56-95aa-840c7203ad85 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:40.014182 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application [None req-04d43e4f-66e9-4b56-95aa-840c7203ad85 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 09 00:42:40.014182 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:42:40.014182 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:42:40.014182 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:42:40.014182 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:42:40.014182 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:42:40.014182 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:42:40.014182 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:42:40.014182 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:42:40.014182 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:42:40.014182 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:42:40.014182 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:42:40.014182 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 09 00:42:40.014182 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 09 00:42:40.014182 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 09 00:42:40.014182 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 09 00:42:40.015425 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:42:40.015425 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:42:40.015425 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 09 00:42:40.015425 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 09 00:42:40.015425 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 09 00:42:40.015425 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 09 00:42:40.015425 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:42:40.015425 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:42:40.015425 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:42:40.015425 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:42:40.015425 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:42:40.015425 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application with Lock( Oct 09 00:42:40.015425 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:42:40.015425 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:42:40.015425 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:42:40.015425 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:42:40.015425 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:42:40.015425 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:42:40.016616 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:42:40.016616 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:42:40.016616 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 09 00:42:40.016616 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 09 00:42:40.016616 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 09 00:42:40.016616 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 09 00:42:40.016616 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 09 00:42:40.016616 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 09 00:42:40.016616 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 09 00:42:40.016616 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application Oct 09 00:42:40.017276 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86540bba-c17b-4b3e-8645-c056bef01772 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:40.017950 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86540bba-c17b-4b3e-8645-c056bef01772 None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:40.018309 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86540bba-c17b-4b3e-8645-c056bef01772 None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:40.018659 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86540bba-c17b-4b3e-8645-c056bef01772 None admin] PATH_INFO: `/v3/users` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:40.019498 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86540bba-c17b-4b3e-8645-c056bef01772 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:42:40.019954 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86540bba-c17b-4b3e-8645-c056bef01772 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:40.020070 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 284/586] 10.222.0.15 () {56 vars in 1099 bytes} [Sun Oct 9 00:42:39 2022] GET /identity/v3/users/cinder => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:42:40.020889 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d43e4f-66e9-4b56-95aa-840c7203ad85 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:40.021568 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86540bba-c17b-4b3e-8645-c056bef01772 None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:40.043546 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 303/587] 10.222.0.15 () {56 vars in 1133 bytes} [Sun Oct 9 00:42:39 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:42:40.043546 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86540bba-c17b-4b3e-8645-c056bef01772 None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:40.089031 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:40.122225 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:40.138885 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d43e4f-66e9-4b56-95aa-840c7203ad85 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:40.152556 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86540bba-c17b-4b3e-8645-c056bef01772 None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:40.174273 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76e7afe-05dd-4d9b-88ee-ab48f7061ab0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:40.174889 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76e7afe-05dd-4d9b-88ee-ab48f7061ab0 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:40.175157 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76e7afe-05dd-4d9b-88ee-ab48f7061ab0 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:40.175740 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76e7afe-05dd-4d9b-88ee-ab48f7061ab0 None admin] PATH_INFO: `/v3/domains` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:40.176098 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76e7afe-05dd-4d9b-88ee-ab48f7061ab0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:42:40.176404 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76e7afe-05dd-4d9b-88ee-ab48f7061ab0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:40.177782 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76e7afe-05dd-4d9b-88ee-ab48f7061ab0 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:40.189352 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fc41d0-0e39-4ef2-a10c-f589224e4b58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:40.190025 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fc41d0-0e39-4ef2-a10c-f589224e4b58 None admin] REQUEST_METHOD: `PUT` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:40.190299 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fc41d0-0e39-4ef2-a10c-f589224e4b58 None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:40.194916 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fc41d0-0e39-4ef2-a10c-f589224e4b58 None admin] PATH_INFO: `/v3/projects/f148d39ced534860abfbe8fc3f98ace4/users/d88a9f3d154c4cf98369972a0561b2b5/roles/6fe3faf520bd402f9bd78d3ed08eec34` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:40.195061 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 285/588] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Oct 9 00:42:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:42:40.195061 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76e7afe-05dd-4d9b-88ee-ab48f7061ab0 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:40.208410 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fc41d0-0e39-4ef2-a10c-f589224e4b58 None admin] RBAC: Authorizing `identity:create_grant(project_id=f148d39ced534860abfbe8fc3f98ace4, user_id=d88a9f3d154c4cf98369972a0561b2b5, role_id=6fe3faf520bd402f9bd78d3ed08eec34)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:40.209880 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fc41d0-0e39-4ef2-a10c-f589224e4b58 None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:40.225283 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 304/589] 10.222.0.15 () {58 vars in 1439 bytes} [Sun Oct 9 00:42:40 2022] PUT /identity/v3/projects/f148d39ced534860abfbe8fc3f98ace4/users/d88a9f3d154c4cf98369972a0561b2b5/roles/6fe3faf520bd402f9bd78d3ed08eec34 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 00:42:40.231754 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fc41d0-0e39-4ef2-a10c-f589224e4b58 None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:40.319447 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76e7afe-05dd-4d9b-88ee-ab48f7061ab0 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:40.345948 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:40.353999 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fc41d0-0e39-4ef2-a10c-f589224e4b58 None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:40.366506 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f595bf51-e0ad-4480-98f6-0c13e89854b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:40.367706 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f595bf51-e0ad-4480-98f6-0c13e89854b8 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:40.368267 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f595bf51-e0ad-4480-98f6-0c13e89854b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:40.368799 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f595bf51-e0ad-4480-98f6-0c13e89854b8 None admin] PATH_INFO: `/v3/users` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:40.369853 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f595bf51-e0ad-4480-98f6-0c13e89854b8 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:42:40.370563 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f595bf51-e0ad-4480-98f6-0c13e89854b8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:40.372437 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f595bf51-e0ad-4480-98f6-0c13e89854b8 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:40.396203 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 286/590] 10.222.0.15 () {56 vars in 1137 bytes} [Sun Oct 9 00:42:40 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:42:40.397556 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f595bf51-e0ad-4480-98f6-0c13e89854b8 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:40.400745 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52863e0-5d51-477d-83e7-136e20345566 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:40.401566 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52863e0-5d51-477d-83e7-136e20345566 None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:40.401850 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52863e0-5d51-477d-83e7-136e20345566 None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:40.402123 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52863e0-5d51-477d-83e7-136e20345566 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:40.403404 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:40.414315 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52863e0-5d51-477d-83e7-136e20345566 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:40.415871 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52863e0-5d51-477d-83e7-136e20345566 None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:40.433546 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application [None req-f52863e0-5d51-477d-83e7-136e20345566 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:42:40.433546 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:42:40.433546 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:42:40.433546 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:42:40.433546 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:42:40.433546 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:42:40.433546 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:42:40.433546 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:42:40.433546 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:42:40.433546 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:42:40.433546 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:42:40.433546 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:42:40.433546 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 09 00:42:40.433546 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 09 00:42:40.433546 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 09 00:42:40.433546 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 09 00:42:40.434537 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:42:40.434537 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:42:40.434537 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:42:40.434537 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:42:40.434537 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:42:40.434537 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:42:40.434537 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:42:40.434537 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application with Lock( Oct 09 00:42:40.434537 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:42:40.434537 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:42:40.434537 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:42:40.434537 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:42:40.434537 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:42:40.434537 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:42:40.434537 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:42:40.434537 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:42:40.434537 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 09 00:42:40.435480 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 09 00:42:40.435480 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:42:40.435480 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Oct 09 00:42:40.439360 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 305/591] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Oct 9 00:42:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:42:40.440467 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52863e0-5d51-477d-83e7-136e20345566 None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:40.519989 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f595bf51-e0ad-4480-98f6-0c13e89854b8 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:40.560792 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326f0bf8-4fa4-4808-b81d-4da9fffcd014 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:40.561418 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326f0bf8-4fa4-4808-b81d-4da9fffcd014 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:40.561689 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326f0bf8-4fa4-4808-b81d-4da9fffcd014 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:40.561976 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326f0bf8-4fa4-4808-b81d-4da9fffcd014 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:40.564568 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52863e0-5d51-477d-83e7-136e20345566 None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:40.570637 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326f0bf8-4fa4-4808-b81d-4da9fffcd014 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:40.572686 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326f0bf8-4fa4-4808-b81d-4da9fffcd014 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:40.586829 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application [None req-326f0bf8-4fa4-4808-b81d-4da9fffcd014 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Oct 09 00:42:40.586829 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:42:40.586829 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:42:40.586829 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:42:40.586829 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:42:40.586829 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:42:40.586829 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:42:40.586829 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:42:40.586829 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:42:40.586829 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:42:40.586829 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:42:40.586829 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:42:40.586829 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 09 00:42:40.586829 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 09 00:42:40.586829 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 09 00:42:40.586829 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 09 00:42:40.587872 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:42:40.587872 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:42:40.587872 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 09 00:42:40.587872 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 09 00:42:40.587872 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 09 00:42:40.587872 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 09 00:42:40.587872 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:42:40.587872 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:42:40.587872 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:42:40.587872 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:42:40.587872 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:42:40.587872 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application with Lock( Oct 09 00:42:40.587872 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:42:40.587872 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:42:40.587872 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:42:40.587872 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:42:40.587872 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:42:40.587872 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:42:40.588800 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:42:40.588800 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:42:40.588800 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 09 00:42:40.588800 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 09 00:42:40.588800 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 09 00:42:40.588800 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 09 00:42:40.588800 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 09 00:42:40.588800 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 09 00:42:40.588800 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Oct 09 00:42:40.588800 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application Oct 09 00:42:40.591347 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 287/592] 10.222.0.15 () {56 vars in 1102 bytes} [Sun Oct 9 00:42:40 2022] GET /identity/v3/users/neutron => generated 85 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:42:40.592530 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326f0bf8-4fa4-4808-b81d-4da9fffcd014 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:40.606885 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a724d4-ea3e-4b84-8326-6b7fdae5e17d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:40.607723 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a724d4-ea3e-4b84-8326-6b7fdae5e17d None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:40.608103 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a724d4-ea3e-4b84-8326-6b7fdae5e17d None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:40.608577 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a724d4-ea3e-4b84-8326-6b7fdae5e17d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:40.620201 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a724d4-ea3e-4b84-8326-6b7fdae5e17d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:40.621810 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a724d4-ea3e-4b84-8326-6b7fdae5e17d None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:40.629739 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:40.638904 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application [None req-08a724d4-ea3e-4b84-8326-6b7fdae5e17d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:42:40.638904 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:42:40.638904 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:42:40.638904 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:42:40.638904 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:42:40.638904 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:42:40.638904 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:42:40.638904 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:42:40.638904 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:42:40.638904 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:42:40.638904 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:42:40.638904 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:42:40.638904 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 09 00:42:40.638904 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 09 00:42:40.638904 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 09 00:42:40.638904 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 09 00:42:40.640092 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:42:40.640092 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:42:40.640092 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:42:40.640092 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:42:40.640092 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:42:40.640092 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:42:40.640092 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:42:40.640092 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application with Lock( Oct 09 00:42:40.640092 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:42:40.640092 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:42:40.640092 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:42:40.640092 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:42:40.640092 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:42:40.640092 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:42:40.640092 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:42:40.640092 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:42:40.640092 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 09 00:42:40.641189 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 09 00:42:40.641189 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:42:40.641189 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Oct 09 00:42:40.646843 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 306/593] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Oct 9 00:42:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:42:40.646843 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a724d4-ea3e-4b84-8326-6b7fdae5e17d None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:40.676382 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:40.720268 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326f0bf8-4fa4-4808-b81d-4da9fffcd014 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:40.760834 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b162f7-431c-44bc-bd71-f51add113c6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:40.761187 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a724d4-ea3e-4b84-8326-6b7fdae5e17d None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:40.761675 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b162f7-431c-44bc-bd71-f51add113c6d None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:40.762040 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b162f7-431c-44bc-bd71-f51add113c6d None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:40.762414 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b162f7-431c-44bc-bd71-f51add113c6d None admin] PATH_INFO: `/v3/domains` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:40.763151 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b162f7-431c-44bc-bd71-f51add113c6d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:42:40.763598 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b162f7-431c-44bc-bd71-f51add113c6d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:40.765311 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b162f7-431c-44bc-bd71-f51add113c6d None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:40.778192 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 288/594] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Oct 9 00:42:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:42:40.779334 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b162f7-431c-44bc-bd71-f51add113c6d None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:40.814721 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd02ff36-2aa3-4032-afda-e88698d6949b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:40.816066 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd02ff36-2aa3-4032-afda-e88698d6949b None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:40.816718 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd02ff36-2aa3-4032-afda-e88698d6949b None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:40.817143 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd02ff36-2aa3-4032-afda-e88698d6949b None admin] PATH_INFO: `/v3/users` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:40.818322 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd02ff36-2aa3-4032-afda-e88698d6949b None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:42:40.819179 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd02ff36-2aa3-4032-afda-e88698d6949b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:40.821183 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd02ff36-2aa3-4032-afda-e88698d6949b None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:40.848547 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 307/595] 10.222.0.15 () {56 vars in 1139 bytes} [Sun Oct 9 00:42:40 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:42:40.849686 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd02ff36-2aa3-4032-afda-e88698d6949b None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:40.920928 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:40.933157 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b162f7-431c-44bc-bd71-f51add113c6d None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:40.979105 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd02ff36-2aa3-4032-afda-e88698d6949b None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:40.986211 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:41.008955 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ef1888-c154-4745-93aa-72c0c3ff38b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:41.010541 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ef1888-c154-4745-93aa-72c0c3ff38b3 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:41.011142 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ef1888-c154-4745-93aa-72c0c3ff38b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:41.011864 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ef1888-c154-4745-93aa-72c0c3ff38b3 None admin] PATH_INFO: `/v3/domains` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:41.013222 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ef1888-c154-4745-93aa-72c0c3ff38b3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:42:41.013926 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ef1888-c154-4745-93aa-72c0c3ff38b3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:41.017585 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ef1888-c154-4745-93aa-72c0c3ff38b3 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:41.025072 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976488e5-2d81-4cf8-95d3-0aa4fb7f01bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:41.025954 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976488e5-2d81-4cf8-95d3-0aa4fb7f01bf None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:41.026369 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976488e5-2d81-4cf8-95d3-0aa4fb7f01bf None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:41.026774 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976488e5-2d81-4cf8-95d3-0aa4fb7f01bf None admin] PATH_INFO: `/v3/projects/service` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:41.035740 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976488e5-2d81-4cf8-95d3-0aa4fb7f01bf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:41.037740 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976488e5-2d81-4cf8-95d3-0aa4fb7f01bf None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:41.041209 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 289/596] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Oct 9 00:42:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:42:41.046803 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ef1888-c154-4745-93aa-72c0c3ff38b3 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:41.056637 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application [None req-976488e5-2d81-4cf8-95d3-0aa4fb7f01bf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 09 00:42:41.056637 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:42:41.056637 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:42:41.056637 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:42:41.056637 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:42:41.056637 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:42:41.056637 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:42:41.056637 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:42:41.056637 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:42:41.056637 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:42:41.056637 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:42:41.056637 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:42:41.056637 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 09 00:42:41.056637 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 09 00:42:41.056637 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 09 00:42:41.057640 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 09 00:42:41.057640 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:42:41.057640 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:42:41.057640 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:42:41.057640 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:42:41.057640 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:42:41.057640 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:42:41.057640 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:42:41.057640 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application with Lock( Oct 09 00:42:41.057640 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:42:41.057640 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:42:41.057640 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:42:41.057640 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:42:41.057640 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:42:41.057640 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:42:41.057640 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:42:41.057640 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:42:41.058521 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 09 00:42:41.058521 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 09 00:42:41.058521 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 09 00:42:41.058521 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 09 00:42:41.058521 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 09 00:42:41.058521 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 09 00:42:41.058521 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 09 00:42:41.058521 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Oct 09 00:42:41.065638 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 308/597] 10.222.0.15 () {56 vars in 1111 bytes} [Sun Oct 9 00:42:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:42:41.065638 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976488e5-2d81-4cf8-95d3-0aa4fb7f01bf None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:41.185687 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ef1888-c154-4745-93aa-72c0c3ff38b3 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:41.213954 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976488e5-2d81-4cf8-95d3-0aa4fb7f01bf None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:41.227405 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c707d7f-7564-4fbd-b739-1af78974a9ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:41.228414 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c707d7f-7564-4fbd-b739-1af78974a9ab None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:41.228903 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c707d7f-7564-4fbd-b739-1af78974a9ab None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:41.229445 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c707d7f-7564-4fbd-b739-1af78974a9ab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:41.232604 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:41.243842 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c707d7f-7564-4fbd-b739-1af78974a9ab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:41.246490 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c707d7f-7564-4fbd-b739-1af78974a9ab None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:41.253382 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565f6d9b-3ea3-4bec-9032-c262ede3162a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:41.254110 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565f6d9b-3ea3-4bec-9032-c262ede3162a None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:41.254389 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565f6d9b-3ea3-4bec-9032-c262ede3162a None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:41.255060 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565f6d9b-3ea3-4bec-9032-c262ede3162a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:41.262304 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565f6d9b-3ea3-4bec-9032-c262ede3162a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:41.263926 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565f6d9b-3ea3-4bec-9032-c262ede3162a None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:41.264916 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application [None req-6c707d7f-7564-4fbd-b739-1af78974a9ab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:42:41.264916 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:42:41.264916 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:42:41.264916 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:42:41.264916 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:42:41.264916 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:42:41.264916 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:42:41.264916 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:42:41.264916 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:42:41.264916 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:42:41.264916 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:42:41.264916 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:42:41.264916 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 09 00:42:41.264916 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 09 00:42:41.264916 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 09 00:42:41.264916 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 09 00:42:41.265833 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:42:41.265833 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:42:41.265833 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:42:41.265833 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:42:41.265833 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:42:41.265833 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:42:41.265833 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:42:41.265833 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application with Lock( Oct 09 00:42:41.265833 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:42:41.265833 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:42:41.265833 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:42:41.265833 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:42:41.265833 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:42:41.265833 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:42:41.265833 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:42:41.265833 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:42:41.265833 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 09 00:42:41.266727 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 09 00:42:41.266727 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:42:41.266727 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application Oct 09 00:42:41.268976 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 290/598] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Oct 9 00:42:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:42:41.269956 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c707d7f-7564-4fbd-b739-1af78974a9ab None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:41.281208 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application [None req-565f6d9b-3ea3-4bec-9032-c262ede3162a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 09 00:42:41.281208 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:42:41.281208 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:42:41.281208 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:42:41.281208 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:42:41.281208 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:42:41.281208 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:42:41.281208 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:42:41.281208 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:42:41.281208 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:42:41.281208 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:42:41.281208 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:42:41.281208 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 09 00:42:41.281208 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 09 00:42:41.281208 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 09 00:42:41.282149 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 09 00:42:41.282149 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:42:41.282149 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:42:41.282149 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:42:41.282149 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:42:41.282149 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:42:41.282149 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:42:41.282149 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:42:41.282149 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application with Lock( Oct 09 00:42:41.282149 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:42:41.282149 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:42:41.282149 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:42:41.282149 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:42:41.282149 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:42:41.282149 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:42:41.282149 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:42:41.282149 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:42:41.283070 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 09 00:42:41.283070 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 09 00:42:41.283070 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 09 00:42:41.283070 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 09 00:42:41.283070 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 09 00:42:41.283070 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 09 00:42:41.283070 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 09 00:42:41.283070 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Oct 09 00:42:41.287213 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 309/599] 10.222.0.15 () {56 vars in 1111 bytes} [Sun Oct 9 00:42:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:42:41.288196 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565f6d9b-3ea3-4bec-9032-c262ede3162a None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:41.317727 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:41.399953 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c707d7f-7564-4fbd-b739-1af78974a9ab None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:41.406843 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565f6d9b-3ea3-4bec-9032-c262ede3162a None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:41.445334 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6638a240-a392-43e3-b33e-52f3894bb0f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:41.446554 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6638a240-a392-43e3-b33e-52f3894bb0f5 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:41.447049 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6638a240-a392-43e3-b33e-52f3894bb0f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:41.447525 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6638a240-a392-43e3-b33e-52f3894bb0f5 None admin] PATH_INFO: `/v3/projects` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:41.448494 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6638a240-a392-43e3-b33e-52f3894bb0f5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:42:41.448937 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6638a240-a392-43e3-b33e-52f3894bb0f5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:41.449527 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57aa5e9c-6591-410c-9c56-69dcc2cfcff9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:41.450233 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57aa5e9c-6591-410c-9c56-69dcc2cfcff9 None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:41.450594 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57aa5e9c-6591-410c-9c56-69dcc2cfcff9 None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:41.450948 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57aa5e9c-6591-410c-9c56-69dcc2cfcff9 None admin] PATH_INFO: `/v3/domains` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:41.451161 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6638a240-a392-43e3-b33e-52f3894bb0f5 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:41.451813 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57aa5e9c-6591-410c-9c56-69dcc2cfcff9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:42:41.452198 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57aa5e9c-6591-410c-9c56-69dcc2cfcff9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:41.453774 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57aa5e9c-6591-410c-9c56-69dcc2cfcff9 None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:41.470109 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 291/600] 10.222.0.15 () {56 vars in 1148 bytes} [Sun Oct 9 00:42:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:42:41.470883 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 310/601] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Oct 9 00:42:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:42:41.471787 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6638a240-a392-43e3-b33e-52f3894bb0f5 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:41.471909 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57aa5e9c-6591-410c-9c56-69dcc2cfcff9 None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:41.525359 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:41.584880 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:41.591900 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6638a240-a392-43e3-b33e-52f3894bb0f5 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:41.599109 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57aa5e9c-6591-410c-9c56-69dcc2cfcff9 None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:41.638280 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39784a82-2ae3-4b76-9766-f5bc4be0ce24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:41.639318 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39784a82-2ae3-4b76-9766-f5bc4be0ce24 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:41.639648 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcc9651-8c66-4bd8-9ae9-12500900e4aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:41.640322 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39784a82-2ae3-4b76-9766-f5bc4be0ce24 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:41.640441 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcc9651-8c66-4bd8-9ae9-12500900e4aa None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:41.640697 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcc9651-8c66-4bd8-9ae9-12500900e4aa None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:41.641071 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcc9651-8c66-4bd8-9ae9-12500900e4aa None admin] PATH_INFO: `/v3/projects/service` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:41.641251 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39784a82-2ae3-4b76-9766-f5bc4be0ce24 None admin] PATH_INFO: `/v3/projects` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:41.642179 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39784a82-2ae3-4b76-9766-f5bc4be0ce24 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:42:41.642667 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39784a82-2ae3-4b76-9766-f5bc4be0ce24 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:41.644888 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39784a82-2ae3-4b76-9766-f5bc4be0ce24 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:41.648447 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcc9651-8c66-4bd8-9ae9-12500900e4aa None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:41.650015 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcc9651-8c66-4bd8-9ae9-12500900e4aa None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:41.659579 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 292/602] 10.222.0.15 () {56 vars in 1148 bytes} [Sun Oct 9 00:42:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:42:41.660764 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39784a82-2ae3-4b76-9766-f5bc4be0ce24 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:41.666228 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application [None req-6bcc9651-8c66-4bd8-9ae9-12500900e4aa None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 09 00:42:41.666228 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:42:41.666228 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:42:41.666228 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:42:41.666228 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:42:41.666228 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:42:41.666228 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:42:41.666228 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:42:41.666228 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:42:41.666228 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:42:41.666228 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:42:41.666228 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:42:41.666228 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 09 00:42:41.666228 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 09 00:42:41.666228 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 09 00:42:41.667143 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 09 00:42:41.667143 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:42:41.667143 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:42:41.667143 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:42:41.667143 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:42:41.667143 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:42:41.667143 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:42:41.667143 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:42:41.667143 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application with Lock( Oct 09 00:42:41.667143 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:42:41.667143 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:42:41.667143 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:42:41.667143 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:42:41.667143 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:42:41.667143 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:42:41.667143 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:42:41.667143 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:42:41.668337 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 09 00:42:41.668337 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 09 00:42:41.668337 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 09 00:42:41.668337 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 09 00:42:41.668337 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 09 00:42:41.668337 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 09 00:42:41.668337 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 09 00:42:41.668337 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Oct 09 00:42:41.672055 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 311/603] 10.222.0.15 () {56 vars in 1111 bytes} [Sun Oct 9 00:42:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:42:41.674072 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7b6833-60b3-430a-ac6e-a5820191a8b7 None None] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:41.674931 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7b6833-60b3-430a-ac6e-a5820191a8b7 None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:41.675685 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7b6833-60b3-430a-ac6e-a5820191a8b7 None None] PATH_INFO: `/` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:41.681698 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 312/604] 10.222.0.15 () {54 vars in 927 bytes} [Sun Oct 9 00:42:41 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:42:41.682123 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7b6833-60b3-430a-ac6e-a5820191a8b7 None None] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:41.774138 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39784a82-2ae3-4b76-9766-f5bc4be0ce24 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:41.787233 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:41.794712 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7b6833-60b3-430a-ac6e-a5820191a8b7 None None] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:41.811054 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc703af6-9dc7-4917-b816-1b75824a4445 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:41.811753 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc703af6-9dc7-4917-b816-1b75824a4445 None admin] REQUEST_METHOD: `PUT` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:41.812034 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc703af6-9dc7-4917-b816-1b75824a4445 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:41.812308 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc703af6-9dc7-4917-b816-1b75824a4445 None admin] PATH_INFO: `/v3/projects/f148d39ced534860abfbe8fc3f98ace4/users/4ac83d57fba841e0a666710732249c49/roles/6fe3faf520bd402f9bd78d3ed08eec34` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:41.828079 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc703af6-9dc7-4917-b816-1b75824a4445 None admin] RBAC: Authorizing `identity:create_grant(project_id=f148d39ced534860abfbe8fc3f98ace4, user_id=4ac83d57fba841e0a666710732249c49, role_id=6fe3faf520bd402f9bd78d3ed08eec34)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:41.828278 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f2221f-e845-42e0-952e-6a367859fda7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:41.828980 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f2221f-e845-42e0-952e-6a367859fda7 None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:41.829346 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f2221f-e845-42e0-952e-6a367859fda7 None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:41.829528 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc703af6-9dc7-4917-b816-1b75824a4445 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:41.829789 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f2221f-e845-42e0-952e-6a367859fda7 None admin] PATH_INFO: `/v3/projects` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:41.830622 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f2221f-e845-42e0-952e-6a367859fda7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:42:41.831016 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f2221f-e845-42e0-952e-6a367859fda7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:41.832870 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f2221f-e845-42e0-952e-6a367859fda7 None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:41.845449 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 313/605] 10.222.0.15 () {56 vars in 1148 bytes} [Sun Oct 9 00:42:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:42:41.846573 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f2221f-e845-42e0-952e-6a367859fda7 None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:41.855355 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 293/606] 10.222.0.15 () {58 vars in 1439 bytes} [Sun Oct 9 00:42:41 2022] PUT /identity/v3/projects/f148d39ced534860abfbe8fc3f98ace4/users/4ac83d57fba841e0a666710732249c49/roles/6fe3faf520bd402f9bd78d3ed08eec34 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 00:42:41.856911 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca11ad7-0356-4101-9622-5f4f3a88d49b None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:41.857195 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca11ad7-0356-4101-9622-5f4f3a88d49b None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:41.857466 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca11ad7-0356-4101-9622-5f4f3a88d49b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:41.890757 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:41.901529 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-4ca11ad7-0356-4101-9622-5f4f3a88d49b None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:42:41.904030 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-4ca11ad7-0356-4101-9622-5f4f3a88d49b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:42:41.966139 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f2221f-e845-42e0-952e-6a367859fda7 None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:42.007444 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 294/607] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Oct 9 00:42:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 09 00:42:42.007444 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca11ad7-0356-4101-9622-5f4f3a88d49b None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:42.016987 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4acc75-efbf-4c12-82df-23921ef1ffac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:42.017789 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4acc75-efbf-4c12-82df-23921ef1ffac None admin] REQUEST_METHOD: `PUT` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:42.018070 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4acc75-efbf-4c12-82df-23921ef1ffac None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:42.018346 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4acc75-efbf-4c12-82df-23921ef1ffac None admin] PATH_INFO: `/v3/projects/f148d39ced534860abfbe8fc3f98ace4/users/ff7cb78bcd91467abe5c2e2b48aedd1b/roles/6fe3faf520bd402f9bd78d3ed08eec34` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:42.048202 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4acc75-efbf-4c12-82df-23921ef1ffac None admin] RBAC: Authorizing `identity:create_grant(project_id=f148d39ced534860abfbe8fc3f98ace4, user_id=ff7cb78bcd91467abe5c2e2b48aedd1b, role_id=6fe3faf520bd402f9bd78d3ed08eec34)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:42.049661 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4acc75-efbf-4c12-82df-23921ef1ffac None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:42.070663 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 314/608] 10.222.0.15 () {58 vars in 1439 bytes} [Sun Oct 9 00:42:41 2022] PUT /identity/v3/projects/f148d39ced534860abfbe8fc3f98ace4/users/ff7cb78bcd91467abe5c2e2b48aedd1b/roles/6fe3faf520bd402f9bd78d3ed08eec34 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 00:42:42.154332 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca11ad7-0356-4101-9622-5f4f3a88d49b None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:42.193547 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dca628-54a5-4d88-9aef-b0429c4d5413 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:42.194220 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dca628-54a5-4d88-9aef-b0429c4d5413 None admin] REQUEST_METHOD: `PUT` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:42.194494 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dca628-54a5-4d88-9aef-b0429c4d5413 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:42.194766 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dca628-54a5-4d88-9aef-b0429c4d5413 None admin] PATH_INFO: `/v3/projects/f148d39ced534860abfbe8fc3f98ace4/users/f4ef90d456d2483e8ddafbe2d4d4fb5e/roles/6fe3faf520bd402f9bd78d3ed08eec34` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:42.198664 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:42.213119 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05dca628-54a5-4d88-9aef-b0429c4d5413 None admin] RBAC: Authorizing `identity:create_grant(project_id=f148d39ced534860abfbe8fc3f98ace4, user_id=f4ef90d456d2483e8ddafbe2d4d4fb5e, role_id=6fe3faf520bd402f9bd78d3ed08eec34)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:42.214577 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05dca628-54a5-4d88-9aef-b0429c4d5413 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:42.234359 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 295/609] 10.222.0.15 () {58 vars in 1439 bytes} [Sun Oct 9 00:42:42 2022] PUT /identity/v3/projects/f148d39ced534860abfbe8fc3f98ace4/users/f4ef90d456d2483e8ddafbe2d4d4fb5e/roles/6fe3faf520bd402f9bd78d3ed08eec34 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 00:42:42.312616 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4acc75-efbf-4c12-82df-23921ef1ffac None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:42.322857 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:42.441213 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4acc75-efbf-4c12-82df-23921ef1ffac None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:42.482002 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be439e7-b382-4e8e-85df-83c42d997200 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:42.482958 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be439e7-b382-4e8e-85df-83c42d997200 None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:42.483566 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be439e7-b382-4e8e-85df-83c42d997200 None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:42.483973 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be439e7-b382-4e8e-85df-83c42d997200 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:42.496603 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be439e7-b382-4e8e-85df-83c42d997200 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 09 00:42:42.502711 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application [None req-7be439e7-b382-4e8e-85df-83c42d997200 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 09 00:42:42.502711 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:42:42.502711 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:42:42.502711 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:42:42.502711 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:42:42.502711 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:42:42.502711 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:42:42.502711 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:42:42.502711 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:42:42.502711 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:42:42.502711 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:42:42.502711 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:42:42.502711 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 09 00:42:42.502711 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 09 00:42:42.502711 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 09 00:42:42.502711 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 09 00:42:42.503901 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 09 00:42:42.503901 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 09 00:42:42.503901 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 09 00:42:42.503901 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 09 00:42:42.503901 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:42:42.503901 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:42:42.503901 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:42:42.503901 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:42:42.503901 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:42:42.503901 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:42:42.503901 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:42:42.503901 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application with Lock( Oct 09 00:42:42.503901 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:42:42.503901 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:42:42.503901 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:42:42.503901 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:42:42.504922 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:42:42.504922 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:42:42.504922 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:42:42.504922 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:42:42.504922 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 09 00:42:42.504922 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 09 00:42:42.504922 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 09 00:42:42.504922 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 09 00:42:42.504922 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 09 00:42:42.504922 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 09 00:42:42.504922 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 09 00:42:42.504922 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Oct 09 00:42:42.508883 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 315/610] 10.222.0.15 () {56 vars in 1102 bytes} [Sun Oct 9 00:42:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:42:42.514822 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dca628-54a5-4d88-9aef-b0429c4d5413 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:42.517375 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ee9071-4112-4f0e-b5eb-d8f25baa6be8 None None] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:42.517791 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ee9071-4112-4f0e-b5eb-d8f25baa6be8 None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:42.518411 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ee9071-4112-4f0e-b5eb-d8f25baa6be8 None None] PATH_INFO: `/` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:42.521233 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 316/611] 10.222.0.15 () {54 vars in 927 bytes} [Sun Oct 9 00:42:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:42:42.525488 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b82a49e-74b1-4f86-bc8d-218711596ccb None None] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:42.525927 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b82a49e-74b1-4f86-bc8d-218711596ccb None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:42.526967 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b82a49e-74b1-4f86-bc8d-218711596ccb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:42.554035 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.auth.core [None req-2b82a49e-74b1-4f86-bc8d-218711596ccb None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:42:42.556380 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-2b82a49e-74b1-4f86-bc8d-218711596ccb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:42:42.633216 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dca628-54a5-4d88-9aef-b0429c4d5413 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:42.638668 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:42.654043 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 317/612] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Oct 9 00:42:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 09 00:42:42.683083 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6470135b-3931-4413-a3e7-7e98876842e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:42.683779 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6470135b-3931-4413-a3e7-7e98876842e8 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:42.684056 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6470135b-3931-4413-a3e7-7e98876842e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:42.684329 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6470135b-3931-4413-a3e7-7e98876842e8 None admin] PATH_INFO: `/v3/roles` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:42.685063 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6470135b-3931-4413-a3e7-7e98876842e8 None admin] RBAC: Adding query filter params (name=service) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:42:42.685362 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6470135b-3931-4413-a3e7-7e98876842e8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:42.686840 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6470135b-3931-4413-a3e7-7e98876842e8 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:42.699124 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 296/613] 10.222.0.15 () {56 vars in 1103 bytes} [Sun Oct 9 00:42:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 09 00:42:42.704686 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b82a49e-74b1-4f86-bc8d-218711596ccb None None] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:42.822873 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b82a49e-74b1-4f86-bc8d-218711596ccb None None] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:42.863470 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3685f497-16d3-40e2-8979-86102a2a03ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:42.864389 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3685f497-16d3-40e2-8979-86102a2a03ae None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:42.864811 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3685f497-16d3-40e2-8979-86102a2a03ae None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:42.865223 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3685f497-16d3-40e2-8979-86102a2a03ae None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:42.876031 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3685f497-16d3-40e2-8979-86102a2a03ae None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:42.877661 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3685f497-16d3-40e2-8979-86102a2a03ae None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:42.894415 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application [None req-3685f497-16d3-40e2-8979-86102a2a03ae None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:42:42.894415 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:42:42.894415 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:42:42.894415 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:42:42.894415 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:42:42.894415 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:42:42.894415 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:42:42.894415 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:42:42.894415 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:42:42.894415 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:42:42.894415 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:42:42.894415 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:42:42.894415 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 09 00:42:42.894415 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 09 00:42:42.894415 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 09 00:42:42.894415 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 09 00:42:42.895603 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:42:42.895603 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:42:42.895603 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:42:42.895603 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:42:42.895603 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:42:42.895603 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:42:42.895603 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:42:42.895603 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application with Lock( Oct 09 00:42:42.895603 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:42:42.895603 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:42:42.895603 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:42:42.895603 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:42:42.895603 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:42:42.895603 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:42:42.895603 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:42:42.895603 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:42:42.895603 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 09 00:42:42.896694 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 09 00:42:42.896694 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:42:42.896694 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Oct 09 00:42:42.898383 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 318/614] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Oct 9 00:42:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:42:42.903995 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6470135b-3931-4413-a3e7-7e98876842e8 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:42.979587 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:43.041191 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6470135b-3931-4413-a3e7-7e98876842e8 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:43.079167 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6f95f3-54e0-46fc-8b47-6ce8707b01f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:43.079809 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6f95f3-54e0-46fc-8b47-6ce8707b01f2 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:43.080079 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6f95f3-54e0-46fc-8b47-6ce8707b01f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:43.080346 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6f95f3-54e0-46fc-8b47-6ce8707b01f2 None admin] PATH_INFO: `/v3/domains` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:43.081006 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6f95f3-54e0-46fc-8b47-6ce8707b01f2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:42:43.081307 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6f95f3-54e0-46fc-8b47-6ce8707b01f2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:43.082679 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6f95f3-54e0-46fc-8b47-6ce8707b01f2 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:43.101922 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 297/615] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Oct 9 00:42:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:42:43.108334 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3685f497-16d3-40e2-8979-86102a2a03ae None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:43.126752 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6f95f3-54e0-46fc-8b47-6ce8707b01f2 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:43.192809 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:43.262806 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3685f497-16d3-40e2-8979-86102a2a03ae None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:43.317568 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6f95f3-54e0-46fc-8b47-6ce8707b01f2 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:43.329721 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:43.359416 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae2dee9-1955-4b4c-908b-ebd3d4cd565d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:43.360004 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1116f6d7-5ca4-48ea-ad5f-9f6d3cbb1efc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:43.360669 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1116f6d7-5ca4-48ea-ad5f-9f6d3cbb1efc None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:43.360943 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1116f6d7-5ca4-48ea-ad5f-9f6d3cbb1efc None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:43.361172 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae2dee9-1955-4b4c-908b-ebd3d4cd565d None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:43.361288 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1116f6d7-5ca4-48ea-ad5f-9f6d3cbb1efc None admin] PATH_INFO: `/v3/users/swift` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:43.361873 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae2dee9-1955-4b4c-908b-ebd3d4cd565d None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:43.362406 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae2dee9-1955-4b4c-908b-ebd3d4cd565d None admin] PATH_INFO: `/v3/roles/service` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:43.374613 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae2dee9-1955-4b4c-908b-ebd3d4cd565d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 09 00:42:43.380065 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application [None req-bae2dee9-1955-4b4c-908b-ebd3d4cd565d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 09 00:42:43.380065 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:42:43.380065 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:42:43.380065 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:42:43.380065 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:42:43.380065 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:42:43.380065 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:42:43.380065 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:42:43.380065 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:42:43.380065 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:42:43.380065 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:42:43.380065 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:42:43.380065 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 09 00:42:43.380065 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 09 00:42:43.380065 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 09 00:42:43.380065 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 09 00:42:43.381061 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 09 00:42:43.381061 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 09 00:42:43.381061 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 09 00:42:43.381061 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 09 00:42:43.381061 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:42:43.381061 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:42:43.381061 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:42:43.381061 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:42:43.381061 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:42:43.381061 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:42:43.381061 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:42:43.381061 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application with Lock( Oct 09 00:42:43.381061 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:42:43.381061 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:42:43.381061 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:42:43.381061 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:42:43.381884 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:42:43.381884 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:42:43.381884 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:42:43.381884 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:42:43.381884 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 09 00:42:43.381884 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 09 00:42:43.381884 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 09 00:42:43.381884 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 09 00:42:43.381884 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 09 00:42:43.381884 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 09 00:42:43.381884 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 09 00:42:43.381884 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application Oct 09 00:42:43.382517 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1116f6d7-5ca4-48ea-ad5f-9f6d3cbb1efc None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:43.382517 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1116f6d7-5ca4-48ea-ad5f-9f6d3cbb1efc None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:43.385004 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 298/616] 10.222.0.15 () {56 vars in 1102 bytes} [Sun Oct 9 00:42:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:42:43.391171 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae2dee9-1955-4b4c-908b-ebd3d4cd565d None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:43.417402 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application [None req-1116f6d7-5ca4-48ea-ad5f-9f6d3cbb1efc None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 09 00:42:43.417402 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:42:43.417402 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:42:43.417402 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:42:43.417402 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:42:43.417402 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:42:43.417402 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:42:43.417402 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:42:43.417402 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:42:43.417402 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:42:43.417402 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:42:43.417402 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:42:43.417402 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 09 00:42:43.417402 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 09 00:42:43.417402 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 09 00:42:43.417402 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 09 00:42:43.418425 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:42:43.418425 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:42:43.418425 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 09 00:42:43.418425 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 09 00:42:43.418425 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 09 00:42:43.418425 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 09 00:42:43.418425 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:42:43.418425 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:42:43.418425 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:42:43.418425 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:42:43.418425 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:42:43.418425 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application with Lock( Oct 09 00:42:43.418425 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:42:43.418425 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:42:43.418425 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:42:43.418425 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:42:43.418425 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:42:43.418425 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:42:43.419403 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:42:43.419403 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:42:43.419403 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 09 00:42:43.419403 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 09 00:42:43.419403 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 09 00:42:43.419403 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 09 00:42:43.419403 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 09 00:42:43.419403 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 09 00:42:43.419403 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 09 00:42:43.419403 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Oct 09 00:42:43.419403 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 319/617] 10.222.0.15 () {56 vars in 1096 bytes} [Sun Oct 9 00:42:43 2022] GET /identity/v3/users/swift => generated 83 bytes in 311 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:42:43.424600 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1116f6d7-5ca4-48ea-ad5f-9f6d3cbb1efc None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:43.587433 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae2dee9-1955-4b4c-908b-ebd3d4cd565d None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:43.625435 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1116f6d7-5ca4-48ea-ad5f-9f6d3cbb1efc None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:43.636911 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:43.672163 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af91fe40-a4a8-4dd1-85f1-7e228901f775 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:43.674142 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af91fe40-a4a8-4dd1-85f1-7e228901f775 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:43.675513 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af91fe40-a4a8-4dd1-85f1-7e228901f775 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:43.676020 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af91fe40-a4a8-4dd1-85f1-7e228901f775 None admin] PATH_INFO: `/v3/roles` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:43.676836 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1db13a-ed22-4d2f-8f9f-1354bcb4febf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:43.678118 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af91fe40-a4a8-4dd1-85f1-7e228901f775 None admin] RBAC: Adding query filter params (name=service) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:42:43.678952 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1db13a-ed22-4d2f-8f9f-1354bcb4febf None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:43.679490 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af91fe40-a4a8-4dd1-85f1-7e228901f775 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:43.680048 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1db13a-ed22-4d2f-8f9f-1354bcb4febf None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:43.681675 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af91fe40-a4a8-4dd1-85f1-7e228901f775 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:43.682147 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1db13a-ed22-4d2f-8f9f-1354bcb4febf None admin] PATH_INFO: `/v3/users` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:43.683157 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1db13a-ed22-4d2f-8f9f-1354bcb4febf None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:42:43.683682 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1db13a-ed22-4d2f-8f9f-1354bcb4febf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:43.687057 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1db13a-ed22-4d2f-8f9f-1354bcb4febf None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:43.702897 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 299/618] 10.222.0.15 () {56 vars in 1103 bytes} [Sun Oct 9 00:42:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 09 00:42:43.713279 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af91fe40-a4a8-4dd1-85f1-7e228901f775 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:43.730328 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 320/619] 10.222.0.15 () {56 vars in 1135 bytes} [Sun Oct 9 00:42:43 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 09 00:42:43.736254 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1db13a-ed22-4d2f-8f9f-1354bcb4febf None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:43.771616 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:43.874646 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1db13a-ed22-4d2f-8f9f-1354bcb4febf None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:43.928158 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959cb89e-2bdb-4bc1-9b56-0223eead1df8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:43.928822 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959cb89e-2bdb-4bc1-9b56-0223eead1df8 None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:43.929097 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959cb89e-2bdb-4bc1-9b56-0223eead1df8 None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:43.929514 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959cb89e-2bdb-4bc1-9b56-0223eead1df8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:43.941616 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959cb89e-2bdb-4bc1-9b56-0223eead1df8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:43.943125 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959cb89e-2bdb-4bc1-9b56-0223eead1df8 None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:43.960698 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application [None req-959cb89e-2bdb-4bc1-9b56-0223eead1df8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:42:43.960698 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:42:43.960698 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:42:43.960698 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:42:43.960698 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:42:43.960698 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:42:43.960698 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:42:43.960698 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:42:43.960698 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:42:43.960698 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:42:43.960698 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:42:43.960698 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:42:43.960698 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 09 00:42:43.960698 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 09 00:42:43.960698 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 09 00:42:43.960698 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 09 00:42:43.961853 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:42:43.961853 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:42:43.961853 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:42:43.961853 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:42:43.961853 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:42:43.961853 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:42:43.961853 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:42:43.961853 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application with Lock( Oct 09 00:42:43.961853 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:42:43.961853 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:42:43.961853 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:42:43.961853 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:42:43.961853 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:42:43.961853 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:42:43.961853 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:42:43.961853 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:42:43.961853 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 09 00:42:43.962729 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 09 00:42:43.962729 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:42:43.962729 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Oct 09 00:42:43.962729 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 321/620] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Oct 9 00:42:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 09 00:42:43.963239 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af91fe40-a4a8-4dd1-85f1-7e228901f775 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:43.970750 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959cb89e-2bdb-4bc1-9b56-0223eead1df8 None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:43.994900 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:44.040767 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a2ff4f-20b8-4530-bad9-9c830760a138 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:44.041898 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a2ff4f-20b8-4530-bad9-9c830760a138 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:44.044373 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a2ff4f-20b8-4530-bad9-9c830760a138 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:44.044853 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a2ff4f-20b8-4530-bad9-9c830760a138 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:44.076462 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a2ff4f-20b8-4530-bad9-9c830760a138 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:44.077924 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a2ff4f-20b8-4530-bad9-9c830760a138 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:44.103396 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959cb89e-2bdb-4bc1-9b56-0223eead1df8 None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:44.117025 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application [None req-f6a2ff4f-20b8-4530-bad9-9c830760a138 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:42:44.117025 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:42:44.117025 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:42:44.117025 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:42:44.117025 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:42:44.117025 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:42:44.117025 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:42:44.117025 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:42:44.117025 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:42:44.117025 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:42:44.117025 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:42:44.117025 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:42:44.117025 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 09 00:42:44.117025 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 09 00:42:44.117025 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 09 00:42:44.117025 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 09 00:42:44.118353 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:42:44.118353 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:42:44.118353 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:42:44.118353 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:42:44.118353 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:42:44.118353 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:42:44.118353 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:42:44.118353 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application with Lock( Oct 09 00:42:44.118353 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:42:44.118353 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:42:44.118353 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:42:44.118353 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:42:44.118353 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:42:44.118353 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:42:44.118353 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:42:44.118353 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:42:44.118353 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 09 00:42:44.119449 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 09 00:42:44.119449 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:42:44.119449 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application Oct 09 00:42:44.119449 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 300/621] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Oct 9 00:42:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 406 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 09 00:42:44.128707 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a2ff4f-20b8-4530-bad9-9c830760a138 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:44.173567 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f28cb6-2dc7-4b7a-931c-6e863436c441 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:44.174349 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f28cb6-2dc7-4b7a-931c-6e863436c441 None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:44.175531 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f28cb6-2dc7-4b7a-931c-6e863436c441 None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:44.175945 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f28cb6-2dc7-4b7a-931c-6e863436c441 None admin] PATH_INFO: `/v3/domains` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:44.176701 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f28cb6-2dc7-4b7a-931c-6e863436c441 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:42:44.177788 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f28cb6-2dc7-4b7a-931c-6e863436c441 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:44.179455 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f28cb6-2dc7-4b7a-931c-6e863436c441 None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:44.193307 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 322/622] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Oct 9 00:42:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:42:44.198940 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f28cb6-2dc7-4b7a-931c-6e863436c441 None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:44.307412 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:44.329744 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a2ff4f-20b8-4530-bad9-9c830760a138 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:44.367121 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:44.369575 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400db559-20d6-4687-a9ae-7ec03ef9cf81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:44.371337 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400db559-20d6-4687-a9ae-7ec03ef9cf81 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:44.371725 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400db559-20d6-4687-a9ae-7ec03ef9cf81 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:44.373178 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400db559-20d6-4687-a9ae-7ec03ef9cf81 None admin] PATH_INFO: `/v3/domains` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:44.374281 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400db559-20d6-4687-a9ae-7ec03ef9cf81 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:42:44.374724 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400db559-20d6-4687-a9ae-7ec03ef9cf81 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:44.378430 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400db559-20d6-4687-a9ae-7ec03ef9cf81 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:44.404984 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 301/623] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Oct 9 00:42:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 09 00:42:44.409203 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400db559-20d6-4687-a9ae-7ec03ef9cf81 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:44.413021 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f28cb6-2dc7-4b7a-931c-6e863436c441 None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:44.486835 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eacc0cc-924d-4e71-8158-ecfb4d7a5b68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:44.487511 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eacc0cc-924d-4e71-8158-ecfb4d7a5b68 None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:44.487783 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eacc0cc-924d-4e71-8158-ecfb4d7a5b68 None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:44.488050 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eacc0cc-924d-4e71-8158-ecfb4d7a5b68 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:44.508674 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eacc0cc-924d-4e71-8158-ecfb4d7a5b68 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:44.510477 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eacc0cc-924d-4e71-8158-ecfb4d7a5b68 None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:44.541167 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application [None req-3eacc0cc-924d-4e71-8158-ecfb4d7a5b68 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 09 00:42:44.541167 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:42:44.541167 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:42:44.541167 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:42:44.541167 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:42:44.541167 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:42:44.541167 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:42:44.541167 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:42:44.541167 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:42:44.541167 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:42:44.541167 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:42:44.541167 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:42:44.541167 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 09 00:42:44.541167 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 09 00:42:44.541167 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 09 00:42:44.542245 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 09 00:42:44.542245 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:42:44.542245 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:42:44.542245 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:42:44.542245 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:42:44.542245 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:42:44.542245 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:42:44.542245 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:42:44.542245 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application with Lock( Oct 09 00:42:44.542245 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:42:44.542245 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:42:44.542245 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:42:44.542245 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:42:44.542245 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:42:44.542245 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:42:44.542245 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:42:44.542245 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:42:44.543128 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 09 00:42:44.543128 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 09 00:42:44.543128 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 09 00:42:44.543128 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 09 00:42:44.543128 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 09 00:42:44.543128 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 09 00:42:44.543128 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 09 00:42:44.543128 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Oct 09 00:42:44.550310 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 323/624] 10.222.0.15 () {56 vars in 1111 bytes} [Sun Oct 9 00:42:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 352 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:42:44.556637 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eacc0cc-924d-4e71-8158-ecfb4d7a5b68 None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:44.565146 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400db559-20d6-4687-a9ae-7ec03ef9cf81 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:44.601865 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abe972a-605f-474a-b481-f90ce5b58062 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:44.602726 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abe972a-605f-474a-b481-f90ce5b58062 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:44.603146 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abe972a-605f-474a-b481-f90ce5b58062 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:44.603573 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abe972a-605f-474a-b481-f90ce5b58062 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:44.612915 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abe972a-605f-474a-b481-f90ce5b58062 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:44.615064 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abe972a-605f-474a-b481-f90ce5b58062 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:44.636389 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application [None req-8abe972a-605f-474a-b481-f90ce5b58062 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Oct 09 00:42:44.636389 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:42:44.636389 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:42:44.636389 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:42:44.636389 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:42:44.636389 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:42:44.636389 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:42:44.636389 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:42:44.636389 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:42:44.636389 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:42:44.636389 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:42:44.636389 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:42:44.636389 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 09 00:42:44.636389 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 09 00:42:44.636389 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 09 00:42:44.636389 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 09 00:42:44.637438 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:42:44.637438 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:42:44.637438 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 09 00:42:44.637438 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 09 00:42:44.637438 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 09 00:42:44.637438 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 09 00:42:44.637438 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:42:44.637438 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:42:44.637438 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:42:44.637438 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:42:44.637438 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:42:44.637438 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application with Lock( Oct 09 00:42:44.637438 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:42:44.637438 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:42:44.637438 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:42:44.637438 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:42:44.637438 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:42:44.637438 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:42:44.638556 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:42:44.638556 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:42:44.638556 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 09 00:42:44.638556 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 09 00:42:44.638556 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 09 00:42:44.638556 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 09 00:42:44.638556 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 09 00:42:44.638556 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 09 00:42:44.638556 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Oct 09 00:42:44.638556 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application Oct 09 00:42:44.638556 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 302/625] 10.222.0.15 () {56 vars in 1099 bytes} [Sun Oct 9 00:42:44 2022] GET /identity/v3/users/glance => generated 84 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:42:44.639535 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ce58fb-7d7a-4831-888d-486aea9b1718 None None] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:44.640065 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ce58fb-7d7a-4831-888d-486aea9b1718 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:44.640484 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ce58fb-7d7a-4831-888d-486aea9b1718 None None] PATH_INFO: `/` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:44.642381 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 303/626] 10.222.0.15 () {54 vars in 927 bytes} [Sun Oct 9 00:42:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:42:44.646676 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ce58fb-7d7a-4831-888d-486aea9b1718 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:44.651656 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:44.731553 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eacc0cc-924d-4e71-8158-ecfb4d7a5b68 None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:44.781504 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8ef617-f5cc-4ae6-a75e-0ee8dd29eff8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:44.782118 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8ef617-f5cc-4ae6-a75e-0ee8dd29eff8 None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:44.782402 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8ef617-f5cc-4ae6-a75e-0ee8dd29eff8 None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:44.782659 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8ef617-f5cc-4ae6-a75e-0ee8dd29eff8 None admin] PATH_INFO: `/v3/projects` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:44.783390 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8ef617-f5cc-4ae6-a75e-0ee8dd29eff8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:42:44.783687 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8ef617-f5cc-4ae6-a75e-0ee8dd29eff8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:44.785066 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ce58fb-7d7a-4831-888d-486aea9b1718 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:44.785186 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8ef617-f5cc-4ae6-a75e-0ee8dd29eff8 None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:44.793557 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:44.799804 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 324/627] 10.222.0.15 () {56 vars in 1148 bytes} [Sun Oct 9 00:42:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:42:44.801069 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2946ca52-b69e-455a-b189-ce19dbd91b01 None None] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:44.801346 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2946ca52-b69e-455a-b189-ce19dbd91b01 None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:44.801611 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2946ca52-b69e-455a-b189-ce19dbd91b01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:44.824586 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.auth.core [None req-2946ca52-b69e-455a-b189-ce19dbd91b01 None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:42:44.825712 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-2946ca52-b69e-455a-b189-ce19dbd91b01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:42:44.839976 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c849e853-1870-43f5-a56d-4ad9cddc44ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:44.843313 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c849e853-1870-43f5-a56d-4ad9cddc44ec None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:44.843313 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c849e853-1870-43f5-a56d-4ad9cddc44ec None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:44.843313 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c849e853-1870-43f5-a56d-4ad9cddc44ec None admin] PATH_INFO: `/v3/users` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:44.843313 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c849e853-1870-43f5-a56d-4ad9cddc44ec None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:42:44.843313 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c849e853-1870-43f5-a56d-4ad9cddc44ec None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:44.844950 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c849e853-1870-43f5-a56d-4ad9cddc44ec None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:44.864109 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 304/628] 10.222.0.15 () {56 vars in 1137 bytes} [Sun Oct 9 00:42:44 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 09 00:42:44.865474 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d41437-cc2c-4457-9dcb-7b7a58d611ad None None] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:44.865752 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d41437-cc2c-4457-9dcb-7b7a58d611ad None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:44.866017 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d41437-cc2c-4457-9dcb-7b7a58d611ad None None] PATH_INFO: `/` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:44.867215 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 305/629] 10.222.0.15 () {54 vars in 927 bytes} [Sun Oct 9 00:42:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:42:44.867963 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d41437-cc2c-4457-9dcb-7b7a58d611ad None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:44.915216 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 325/630] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Oct 9 00:42:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 09 00:42:44.916552 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a5081b-2eef-400b-9ee7-fdd45ecffb6d None None] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:44.917044 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a5081b-2eef-400b-9ee7-fdd45ecffb6d None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:44.917044 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a5081b-2eef-400b-9ee7-fdd45ecffb6d None None] PATH_INFO: `/` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:44.918477 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 326/631] 10.222.0.15 () {54 vars in 927 bytes} [Sun Oct 9 00:42:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:42:44.922853 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a5081b-2eef-400b-9ee7-fdd45ecffb6d None None] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:44.941334 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:44.988394 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d41437-cc2c-4457-9dcb-7b7a58d611ad None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:45.026587 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873887fc-07a6-4d8f-96b1-e89f4776775b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:45.027366 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873887fc-07a6-4d8f-96b1-e89f4776775b None admin] REQUEST_METHOD: `PUT` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:45.027644 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873887fc-07a6-4d8f-96b1-e89f4776775b None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:45.027915 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873887fc-07a6-4d8f-96b1-e89f4776775b None admin] PATH_INFO: `/v3/projects/f148d39ced534860abfbe8fc3f98ace4/users/c4c467943b8f4d31a2f067ca6ed3b25c/roles/6fe3faf520bd402f9bd78d3ed08eec34` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:45.047806 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873887fc-07a6-4d8f-96b1-e89f4776775b None admin] RBAC: Authorizing `identity:create_grant(project_id=f148d39ced534860abfbe8fc3f98ace4, user_id=c4c467943b8f4d31a2f067ca6ed3b25c, role_id=6fe3faf520bd402f9bd78d3ed08eec34)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:45.051503 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873887fc-07a6-4d8f-96b1-e89f4776775b None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:45.065187 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 306/632] 10.222.0.15 () {58 vars in 1439 bytes} [Sun Oct 9 00:42:44 2022] PUT /identity/v3/projects/f148d39ced534860abfbe8fc3f98ace4/users/c4c467943b8f4d31a2f067ca6ed3b25c/roles/6fe3faf520bd402f9bd78d3ed08eec34 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 00:42:45.065836 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a5081b-2eef-400b-9ee7-fdd45ecffb6d None None] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:45.066828 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f218aa-0640-4bac-b508-d54f2a48e494 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:45.067232 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f218aa-0640-4bac-b508-d54f2a48e494 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:45.067648 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f218aa-0640-4bac-b508-d54f2a48e494 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:45.090131 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-00f218aa-0640-4bac-b508-d54f2a48e494 None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:42:45.091940 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-00f218aa-0640-4bac-b508-d54f2a48e494 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:42:45.109754 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:45.121949 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28830c35-8121-4fb3-b8b8-fd6b48aebaf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:45.122756 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28830c35-8121-4fb3-b8b8-fd6b48aebaf6 None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:45.123925 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28830c35-8121-4fb3-b8b8-fd6b48aebaf6 None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:45.124087 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28830c35-8121-4fb3-b8b8-fd6b48aebaf6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:45.181195 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 307/633] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Oct 9 00:42:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 09 00:42:45.182748 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e330ff6-25de-43a1-be73-7512d084539d None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:45.183140 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e330ff6-25de-43a1-be73-7512d084539d None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:45.183564 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e330ff6-25de-43a1-be73-7512d084539d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:45.203800 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-2e330ff6-25de-43a1-be73-7512d084539d None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:42:45.205184 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-2e330ff6-25de-43a1-be73-7512d084539d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:42:45.222437 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28830c35-8121-4fb3-b8b8-fd6b48aebaf6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:45.224966 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28830c35-8121-4fb3-b8b8-fd6b48aebaf6 None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:45.253093 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:45.301608 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 308/634] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Oct 9 00:42:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 09 00:42:45.302715 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e330ff6-25de-43a1-be73-7512d084539d None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:45.370387 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 327/635] 10.222.0.15 () {58 vars in 1282 bytes} [Sun Oct 9 00:42:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 451 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 09 00:42:45.376405 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28830c35-8121-4fb3-b8b8-fd6b48aebaf6 None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:45.418294 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:45.466137 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e330ff6-25de-43a1-be73-7512d084539d None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:45.517173 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28830c35-8121-4fb3-b8b8-fd6b48aebaf6 None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:45.517808 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3778b9-9b41-4f48-8b96-1402ea736148 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:45.518681 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3778b9-9b41-4f48-8b96-1402ea736148 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:45.519156 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3778b9-9b41-4f48-8b96-1402ea736148 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:45.519661 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3778b9-9b41-4f48-8b96-1402ea736148 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:45.531928 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3778b9-9b41-4f48-8b96-1402ea736148 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 09 00:42:45.537432 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application [None req-ec3778b9-9b41-4f48-8b96-1402ea736148 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 09 00:42:45.537432 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:42:45.537432 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:42:45.537432 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:42:45.537432 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:42:45.537432 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:42:45.537432 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:42:45.537432 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:42:45.537432 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:42:45.537432 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:42:45.537432 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:42:45.537432 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:42:45.537432 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 09 00:42:45.537432 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 09 00:42:45.537432 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 09 00:42:45.537432 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 09 00:42:45.538391 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 09 00:42:45.538391 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 09 00:42:45.538391 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 09 00:42:45.538391 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 09 00:42:45.538391 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:42:45.538391 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:42:45.538391 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:42:45.538391 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:42:45.538391 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:42:45.538391 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:42:45.538391 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:42:45.538391 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application with Lock( Oct 09 00:42:45.538391 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:42:45.538391 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:42:45.538391 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:42:45.538391 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:42:45.539243 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:42:45.539243 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:42:45.539243 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:42:45.539243 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:42:45.539243 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 09 00:42:45.539243 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 09 00:42:45.539243 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 09 00:42:45.539243 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 09 00:42:45.539243 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 09 00:42:45.539243 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 09 00:42:45.539243 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 09 00:42:45.539243 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application Oct 09 00:42:45.542061 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 309/636] 10.222.0.15 () {56 vars in 1102 bytes} [Sun Oct 9 00:42:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:42:45.543177 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3778b9-9b41-4f48-8b96-1402ea736148 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:45.566443 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9ccee5-092d-4cb7-8a0d-f09851fe0a8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:45.567095 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9ccee5-092d-4cb7-8a0d-f09851fe0a8a None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:45.567468 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9ccee5-092d-4cb7-8a0d-f09851fe0a8a None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:45.567979 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9ccee5-092d-4cb7-8a0d-f09851fe0a8a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:45.581126 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9ccee5-092d-4cb7-8a0d-f09851fe0a8a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:45.582617 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9ccee5-092d-4cb7-8a0d-f09851fe0a8a None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:45.586730 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:45.598514 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application [None req-9b9ccee5-092d-4cb7-8a0d-f09851fe0a8a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:42:45.598514 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:42:45.598514 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:42:45.598514 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:42:45.598514 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:42:45.598514 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:42:45.598514 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:42:45.598514 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:42:45.598514 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:42:45.598514 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:42:45.598514 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:42:45.598514 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:42:45.598514 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 09 00:42:45.598514 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 09 00:42:45.598514 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 09 00:42:45.598514 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 09 00:42:45.600966 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:42:45.600966 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:42:45.600966 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:42:45.600966 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:42:45.600966 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:42:45.600966 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:42:45.600966 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:42:45.600966 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application with Lock( Oct 09 00:42:45.600966 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:42:45.600966 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:42:45.600966 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:42:45.600966 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:42:45.600966 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:42:45.600966 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:42:45.600966 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:42:45.600966 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:42:45.600966 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 09 00:42:45.601855 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 09 00:42:45.601855 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:42:45.601855 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Oct 09 00:42:45.601855 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 328/637] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Oct 9 00:42:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 09 00:42:45.601855 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9ccee5-092d-4cb7-8a0d-f09851fe0a8a None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:45.676772 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3778b9-9b41-4f48-8b96-1402ea736148 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:45.704665 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:45.717760 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3053d949-6f93-4cb0-be3f-e1042084dad8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:45.718677 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3053d949-6f93-4cb0-be3f-e1042084dad8 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:45.718956 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3053d949-6f93-4cb0-be3f-e1042084dad8 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:45.720039 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3053d949-6f93-4cb0-be3f-e1042084dad8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:45.727236 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9ccee5-092d-4cb7-8a0d-f09851fe0a8a None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:45.731859 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3053d949-6f93-4cb0-be3f-e1042084dad8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 09 00:42:45.737305 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application [None req-3053d949-6f93-4cb0-be3f-e1042084dad8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 09 00:42:45.737305 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:42:45.737305 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:42:45.737305 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:42:45.737305 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:42:45.737305 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:42:45.737305 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:42:45.737305 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:42:45.737305 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:42:45.737305 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:42:45.737305 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:42:45.737305 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:42:45.737305 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 09 00:42:45.737305 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 09 00:42:45.737305 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 09 00:42:45.737305 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 09 00:42:45.744579 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 09 00:42:45.744579 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 09 00:42:45.744579 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 09 00:42:45.744579 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 09 00:42:45.744579 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:42:45.744579 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:42:45.744579 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:42:45.744579 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:42:45.744579 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:42:45.744579 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:42:45.744579 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:42:45.744579 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application with Lock( Oct 09 00:42:45.744579 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:42:45.744579 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:42:45.744579 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:42:45.744579 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:42:45.746002 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:42:45.746002 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:42:45.746002 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:42:45.746002 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:42:45.746002 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 09 00:42:45.746002 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 09 00:42:45.746002 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 09 00:42:45.746002 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 09 00:42:45.746002 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 09 00:42:45.746002 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 09 00:42:45.746002 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 09 00:42:45.746002 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application Oct 09 00:42:45.746002 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 310/638] 10.222.0.15 () {56 vars in 1102 bytes} [Sun Oct 9 00:42:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:42:45.746002 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3053d949-6f93-4cb0-be3f-e1042084dad8 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:45.775148 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744b9e14-d9f7-4ca5-b0bb-090f701d0c62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:45.776420 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744b9e14-d9f7-4ca5-b0bb-090f701d0c62 None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:45.776697 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744b9e14-d9f7-4ca5-b0bb-090f701d0c62 None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:45.776971 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744b9e14-d9f7-4ca5-b0bb-090f701d0c62 None admin] PATH_INFO: `/v3/roles` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:45.777647 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744b9e14-d9f7-4ca5-b0bb-090f701d0c62 None admin] RBAC: Adding query filter params (name=service) {{(pid=81525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:42:45.777933 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744b9e14-d9f7-4ca5-b0bb-090f701d0c62 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:45.779814 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744b9e14-d9f7-4ca5-b0bb-090f701d0c62 None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:45.790723 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 329/639] 10.222.0.15 () {56 vars in 1103 bytes} [Sun Oct 9 00:42:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:42:45.791429 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744b9e14-d9f7-4ca5-b0bb-090f701d0c62 None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:45.861161 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:45.871652 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3053d949-6f93-4cb0-be3f-e1042084dad8 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:45.911864 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744b9e14-d9f7-4ca5-b0bb-090f701d0c62 None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:45.913306 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb17546-544f-4900-b41b-a5c232a3d1ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:45.913946 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb17546-544f-4900-b41b-a5c232a3d1ba None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:45.914215 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb17546-544f-4900-b41b-a5c232a3d1ba None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:45.914482 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb17546-544f-4900-b41b-a5c232a3d1ba None admin] PATH_INFO: `/v3/roles/service` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:45.925365 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb17546-544f-4900-b41b-a5c232a3d1ba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 09 00:42:45.930763 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application [None req-bcb17546-544f-4900-b41b-a5c232a3d1ba None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 09 00:42:45.930763 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:42:45.930763 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:42:45.930763 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:42:45.930763 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:42:45.930763 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:42:45.930763 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:42:45.930763 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:42:45.930763 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:42:45.930763 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:42:45.930763 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:42:45.930763 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:42:45.930763 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 09 00:42:45.930763 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 09 00:42:45.930763 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 09 00:42:45.930763 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 09 00:42:45.931795 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 09 00:42:45.931795 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 09 00:42:45.931795 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 09 00:42:45.931795 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 09 00:42:45.931795 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:42:45.931795 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:42:45.931795 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:42:45.931795 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:42:45.931795 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:42:45.931795 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:42:45.931795 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:42:45.931795 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application with Lock( Oct 09 00:42:45.931795 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:42:45.931795 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:42:45.931795 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:42:45.931795 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:42:45.932803 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:42:45.932803 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:42:45.932803 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:42:45.932803 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:42:45.932803 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 09 00:42:45.932803 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 09 00:42:45.932803 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 09 00:42:45.932803 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 09 00:42:45.932803 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 09 00:42:45.932803 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 09 00:42:45.932803 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 09 00:42:45.932803 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application Oct 09 00:42:45.936656 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 311/640] 10.222.0.15 () {56 vars in 1102 bytes} [Sun Oct 9 00:42:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:42:45.937648 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb17546-544f-4900-b41b-a5c232a3d1ba None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:45.956672 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0eec012-f1c9-4433-b3ce-d9ed54bc6d16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:45.957293 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0eec012-f1c9-4433-b3ce-d9ed54bc6d16 None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:45.957567 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0eec012-f1c9-4433-b3ce-d9ed54bc6d16 None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:45.957833 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0eec012-f1c9-4433-b3ce-d9ed54bc6d16 None admin] PATH_INFO: `/v3/domains` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:45.958477 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0eec012-f1c9-4433-b3ce-d9ed54bc6d16 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:42:45.958774 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0eec012-f1c9-4433-b3ce-d9ed54bc6d16 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:45.960247 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0eec012-f1c9-4433-b3ce-d9ed54bc6d16 None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:45.972666 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 330/641] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Oct 9 00:42:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:42:45.973569 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0eec012-f1c9-4433-b3ce-d9ed54bc6d16 None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:45.976451 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:46.070180 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb17546-544f-4900-b41b-a5c232a3d1ba None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:46.103517 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0eec012-f1c9-4433-b3ce-d9ed54bc6d16 None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:46.108474 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af6a882-c7c8-40cb-80e1-8a5e399c8555 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:46.109082 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af6a882-c7c8-40cb-80e1-8a5e399c8555 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:46.109355 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af6a882-c7c8-40cb-80e1-8a5e399c8555 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:46.109620 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af6a882-c7c8-40cb-80e1-8a5e399c8555 None admin] PATH_INFO: `/v3/roles` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:46.110288 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af6a882-c7c8-40cb-80e1-8a5e399c8555 None admin] RBAC: Adding query filter params (name=service) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:42:46.110583 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af6a882-c7c8-40cb-80e1-8a5e399c8555 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:46.112034 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af6a882-c7c8-40cb-80e1-8a5e399c8555 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:46.128759 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 312/642] 10.222.0.15 () {56 vars in 1103 bytes} [Sun Oct 9 00:42:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:42:46.128759 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af6a882-c7c8-40cb-80e1-8a5e399c8555 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:46.144863 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5c81c8-05a3-4f5e-a16b-71856c4420c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:46.145614 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5c81c8-05a3-4f5e-a16b-71856c4420c3 None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:46.145953 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5c81c8-05a3-4f5e-a16b-71856c4420c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:46.146287 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5c81c8-05a3-4f5e-a16b-71856c4420c3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:46.147872 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:46.159314 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5c81c8-05a3-4f5e-a16b-71856c4420c3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:46.160919 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5c81c8-05a3-4f5e-a16b-71856c4420c3 None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:46.187402 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application [None req-8c5c81c8-05a3-4f5e-a16b-71856c4420c3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:42:46.187402 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:42:46.187402 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:42:46.187402 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:42:46.187402 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:42:46.187402 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:42:46.187402 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:42:46.187402 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:42:46.187402 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:42:46.187402 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:42:46.187402 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:42:46.187402 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:42:46.187402 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 09 00:42:46.187402 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 09 00:42:46.187402 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 09 00:42:46.187402 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 09 00:42:46.189354 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:42:46.189354 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:42:46.189354 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:42:46.189354 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:42:46.189354 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:42:46.189354 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:42:46.189354 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:42:46.189354 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application with Lock( Oct 09 00:42:46.189354 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:42:46.189354 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:42:46.189354 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:42:46.189354 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:42:46.189354 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:42:46.189354 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:42:46.189354 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:42:46.189354 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:42:46.189354 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 09 00:42:46.190478 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 09 00:42:46.190478 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:42:46.190478 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Oct 09 00:42:46.197368 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 331/643] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Oct 9 00:42:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:42:46.197368 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5c81c8-05a3-4f5e-a16b-71856c4420c3 None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:46.260858 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:46.271818 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af6a882-c7c8-40cb-80e1-8a5e399c8555 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:46.313253 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75810741-2732-4462-9957-9bc717a74015 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:46.313874 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75810741-2732-4462-9957-9bc717a74015 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:46.314154 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75810741-2732-4462-9957-9bc717a74015 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:46.314467 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75810741-2732-4462-9957-9bc717a74015 None admin] PATH_INFO: `/v3/roles` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:46.315105 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75810741-2732-4462-9957-9bc717a74015 None admin] RBAC: Adding query filter params (name=service) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:42:46.315437 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75810741-2732-4462-9957-9bc717a74015 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:46.316853 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75810741-2732-4462-9957-9bc717a74015 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:46.318524 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5c81c8-05a3-4f5e-a16b-71856c4420c3 None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:46.328616 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 313/644] 10.222.0.15 () {56 vars in 1103 bytes} [Sun Oct 9 00:42:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:42:46.330495 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75810741-2732-4462-9957-9bc717a74015 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:46.353111 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37e284c-b942-454b-bbb0-0f16ade2e9ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:46.353754 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37e284c-b942-454b-bbb0-0f16ade2e9ed None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:46.354028 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37e284c-b942-454b-bbb0-0f16ade2e9ed None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:46.354293 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37e284c-b942-454b-bbb0-0f16ade2e9ed None admin] PATH_INFO: `/v3/projects/service` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:46.362858 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37e284c-b942-454b-bbb0-0f16ade2e9ed None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:46.364079 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37e284c-b942-454b-bbb0-0f16ade2e9ed None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:46.376134 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application [None req-c37e284c-b942-454b-bbb0-0f16ade2e9ed None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 09 00:42:46.376134 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:42:46.376134 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:42:46.376134 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:42:46.376134 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:42:46.376134 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:42:46.376134 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:42:46.376134 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:42:46.376134 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:42:46.376134 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:42:46.376134 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:42:46.376134 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:42:46.376134 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 09 00:42:46.376134 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 09 00:42:46.376134 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 09 00:42:46.377060 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 09 00:42:46.377060 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:42:46.377060 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:42:46.377060 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:42:46.377060 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:42:46.377060 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:42:46.377060 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:42:46.377060 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:42:46.377060 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application with Lock( Oct 09 00:42:46.377060 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:42:46.377060 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:42:46.377060 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:42:46.377060 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:42:46.377060 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:42:46.377060 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:42:46.377060 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:42:46.377060 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:42:46.378111 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 09 00:42:46.378111 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 09 00:42:46.378111 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 09 00:42:46.378111 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 09 00:42:46.378111 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 09 00:42:46.378111 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 09 00:42:46.378111 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 09 00:42:46.378111 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Oct 09 00:42:46.378111 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 332/645] 10.222.0.15 () {56 vars in 1111 bytes} [Sun Oct 9 00:42:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:42:46.378587 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37e284c-b942-454b-bbb0-0f16ade2e9ed None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:46.432643 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:46.463965 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75810741-2732-4462-9957-9bc717a74015 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:46.505484 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37e284c-b942-454b-bbb0-0f16ade2e9ed None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:46.510767 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a2140b-c377-4e22-bf2a-9057ce83380c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:46.511526 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a2140b-c377-4e22-bf2a-9057ce83380c None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:46.511871 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a2140b-c377-4e22-bf2a-9057ce83380c None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:46.512210 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a2140b-c377-4e22-bf2a-9057ce83380c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:46.519336 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:46.526500 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a2140b-c377-4e22-bf2a-9057ce83380c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:46.528021 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a2140b-c377-4e22-bf2a-9057ce83380c None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:46.542333 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177c0b60-a6e9-4925-b307-7a10df02bbce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:46.543027 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177c0b60-a6e9-4925-b307-7a10df02bbce None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:46.543393 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177c0b60-a6e9-4925-b307-7a10df02bbce None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:46.543552 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application [None req-e7a2140b-c377-4e22-bf2a-9057ce83380c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:42:46.543552 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:42:46.543552 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:42:46.543552 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:42:46.543552 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:42:46.543552 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:42:46.543552 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:42:46.543552 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:42:46.543552 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:42:46.543552 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:42:46.543552 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:42:46.543552 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:42:46.543552 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 09 00:42:46.543552 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 09 00:42:46.543552 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 09 00:42:46.543552 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 09 00:42:46.545012 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:42:46.545012 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:42:46.545012 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:42:46.545012 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:42:46.545012 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:42:46.545012 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:42:46.545012 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:42:46.545012 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application with Lock( Oct 09 00:42:46.545012 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:42:46.545012 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:42:46.545012 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:42:46.545012 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:42:46.545012 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:42:46.545012 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:42:46.545012 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:42:46.545012 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:42:46.545012 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 09 00:42:46.546140 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 09 00:42:46.546140 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:42:46.546140 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application Oct 09 00:42:46.546357 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177c0b60-a6e9-4925-b307-7a10df02bbce None admin] PATH_INFO: `/v3/domains` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:46.546357 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177c0b60-a6e9-4925-b307-7a10df02bbce None admin] RBAC: Adding query filter params (name=Default) {{(pid=81525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:42:46.546357 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177c0b60-a6e9-4925-b307-7a10df02bbce None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:46.547595 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177c0b60-a6e9-4925-b307-7a10df02bbce None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:46.549261 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 314/646] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Oct 9 00:42:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:42:46.550257 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a2140b-c377-4e22-bf2a-9057ce83380c None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:46.562830 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 333/647] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Oct 9 00:42:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:42:46.564037 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177c0b60-a6e9-4925-b307-7a10df02bbce None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:46.676588 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a2140b-c377-4e22-bf2a-9057ce83380c None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:46.680591 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177c0b60-a6e9-4925-b307-7a10df02bbce None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:46.716139 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:46.722088 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f4beef-7b34-4467-a2d4-1d4b5c826e44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:46.722993 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f4beef-7b34-4467-a2d4-1d4b5c826e44 None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:46.723465 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f4beef-7b34-4467-a2d4-1d4b5c826e44 None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:46.723931 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f4beef-7b34-4467-a2d4-1d4b5c826e44 None admin] PATH_INFO: `/v3/projects` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:46.724802 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f4beef-7b34-4467-a2d4-1d4b5c826e44 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:42:46.725177 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f4beef-7b34-4467-a2d4-1d4b5c826e44 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:46.727178 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e784158-1d54-4a57-9484-19b8617396b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:46.727444 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f4beef-7b34-4467-a2d4-1d4b5c826e44 None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:46.727554 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e784158-1d54-4a57-9484-19b8617396b9 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:46.727628 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e784158-1d54-4a57-9484-19b8617396b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:46.728426 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e784158-1d54-4a57-9484-19b8617396b9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:46.739690 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e784158-1d54-4a57-9484-19b8617396b9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:46.741178 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e784158-1d54-4a57-9484-19b8617396b9 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:46.743625 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 334/648] 10.222.0.15 () {56 vars in 1148 bytes} [Sun Oct 9 00:42:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:42:46.744854 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f4beef-7b34-4467-a2d4-1d4b5c826e44 None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:46.768937 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application [None req-4e784158-1d54-4a57-9484-19b8617396b9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:42:46.768937 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:42:46.768937 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:42:46.768937 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:42:46.768937 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:42:46.768937 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:42:46.768937 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:42:46.768937 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:42:46.768937 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:42:46.768937 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:42:46.768937 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:42:46.768937 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:42:46.768937 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 09 00:42:46.768937 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 09 00:42:46.768937 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 09 00:42:46.768937 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 09 00:42:46.769963 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:42:46.769963 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:42:46.769963 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:42:46.769963 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:42:46.769963 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:42:46.769963 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:42:46.769963 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:42:46.769963 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application with Lock( Oct 09 00:42:46.769963 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:42:46.769963 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:42:46.769963 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:42:46.769963 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:42:46.769963 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:42:46.769963 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:42:46.769963 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:42:46.769963 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:42:46.769963 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 09 00:42:46.770837 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 09 00:42:46.770837 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:42:46.770837 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application Oct 09 00:42:46.771740 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 315/649] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Oct 9 00:42:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:42:46.773321 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e784158-1d54-4a57-9484-19b8617396b9 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:46.800139 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:46.876094 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f4beef-7b34-4467-a2d4-1d4b5c826e44 None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:46.907959 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e784158-1d54-4a57-9484-19b8617396b9 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:46.918921 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42a8176-876d-453d-8c60-034c5f204eec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:46.919594 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42a8176-876d-453d-8c60-034c5f204eec None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:46.919888 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42a8176-876d-453d-8c60-034c5f204eec None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:46.920149 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42a8176-876d-453d-8c60-034c5f204eec None admin] PATH_INFO: `/v3/domains` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:46.920798 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42a8176-876d-453d-8c60-034c5f204eec None admin] RBAC: Adding query filter params (name=Default) {{(pid=81525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:42:46.921117 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42a8176-876d-453d-8c60-034c5f204eec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:46.922488 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42a8176-876d-453d-8c60-034c5f204eec None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:46.939382 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 335/650] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Oct 9 00:42:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:42:46.939382 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42a8176-876d-453d-8c60-034c5f204eec None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:46.960970 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1667e49-58d7-4de7-9fcf-f5374fa0e61f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:46.961622 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1667e49-58d7-4de7-9fcf-f5374fa0e61f None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:46.962374 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1667e49-58d7-4de7-9fcf-f5374fa0e61f None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:46.964133 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1667e49-58d7-4de7-9fcf-f5374fa0e61f None admin] PATH_INFO: `/v3/users/nova` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:46.972884 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1667e49-58d7-4de7-9fcf-f5374fa0e61f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:46.974283 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1667e49-58d7-4de7-9fcf-f5374fa0e61f None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:46.986827 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application [None req-f1667e49-58d7-4de7-9fcf-f5374fa0e61f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 09 00:42:46.986827 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:42:46.986827 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:42:46.986827 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:42:46.986827 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:42:46.986827 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:42:46.986827 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:42:46.986827 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:42:46.986827 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:42:46.986827 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:42:46.986827 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:42:46.986827 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:42:46.986827 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 09 00:42:46.986827 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 09 00:42:46.986827 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 09 00:42:46.986827 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 09 00:42:46.988135 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:42:46.988135 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:42:46.988135 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 09 00:42:46.988135 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 09 00:42:46.988135 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 09 00:42:46.988135 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 09 00:42:46.988135 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:42:46.988135 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:42:46.988135 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:42:46.988135 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:42:46.988135 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:42:46.988135 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application with Lock( Oct 09 00:42:46.988135 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:42:46.988135 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:42:46.988135 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:42:46.988135 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:42:46.988135 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:42:46.988135 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:42:46.989566 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:42:46.989566 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:42:46.989566 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 09 00:42:46.989566 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 09 00:42:46.989566 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 09 00:42:46.989566 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 09 00:42:46.989566 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 09 00:42:46.989566 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 09 00:42:46.989566 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 09 00:42:46.989566 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application Oct 09 00:42:46.992775 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 316/651] 10.222.0.15 () {56 vars in 1093 bytes} [Sun Oct 9 00:42:46 2022] GET /identity/v3/users/nova => generated 82 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:42:46.993607 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1667e49-58d7-4de7-9fcf-f5374fa0e61f None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:47.038187 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:47.049408 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:47.057372 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42a8176-876d-453d-8c60-034c5f204eec None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:47.094559 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fa1f82-e9ce-4a6e-8ce0-094209c749a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:47.095270 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fa1f82-e9ce-4a6e-8ce0-094209c749a2 None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:47.095653 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fa1f82-e9ce-4a6e-8ce0-094209c749a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:47.096007 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fa1f82-e9ce-4a6e-8ce0-094209c749a2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:47.096805 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fa1f82-e9ce-4a6e-8ce0-094209c749a2 None admin] RBAC: Adding query filter params (role.id=6fe3faf520bd402f9bd78d3ed08eec34, scope.project.id=f148d39ced534860abfbe8fc3f98ace4, user.id=d88a9f3d154c4cf98369972a0561b2b5) {{(pid=81525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:42:47.097175 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fa1f82-e9ce-4a6e-8ce0-094209c749a2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:47.099041 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fa1f82-e9ce-4a6e-8ce0-094209c749a2 None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:47.115291 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 336/652] 10.222.0.15 () {56 vars in 1374 bytes} [Sun Oct 9 00:42:46 2022] GET /identity/v3/role_assignments?user.id=d88a9f3d154c4cf98369972a0561b2b5&scope.project.id=f148d39ced534860abfbe8fc3f98ace4&role.id=6fe3faf520bd402f9bd78d3ed08eec34 => generated 608 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:42:47.115291 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fa1f82-e9ce-4a6e-8ce0-094209c749a2 None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:47.126678 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1667e49-58d7-4de7-9fcf-f5374fa0e61f None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:47.166786 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bedb77-9eae-4d3d-a94a-9edfca37628a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:47.167463 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bedb77-9eae-4d3d-a94a-9edfca37628a None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:47.167744 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bedb77-9eae-4d3d-a94a-9edfca37628a None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:47.168018 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bedb77-9eae-4d3d-a94a-9edfca37628a None admin] PATH_INFO: `/v3/domains` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:47.168828 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bedb77-9eae-4d3d-a94a-9edfca37628a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:42:47.169119 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bedb77-9eae-4d3d-a94a-9edfca37628a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:47.170680 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bedb77-9eae-4d3d-a94a-9edfca37628a None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:47.184363 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 317/653] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Oct 9 00:42:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:42:47.189966 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bedb77-9eae-4d3d-a94a-9edfca37628a None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:47.233885 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fa1f82-e9ce-4a6e-8ce0-094209c749a2 None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:47.273238 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235b1c76-ae63-4b16-b8a5-776e153be4e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:47.274286 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235b1c76-ae63-4b16-b8a5-776e153be4e4 None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:47.274657 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235b1c76-ae63-4b16-b8a5-776e153be4e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:47.275063 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235b1c76-ae63-4b16-b8a5-776e153be4e4 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:47.284377 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235b1c76-ae63-4b16-b8a5-776e153be4e4 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:47.285980 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235b1c76-ae63-4b16-b8a5-776e153be4e4 None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:47.300022 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application [None req-235b1c76-ae63-4b16-b8a5-776e153be4e4 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 09 00:42:47.300022 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:42:47.300022 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:42:47.300022 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:42:47.300022 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:42:47.300022 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:42:47.300022 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:42:47.300022 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:42:47.300022 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:42:47.300022 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:42:47.300022 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:42:47.300022 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:42:47.300022 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 09 00:42:47.300022 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 09 00:42:47.300022 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 09 00:42:47.300022 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 09 00:42:47.301065 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:42:47.301065 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:42:47.301065 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 09 00:42:47.301065 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 09 00:42:47.301065 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 09 00:42:47.301065 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 09 00:42:47.301065 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:42:47.301065 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:42:47.301065 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:42:47.301065 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:42:47.301065 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:42:47.301065 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application with Lock( Oct 09 00:42:47.301065 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:42:47.301065 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:42:47.301065 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:42:47.301065 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:42:47.301065 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:42:47.301065 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:42:47.302014 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:42:47.302014 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:42:47.302014 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 09 00:42:47.302014 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 09 00:42:47.302014 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 09 00:42:47.302014 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 09 00:42:47.302014 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 09 00:42:47.302014 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 09 00:42:47.302014 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 09 00:42:47.302014 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Oct 09 00:42:47.306461 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 337/654] 10.222.0.15 () {56 vars in 1099 bytes} [Sun Oct 9 00:42:47 2022] GET /identity/v3/users/cinder => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:42:47.307687 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235b1c76-ae63-4b16-b8a5-776e153be4e4 None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:47.316622 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:47.330468 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bedb77-9eae-4d3d-a94a-9edfca37628a None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:47.339477 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:47.388163 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab7cfa7-1e0d-41f2-a8d7-a2306c0f9411 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:47.388411 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab7cfa7-1e0d-41f2-a8d7-a2306c0f9411 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:47.388656 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab7cfa7-1e0d-41f2-a8d7-a2306c0f9411 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:47.389308 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab7cfa7-1e0d-41f2-a8d7-a2306c0f9411 None admin] PATH_INFO: `/v3/users` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:47.390103 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab7cfa7-1e0d-41f2-a8d7-a2306c0f9411 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:42:47.391117 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab7cfa7-1e0d-41f2-a8d7-a2306c0f9411 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:47.392327 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab7cfa7-1e0d-41f2-a8d7-a2306c0f9411 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:47.416582 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 318/655] 10.222.0.15 () {56 vars in 1133 bytes} [Sun Oct 9 00:42:47 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:42:47.417818 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab7cfa7-1e0d-41f2-a8d7-a2306c0f9411 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:47.454001 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235b1c76-ae63-4b16-b8a5-776e153be4e4 None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:47.496764 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287c7a94-86b3-47ba-9318-e4abed963bd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:47.497568 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287c7a94-86b3-47ba-9318-e4abed963bd0 None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:47.498163 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287c7a94-86b3-47ba-9318-e4abed963bd0 None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:47.498769 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287c7a94-86b3-47ba-9318-e4abed963bd0 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:47.511766 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287c7a94-86b3-47ba-9318-e4abed963bd0 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:47.513237 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287c7a94-86b3-47ba-9318-e4abed963bd0 None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:47.525295 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application [None req-287c7a94-86b3-47ba-9318-e4abed963bd0 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Oct 09 00:42:47.525295 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:42:47.525295 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:42:47.525295 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:42:47.525295 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:42:47.525295 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:42:47.525295 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:42:47.525295 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:42:47.525295 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:42:47.525295 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:42:47.525295 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:42:47.525295 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:42:47.525295 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 09 00:42:47.525295 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 09 00:42:47.525295 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 09 00:42:47.525295 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 09 00:42:47.526317 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:42:47.526317 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:42:47.526317 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 09 00:42:47.526317 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 09 00:42:47.526317 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 09 00:42:47.526317 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 09 00:42:47.526317 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:42:47.526317 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:42:47.526317 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:42:47.526317 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:42:47.526317 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:42:47.526317 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application with Lock( Oct 09 00:42:47.526317 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:42:47.526317 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:42:47.526317 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:42:47.526317 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:42:47.526317 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:42:47.526317 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:42:47.527294 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:42:47.527294 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:42:47.527294 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 09 00:42:47.527294 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 09 00:42:47.527294 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 09 00:42:47.527294 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 09 00:42:47.527294 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 09 00:42:47.527294 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 09 00:42:47.527294 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Oct 09 00:42:47.527294 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Oct 09 00:42:47.527294 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 338/656] 10.222.0.15 () {56 vars in 1102 bytes} [Sun Oct 9 00:42:47 2022] GET /identity/v3/users/neutron => generated 85 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:42:47.527908 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287c7a94-86b3-47ba-9318-e4abed963bd0 None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:47.549398 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab7cfa7-1e0d-41f2-a8d7-a2306c0f9411 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:47.588382 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfd3e4f-9afd-4854-af6d-afc04917cd17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:47.589009 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfd3e4f-9afd-4854-af6d-afc04917cd17 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:47.589284 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfd3e4f-9afd-4854-af6d-afc04917cd17 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:47.589552 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfd3e4f-9afd-4854-af6d-afc04917cd17 None admin] PATH_INFO: `/v3/users` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:47.590292 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfd3e4f-9afd-4854-af6d-afc04917cd17 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:42:47.590594 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfd3e4f-9afd-4854-af6d-afc04917cd17 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:47.592073 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfd3e4f-9afd-4854-af6d-afc04917cd17 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:47.621923 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 319/657] 10.222.0.15 () {56 vars in 1137 bytes} [Sun Oct 9 00:42:47 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:42:47.621923 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65841bb-0ac0-4b84-a248-d3ebc0e83fde None None] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:47.621923 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65841bb-0ac0-4b84-a248-d3ebc0e83fde None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:47.621923 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65841bb-0ac0-4b84-a248-d3ebc0e83fde None None] PATH_INFO: `/` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:47.621923 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 320/658] 10.222.0.15 () {54 vars in 927 bytes} [Sun Oct 9 00:42:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:42:47.621923 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65841bb-0ac0-4b84-a248-d3ebc0e83fde None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:47.633732 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:47.642566 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:47.660469 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287c7a94-86b3-47ba-9318-e4abed963bd0 None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:47.697418 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13be7de-536d-4ded-9f8c-b8adce2b8a83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:47.698262 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13be7de-536d-4ded-9f8c-b8adce2b8a83 None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:47.698647 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13be7de-536d-4ded-9f8c-b8adce2b8a83 None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:47.699100 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13be7de-536d-4ded-9f8c-b8adce2b8a83 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:47.752903 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65841bb-0ac0-4b84-a248-d3ebc0e83fde None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:47.777608 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13be7de-536d-4ded-9f8c-b8adce2b8a83 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:47.779598 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13be7de-536d-4ded-9f8c-b8adce2b8a83 None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:47.794055 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3245ccc-9a7a-4742-8739-4eb2fabbcf78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:47.794568 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3245ccc-9a7a-4742-8739-4eb2fabbcf78 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:47.794843 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3245ccc-9a7a-4742-8739-4eb2fabbcf78 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:47.795113 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3245ccc-9a7a-4742-8739-4eb2fabbcf78 None admin] PATH_INFO: `/v3/users` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:47.795889 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3245ccc-9a7a-4742-8739-4eb2fabbcf78 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:42:47.796195 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3245ccc-9a7a-4742-8739-4eb2fabbcf78 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:47.797780 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3245ccc-9a7a-4742-8739-4eb2fabbcf78 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:47.818216 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 321/659] 10.222.0.15 () {56 vars in 1139 bytes} [Sun Oct 9 00:42:47 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:42:47.819129 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3245ccc-9a7a-4742-8739-4eb2fabbcf78 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:47.882487 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:47.911073 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 339/660] 10.222.0.15 () {58 vars in 1282 bytes} [Sun Oct 9 00:42:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 09 00:42:47.911073 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00166224-42ef-49be-be99-f68dfbd93a71 None None] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:47.911073 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00166224-42ef-49be-be99-f68dfbd93a71 None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:47.911073 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00166224-42ef-49be-be99-f68dfbd93a71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:47.913979 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:47.927107 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.auth.core [None req-00166224-42ef-49be-be99-f68dfbd93a71 None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:42:47.928420 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-00166224-42ef-49be-be99-f68dfbd93a71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:42:47.950010 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3245ccc-9a7a-4742-8739-4eb2fabbcf78 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:47.992588 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9fda0d-fcb6-4149-9fc2-707fd6b1632e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:47.994341 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9fda0d-fcb6-4149-9fc2-707fd6b1632e None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:47.994341 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9fda0d-fcb6-4149-9fc2-707fd6b1632e None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:47.994341 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9fda0d-fcb6-4149-9fc2-707fd6b1632e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:48.010669 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 340/661] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Oct 9 00:42:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 09 00:42:48.010669 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00166224-42ef-49be-be99-f68dfbd93a71 None None] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:48.086871 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9fda0d-fcb6-4149-9fc2-707fd6b1632e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:48.088868 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9fda0d-fcb6-4149-9fc2-707fd6b1632e None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:48.143760 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00166224-42ef-49be-be99-f68dfbd93a71 None None] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:48.156516 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:48.184314 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:48.199105 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24397ccb-e586-4efd-9307-5d99527dfcb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:48.200628 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24397ccb-e586-4efd-9307-5d99527dfcb4 None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:48.201462 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24397ccb-e586-4efd-9307-5d99527dfcb4 None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:48.202180 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24397ccb-e586-4efd-9307-5d99527dfcb4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:48.231507 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 322/662] 10.222.0.15 () {58 vars in 1282 bytes} [Sun Oct 9 00:42:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 09 00:42:48.233278 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9fda0d-fcb6-4149-9fc2-707fd6b1632e None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:48.295895 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24397ccb-e586-4efd-9307-5d99527dfcb4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:48.297360 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24397ccb-e586-4efd-9307-5d99527dfcb4 None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:48.376634 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9fda0d-fcb6-4149-9fc2-707fd6b1632e None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:48.417227 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 341/663] 10.222.0.15 () {58 vars in 1282 bytes} [Sun Oct 9 00:42:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 09 00:42:48.417645 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b34517-df2c-42de-86b7-c9f7ad53a3f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:48.418293 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b34517-df2c-42de-86b7-c9f7ad53a3f6 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:48.418569 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b34517-df2c-42de-86b7-c9f7ad53a3f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:48.418784 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24397ccb-e586-4efd-9307-5d99527dfcb4 None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:48.418877 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b34517-df2c-42de-86b7-c9f7ad53a3f6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:48.430890 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:48.432840 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b34517-df2c-42de-86b7-c9f7ad53a3f6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:48.434308 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b34517-df2c-42de-86b7-c9f7ad53a3f6 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:48.453508 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application [None req-c9b34517-df2c-42de-86b7-c9f7ad53a3f6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:42:48.453508 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:42:48.453508 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:42:48.453508 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:42:48.453508 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:42:48.453508 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:42:48.453508 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:42:48.453508 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:42:48.453508 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:42:48.453508 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:42:48.453508 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:42:48.453508 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:42:48.453508 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 09 00:42:48.453508 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 09 00:42:48.453508 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 09 00:42:48.453508 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 09 00:42:48.454519 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:42:48.454519 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:42:48.454519 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:42:48.454519 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:42:48.454519 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:42:48.454519 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:42:48.454519 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:42:48.454519 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application with Lock( Oct 09 00:42:48.454519 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:42:48.454519 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:42:48.454519 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:42:48.454519 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:42:48.454519 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:42:48.454519 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:42:48.454519 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:42:48.454519 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:42:48.454519 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 09 00:42:48.455567 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 09 00:42:48.455567 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:42:48.455567 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application Oct 09 00:42:48.455567 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 323/664] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Oct 9 00:42:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:42:48.455567 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b34517-df2c-42de-86b7-c9f7ad53a3f6 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:48.484626 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:48.539592 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24397ccb-e586-4efd-9307-5d99527dfcb4 None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:48.571070 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b34517-df2c-42de-86b7-c9f7ad53a3f6 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:48.576047 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0d2bc4-9ed2-46a3-ba41-9bd1421ba489 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:48.576693 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0d2bc4-9ed2-46a3-ba41-9bd1421ba489 None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:48.576967 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0d2bc4-9ed2-46a3-ba41-9bd1421ba489 None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:48.577233 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0d2bc4-9ed2-46a3-ba41-9bd1421ba489 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:48.588497 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0d2bc4-9ed2-46a3-ba41-9bd1421ba489 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:48.589995 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0d2bc4-9ed2-46a3-ba41-9bd1421ba489 None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:48.607720 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application [None req-0b0d2bc4-9ed2-46a3-ba41-9bd1421ba489 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:42:48.607720 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:42:48.607720 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:42:48.607720 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:42:48.607720 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:42:48.607720 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:42:48.607720 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:42:48.607720 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:42:48.607720 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:42:48.607720 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:42:48.607720 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:42:48.607720 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:42:48.607720 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 09 00:42:48.607720 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 09 00:42:48.607720 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 09 00:42:48.607720 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 09 00:42:48.609135 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:42:48.609135 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:42:48.609135 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:42:48.609135 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:42:48.609135 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:42:48.609135 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:42:48.609135 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:42:48.609135 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application with Lock( Oct 09 00:42:48.609135 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:42:48.609135 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:42:48.609135 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:42:48.609135 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:42:48.609135 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:42:48.609135 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:42:48.609135 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:42:48.609135 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:42:48.609135 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 09 00:42:48.610077 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 09 00:42:48.610077 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:42:48.610077 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Oct 09 00:42:48.610077 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 342/665] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Oct 9 00:42:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:42:48.610077 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0d2bc4-9ed2-46a3-ba41-9bd1421ba489 None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:48.614880 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe733247-d546-4a91-b365-6b3c64619df4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:48.615569 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe733247-d546-4a91-b365-6b3c64619df4 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:48.615840 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe733247-d546-4a91-b365-6b3c64619df4 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:48.616101 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe733247-d546-4a91-b365-6b3c64619df4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:48.628921 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe733247-d546-4a91-b365-6b3c64619df4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 09 00:42:48.634355 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application [None req-fe733247-d546-4a91-b365-6b3c64619df4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 09 00:42:48.634355 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:42:48.634355 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:42:48.634355 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:42:48.634355 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:42:48.634355 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:42:48.634355 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:42:48.634355 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:42:48.634355 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:42:48.634355 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:42:48.634355 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:42:48.634355 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:42:48.634355 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 09 00:42:48.634355 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 09 00:42:48.634355 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 09 00:42:48.634355 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 09 00:42:48.635372 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 09 00:42:48.635372 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 09 00:42:48.635372 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 09 00:42:48.635372 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 09 00:42:48.635372 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:42:48.635372 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:42:48.635372 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:42:48.635372 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:42:48.635372 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:42:48.635372 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:42:48.635372 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:42:48.635372 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application with Lock( Oct 09 00:42:48.635372 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:42:48.635372 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:42:48.635372 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:42:48.635372 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:42:48.636242 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:42:48.636242 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:42:48.636242 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:42:48.636242 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:42:48.636242 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 09 00:42:48.636242 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 09 00:42:48.636242 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 09 00:42:48.636242 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 09 00:42:48.636242 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 09 00:42:48.636242 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 09 00:42:48.636242 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 09 00:42:48.636242 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application Oct 09 00:42:48.636242 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 324/666] 10.222.0.15 () {56 vars in 1102 bytes} [Sun Oct 9 00:42:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:42:48.636930 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe733247-d546-4a91-b365-6b3c64619df4 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:48.679841 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:48.720592 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0d2bc4-9ed2-46a3-ba41-9bd1421ba489 None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:48.731147 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:48.749102 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe733247-d546-4a91-b365-6b3c64619df4 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:48.758975 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7e375b-ec62-4c42-8b05-856a6971b595 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:48.759648 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7e375b-ec62-4c42-8b05-856a6971b595 None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:48.759924 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7e375b-ec62-4c42-8b05-856a6971b595 None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:48.760190 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7e375b-ec62-4c42-8b05-856a6971b595 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:48.770150 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7e375b-ec62-4c42-8b05-856a6971b595 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:48.771629 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7e375b-ec62-4c42-8b05-856a6971b595 None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:48.787480 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application [None req-fe7e375b-ec62-4c42-8b05-856a6971b595 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:42:48.787480 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:42:48.787480 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:42:48.787480 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:42:48.787480 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:42:48.787480 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:42:48.787480 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:42:48.787480 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:42:48.787480 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:42:48.787480 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:42:48.787480 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:42:48.787480 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:42:48.787480 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 09 00:42:48.787480 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 09 00:42:48.787480 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 09 00:42:48.787480 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 09 00:42:48.788490 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:42:48.788490 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:42:48.788490 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:42:48.788490 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:42:48.788490 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:42:48.788490 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:42:48.788490 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:42:48.788490 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application with Lock( Oct 09 00:42:48.788490 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:42:48.788490 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:42:48.788490 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:42:48.788490 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:42:48.788490 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:42:48.788490 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:42:48.788490 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:42:48.788490 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:42:48.788490 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 09 00:42:48.789355 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 09 00:42:48.789355 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:42:48.789355 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Oct 09 00:42:48.789355 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 343/667] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Oct 9 00:42:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:42:48.789355 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7e375b-ec62-4c42-8b05-856a6971b595 None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:48.796809 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ff8555-688a-44d7-9799-c603336732d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:48.797432 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ff8555-688a-44d7-9799-c603336732d5 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:48.797685 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ff8555-688a-44d7-9799-c603336732d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:48.797980 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ff8555-688a-44d7-9799-c603336732d5 None admin] PATH_INFO: `/v3/domains` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:48.798634 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ff8555-688a-44d7-9799-c603336732d5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:42:48.798931 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ff8555-688a-44d7-9799-c603336732d5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:48.800475 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ff8555-688a-44d7-9799-c603336732d5 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:48.818133 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 325/668] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Oct 9 00:42:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:42:48.818133 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ff8555-688a-44d7-9799-c603336732d5 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:48.899915 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7e375b-ec62-4c42-8b05-856a6971b595 None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:48.912789 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:48.922173 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ff8555-688a-44d7-9799-c603336732d5 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:48.934542 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eac0329-cdd7-44f8-9a7c-f2c302108b4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:48.935165 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eac0329-cdd7-44f8-9a7c-f2c302108b4c None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:48.935483 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eac0329-cdd7-44f8-9a7c-f2c302108b4c None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:48.935751 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eac0329-cdd7-44f8-9a7c-f2c302108b4c None admin] PATH_INFO: `/v3/domains` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:48.936398 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eac0329-cdd7-44f8-9a7c-f2c302108b4c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:42:48.936697 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eac0329-cdd7-44f8-9a7c-f2c302108b4c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:48.938075 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eac0329-cdd7-44f8-9a7c-f2c302108b4c None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:48.950177 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 344/669] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Oct 9 00:42:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:42:48.951040 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eac0329-cdd7-44f8-9a7c-f2c302108b4c None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:48.969189 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a04d48-2714-41b9-8363-6e0ef085521b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:48.970058 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a04d48-2714-41b9-8363-6e0ef085521b None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:48.970635 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a04d48-2714-41b9-8363-6e0ef085521b None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:48.971044 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a04d48-2714-41b9-8363-6e0ef085521b None admin] PATH_INFO: `/v3/roles` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:48.972200 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a04d48-2714-41b9-8363-6e0ef085521b None admin] RBAC: Adding query filter params (name=service) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:42:48.972644 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a04d48-2714-41b9-8363-6e0ef085521b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:48.974174 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a04d48-2714-41b9-8363-6e0ef085521b None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:48.989886 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 326/670] 10.222.0.15 () {56 vars in 1103 bytes} [Sun Oct 9 00:42:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:42:48.991899 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a04d48-2714-41b9-8363-6e0ef085521b None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:49.005512 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:49.075086 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eac0329-cdd7-44f8-9a7c-f2c302108b4c None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:49.114713 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad678c55-12c5-4e40-a5c3-b0386026969e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:49.115394 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad678c55-12c5-4e40-a5c3-b0386026969e None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:49.115673 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad678c55-12c5-4e40-a5c3-b0386026969e None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:49.115949 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad678c55-12c5-4e40-a5c3-b0386026969e None admin] PATH_INFO: `/v3/domains` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:49.116594 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad678c55-12c5-4e40-a5c3-b0386026969e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:42:49.116895 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad678c55-12c5-4e40-a5c3-b0386026969e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:49.118356 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad678c55-12c5-4e40-a5c3-b0386026969e None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:49.135333 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 345/671] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Oct 9 00:42:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:42:49.135333 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad678c55-12c5-4e40-a5c3-b0386026969e None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:49.135611 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a04d48-2714-41b9-8363-6e0ef085521b None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:49.168734 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:49.175972 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed2ef15-40f9-4358-be6b-42a5cafc14ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:49.176693 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed2ef15-40f9-4358-be6b-42a5cafc14ca None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:49.177040 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed2ef15-40f9-4358-be6b-42a5cafc14ca None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:49.177384 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed2ef15-40f9-4358-be6b-42a5cafc14ca None admin] PATH_INFO: `/v3/projects/service` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:49.184626 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed2ef15-40f9-4358-be6b-42a5cafc14ca None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:49.186114 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed2ef15-40f9-4358-be6b-42a5cafc14ca None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:49.199329 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application [None req-8ed2ef15-40f9-4358-be6b-42a5cafc14ca None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 09 00:42:49.199329 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:42:49.199329 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:42:49.199329 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:42:49.199329 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:42:49.199329 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:42:49.199329 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:42:49.199329 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:42:49.199329 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:42:49.199329 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:42:49.199329 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:42:49.199329 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:42:49.199329 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 09 00:42:49.199329 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 09 00:42:49.199329 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 09 00:42:49.200398 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 09 00:42:49.200398 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:42:49.200398 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:42:49.200398 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:42:49.200398 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:42:49.200398 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:42:49.200398 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:42:49.200398 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:42:49.200398 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application with Lock( Oct 09 00:42:49.200398 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:42:49.200398 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:42:49.200398 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:42:49.200398 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:42:49.200398 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:42:49.200398 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:42:49.200398 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:42:49.200398 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:42:49.201289 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 09 00:42:49.201289 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 09 00:42:49.201289 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 09 00:42:49.201289 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 09 00:42:49.201289 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 09 00:42:49.201289 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 09 00:42:49.201289 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 09 00:42:49.201289 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application Oct 09 00:42:49.201289 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 327/672] 10.222.0.15 () {56 vars in 1111 bytes} [Sun Oct 9 00:42:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:42:49.201289 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed2ef15-40f9-4358-be6b-42a5cafc14ca None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:49.259564 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad678c55-12c5-4e40-a5c3-b0386026969e None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:49.277827 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:49.299296 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce7d5de-3746-4abc-a73e-54334b105b49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:49.300295 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce7d5de-3746-4abc-a73e-54334b105b49 None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:49.300573 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce7d5de-3746-4abc-a73e-54334b105b49 None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:49.300842 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce7d5de-3746-4abc-a73e-54334b105b49 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:49.308117 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce7d5de-3746-4abc-a73e-54334b105b49 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:49.309603 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce7d5de-3746-4abc-a73e-54334b105b49 None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:49.317666 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed2ef15-40f9-4358-be6b-42a5cafc14ca None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:49.325949 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application [None req-7ce7d5de-3746-4abc-a73e-54334b105b49 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 09 00:42:49.325949 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:42:49.325949 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:42:49.325949 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:42:49.325949 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:42:49.325949 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:42:49.325949 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:42:49.325949 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:42:49.325949 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:42:49.325949 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:42:49.325949 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:42:49.325949 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:42:49.325949 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 09 00:42:49.325949 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 09 00:42:49.325949 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 09 00:42:49.326840 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 09 00:42:49.326840 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:42:49.326840 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:42:49.326840 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:42:49.326840 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:42:49.326840 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:42:49.326840 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:42:49.326840 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:42:49.326840 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application with Lock( Oct 09 00:42:49.326840 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:42:49.326840 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:42:49.326840 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:42:49.326840 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:42:49.326840 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:42:49.326840 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:42:49.326840 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:42:49.326840 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:42:49.327817 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 09 00:42:49.327817 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 09 00:42:49.327817 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 09 00:42:49.327817 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 09 00:42:49.327817 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 09 00:42:49.327817 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 09 00:42:49.327817 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 09 00:42:49.327817 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Oct 09 00:42:49.329086 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 346/673] 10.222.0.15 () {56 vars in 1111 bytes} [Sun Oct 9 00:42:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:42:49.330095 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce7d5de-3746-4abc-a73e-54334b105b49 None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:49.357426 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfbb297-68de-4dbb-8f16-ff409ca65afc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:49.358262 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfbb297-68de-4dbb-8f16-ff409ca65afc None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:49.358610 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfbb297-68de-4dbb-8f16-ff409ca65afc None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:49.358971 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfbb297-68de-4dbb-8f16-ff409ca65afc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:49.371703 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfbb297-68de-4dbb-8f16-ff409ca65afc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:49.373674 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfbb297-68de-4dbb-8f16-ff409ca65afc None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:49.389787 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application [None req-abfbb297-68de-4dbb-8f16-ff409ca65afc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:42:49.389787 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:42:49.389787 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:42:49.389787 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:42:49.389787 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:42:49.389787 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:42:49.389787 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:42:49.389787 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:42:49.389787 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:42:49.389787 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:42:49.389787 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:42:49.389787 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:42:49.389787 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 09 00:42:49.389787 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 09 00:42:49.389787 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 09 00:42:49.389787 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 09 00:42:49.391029 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:42:49.391029 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:42:49.391029 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:42:49.391029 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:42:49.391029 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:42:49.391029 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:42:49.391029 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:42:49.391029 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application with Lock( Oct 09 00:42:49.391029 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:42:49.391029 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:42:49.391029 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:42:49.391029 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:42:49.391029 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:42:49.391029 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:42:49.391029 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:42:49.391029 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:42:49.391029 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 09 00:42:49.392146 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 09 00:42:49.392146 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:42:49.392146 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application Oct 09 00:42:49.392829 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 328/674] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Oct 9 00:42:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:42:49.393838 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfbb297-68de-4dbb-8f16-ff409ca65afc None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:49.451441 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:49.461702 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce7d5de-3746-4abc-a73e-54334b105b49 None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:49.498915 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958c857f-429d-4c41-a5b0-dfed83b4e3a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:49.499591 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958c857f-429d-4c41-a5b0-dfed83b4e3a5 None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:49.499864 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958c857f-429d-4c41-a5b0-dfed83b4e3a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:49.500128 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958c857f-429d-4c41-a5b0-dfed83b4e3a5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:49.506928 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958c857f-429d-4c41-a5b0-dfed83b4e3a5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:49.508457 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958c857f-429d-4c41-a5b0-dfed83b4e3a5 None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:49.514792 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfbb297-68de-4dbb-8f16-ff409ca65afc None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:49.519606 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application [None req-958c857f-429d-4c41-a5b0-dfed83b4e3a5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 09 00:42:49.519606 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:42:49.519606 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:42:49.519606 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:42:49.519606 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:42:49.519606 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:42:49.519606 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:42:49.519606 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:42:49.519606 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:42:49.519606 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:42:49.519606 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:42:49.519606 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:42:49.519606 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 09 00:42:49.519606 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 09 00:42:49.519606 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 09 00:42:49.520666 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 09 00:42:49.520666 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:42:49.520666 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:42:49.520666 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:42:49.520666 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:42:49.520666 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:42:49.520666 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:42:49.520666 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:42:49.520666 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application with Lock( Oct 09 00:42:49.520666 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:42:49.520666 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:42:49.520666 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:42:49.520666 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:42:49.520666 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:42:49.520666 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:42:49.520666 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:42:49.520666 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:42:49.521752 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 09 00:42:49.521752 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 09 00:42:49.521752 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 09 00:42:49.521752 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 09 00:42:49.521752 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 09 00:42:49.521752 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 09 00:42:49.521752 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 09 00:42:49.521752 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Oct 09 00:42:49.521752 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 347/675] 10.222.0.15 () {56 vars in 1111 bytes} [Sun Oct 9 00:42:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:42:49.521752 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958c857f-429d-4c41-a5b0-dfed83b4e3a5 None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:49.536353 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:49.553557 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f455493d-183d-40f9-aa3a-7c2a7386daf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:49.554183 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f455493d-183d-40f9-aa3a-7c2a7386daf2 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:49.554459 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f455493d-183d-40f9-aa3a-7c2a7386daf2 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:49.554724 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f455493d-183d-40f9-aa3a-7c2a7386daf2 None admin] PATH_INFO: `/v3/projects` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:49.555489 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f455493d-183d-40f9-aa3a-7c2a7386daf2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:42:49.555792 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f455493d-183d-40f9-aa3a-7c2a7386daf2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:49.557219 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f455493d-183d-40f9-aa3a-7c2a7386daf2 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:49.569832 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 329/676] 10.222.0.15 () {56 vars in 1148 bytes} [Sun Oct 9 00:42:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:42:49.570688 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f455493d-183d-40f9-aa3a-7c2a7386daf2 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:49.627152 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958c857f-429d-4c41-a5b0-dfed83b4e3a5 None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:49.662386 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078fb170-a8b8-41df-881f-fc4c5016d53d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:49.663010 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078fb170-a8b8-41df-881f-fc4c5016d53d None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:49.663291 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078fb170-a8b8-41df-881f-fc4c5016d53d None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:49.663811 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078fb170-a8b8-41df-881f-fc4c5016d53d None admin] PATH_INFO: `/v3/projects` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:49.664266 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078fb170-a8b8-41df-881f-fc4c5016d53d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:42:49.664647 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078fb170-a8b8-41df-881f-fc4c5016d53d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:49.666080 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078fb170-a8b8-41df-881f-fc4c5016d53d None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:49.672273 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f455493d-183d-40f9-aa3a-7c2a7386daf2 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:49.678119 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 348/677] 10.222.0.15 () {56 vars in 1148 bytes} [Sun Oct 9 00:42:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:42:49.679373 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f04965d-4cf4-48f1-a249-f13e7cab23f7 None None] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:49.679663 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f04965d-4cf4-48f1-a249-f13e7cab23f7 None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:49.679930 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f04965d-4cf4-48f1-a249-f13e7cab23f7 None None] PATH_INFO: `/` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:49.681128 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 349/678] 10.222.0.15 () {54 vars in 927 bytes} [Sun Oct 9 00:42:49 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:42:49.681824 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f04965d-4cf4-48f1-a249-f13e7cab23f7 None None] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:49.697498 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:49.711159 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b1d742-b8a1-43a0-9493-781ba05b0734 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:49.711976 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b1d742-b8a1-43a0-9493-781ba05b0734 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:49.712327 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b1d742-b8a1-43a0-9493-781ba05b0734 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:49.712596 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b1d742-b8a1-43a0-9493-781ba05b0734 None admin] PATH_INFO: `/v3/domains` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:49.713252 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b1d742-b8a1-43a0-9493-781ba05b0734 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:42:49.713552 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b1d742-b8a1-43a0-9493-781ba05b0734 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:49.714926 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b1d742-b8a1-43a0-9493-781ba05b0734 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:49.731088 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 330/679] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Oct 9 00:42:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:42:49.731088 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b1d742-b8a1-43a0-9493-781ba05b0734 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:49.770952 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:49.791633 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f04965d-4cf4-48f1-a249-f13e7cab23f7 None None] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:49.836476 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879835ab-b759-4c29-bc04-7e7288c548d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:49.837430 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879835ab-b759-4c29-bc04-7e7288c548d5 None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:49.837876 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879835ab-b759-4c29-bc04-7e7288c548d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:49.838351 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879835ab-b759-4c29-bc04-7e7288c548d5 None admin] PATH_INFO: `/v3/projects` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:49.839557 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879835ab-b759-4c29-bc04-7e7288c548d5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:42:49.840046 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879835ab-b759-4c29-bc04-7e7288c548d5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:49.842347 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879835ab-b759-4c29-bc04-7e7288c548d5 None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:49.848575 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b1d742-b8a1-43a0-9493-781ba05b0734 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:49.857906 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 350/680] 10.222.0.15 () {56 vars in 1148 bytes} [Sun Oct 9 00:42:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:42:49.858769 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879835ab-b759-4c29-bc04-7e7288c548d5 None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:49.888991 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fd914b-aace-438d-b95a-dcee99dd4151 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:49.889603 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fd914b-aace-438d-b95a-dcee99dd4151 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:49.889878 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fd914b-aace-438d-b95a-dcee99dd4151 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:49.890145 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fd914b-aace-438d-b95a-dcee99dd4151 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:49.890902 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fd914b-aace-438d-b95a-dcee99dd4151 None admin] RBAC: Adding query filter params (role.id=6fe3faf520bd402f9bd78d3ed08eec34, scope.project.id=f148d39ced534860abfbe8fc3f98ace4, user.id=4ac83d57fba841e0a666710732249c49) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:42:49.891198 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fd914b-aace-438d-b95a-dcee99dd4151 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:49.892667 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fd914b-aace-438d-b95a-dcee99dd4151 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:49.898735 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 331/681] 10.222.0.15 () {56 vars in 1374 bytes} [Sun Oct 9 00:42:49 2022] GET /identity/v3/role_assignments?user.id=4ac83d57fba841e0a666710732249c49&scope.project.id=f148d39ced534860abfbe8fc3f98ace4&role.id=6fe3faf520bd402f9bd78d3ed08eec34 => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:42:49.900043 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3f93c2-3a59-4fe4-b360-4e8309203c6e None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:49.900323 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3f93c2-3a59-4fe4-b360-4e8309203c6e None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:49.900589 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3f93c2-3a59-4fe4-b360-4e8309203c6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:49.920956 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-2d3f93c2-3a59-4fe4-b360-4e8309203c6e None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:42:49.922192 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-2d3f93c2-3a59-4fe4-b360-4e8309203c6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:42:49.952029 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:49.990443 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879835ab-b759-4c29-bc04-7e7288c548d5 None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:50.005622 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 332/682] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Oct 9 00:42:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 09 00:42:50.006597 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3f93c2-3a59-4fe4-b360-4e8309203c6e None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:50.047477 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaeaea97-2bc7-42f2-a700-0dc2aa315721 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:50.049100 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaeaea97-2bc7-42f2-a700-0dc2aa315721 None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:50.049635 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaeaea97-2bc7-42f2-a700-0dc2aa315721 None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:50.050124 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaeaea97-2bc7-42f2-a700-0dc2aa315721 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:50.051043 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaeaea97-2bc7-42f2-a700-0dc2aa315721 None admin] RBAC: Adding query filter params (role.id=6fe3faf520bd402f9bd78d3ed08eec34, scope.project.id=f148d39ced534860abfbe8fc3f98ace4, user.id=ff7cb78bcd91467abe5c2e2b48aedd1b) {{(pid=81525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:42:50.051836 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaeaea97-2bc7-42f2-a700-0dc2aa315721 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:50.052957 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:50.055632 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaeaea97-2bc7-42f2-a700-0dc2aa315721 None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:50.073860 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 351/683] 10.222.0.15 () {56 vars in 1374 bytes} [Sun Oct 9 00:42:49 2022] GET /identity/v3/role_assignments?user.id=ff7cb78bcd91467abe5c2e2b48aedd1b&scope.project.id=f148d39ced534860abfbe8fc3f98ace4&role.id=6fe3faf520bd402f9bd78d3ed08eec34 => generated 608 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:42:50.073860 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaeaea97-2bc7-42f2-a700-0dc2aa315721 None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:50.172042 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3f93c2-3a59-4fe4-b360-4e8309203c6e None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:50.229672 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b2a4be-e476-457f-b6aa-9df6d67d5a42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:50.230576 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b2a4be-e476-457f-b6aa-9df6d67d5a42 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:50.230943 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b2a4be-e476-457f-b6aa-9df6d67d5a42 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:50.231336 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b2a4be-e476-457f-b6aa-9df6d67d5a42 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:50.244042 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b2a4be-e476-457f-b6aa-9df6d67d5a42 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:50.246581 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b2a4be-e476-457f-b6aa-9df6d67d5a42 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:50.248104 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaeaea97-2bc7-42f2-a700-0dc2aa315721 None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:50.263858 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application [None req-f8b2a4be-e476-457f-b6aa-9df6d67d5a42 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 09 00:42:50.263858 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:42:50.263858 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:42:50.263858 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:42:50.263858 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:42:50.263858 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:42:50.263858 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:42:50.263858 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:42:50.263858 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:42:50.263858 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:42:50.263858 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:42:50.263858 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:42:50.263858 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 09 00:42:50.263858 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 09 00:42:50.263858 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 09 00:42:50.263858 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 09 00:42:50.265114 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:42:50.265114 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:42:50.265114 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 09 00:42:50.265114 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 09 00:42:50.265114 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 09 00:42:50.265114 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 09 00:42:50.265114 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:42:50.265114 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:42:50.265114 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:42:50.265114 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:42:50.265114 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:42:50.265114 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application with Lock( Oct 09 00:42:50.265114 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:42:50.265114 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:42:50.265114 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:42:50.265114 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:42:50.265114 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:42:50.265114 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:42:50.267288 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:42:50.267288 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:42:50.267288 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 09 00:42:50.267288 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 09 00:42:50.267288 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 09 00:42:50.267288 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 09 00:42:50.267288 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 09 00:42:50.267288 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 09 00:42:50.267288 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 09 00:42:50.267288 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application Oct 09 00:42:50.268438 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 333/684] 10.222.0.15 () {56 vars in 1096 bytes} [Sun Oct 9 00:42:50 2022] GET /identity/v3/users/swift => generated 83 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:42:50.272471 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b2a4be-e476-457f-b6aa-9df6d67d5a42 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:50.296580 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840da827-97aa-4983-b673-5a9091663711 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:50.297350 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840da827-97aa-4983-b673-5a9091663711 None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:50.297578 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840da827-97aa-4983-b673-5a9091663711 None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:50.297931 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840da827-97aa-4983-b673-5a9091663711 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:50.298672 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840da827-97aa-4983-b673-5a9091663711 None admin] RBAC: Adding query filter params (role.id=6fe3faf520bd402f9bd78d3ed08eec34, scope.project.id=f148d39ced534860abfbe8fc3f98ace4, user.id=f4ef90d456d2483e8ddafbe2d4d4fb5e) {{(pid=81525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:42:50.298971 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840da827-97aa-4983-b673-5a9091663711 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:50.300488 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840da827-97aa-4983-b673-5a9091663711 None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:50.304394 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:50.310245 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 352/685] 10.222.0.15 () {56 vars in 1374 bytes} [Sun Oct 9 00:42:50 2022] GET /identity/v3/role_assignments?user.id=f4ef90d456d2483e8ddafbe2d4d4fb5e&scope.project.id=f148d39ced534860abfbe8fc3f98ace4&role.id=6fe3faf520bd402f9bd78d3ed08eec34 => generated 608 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:42:50.311247 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840da827-97aa-4983-b673-5a9091663711 None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:50.394266 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:50.408087 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b2a4be-e476-457f-b6aa-9df6d67d5a42 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:50.490015 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cc91d7-c8ba-4459-9d5f-105d798b16db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:50.490564 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cc91d7-c8ba-4459-9d5f-105d798b16db None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:50.490837 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cc91d7-c8ba-4459-9d5f-105d798b16db None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:50.491107 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cc91d7-c8ba-4459-9d5f-105d798b16db None admin] PATH_INFO: `/v3/users` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:50.491904 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cc91d7-c8ba-4459-9d5f-105d798b16db None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:42:50.492204 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cc91d7-c8ba-4459-9d5f-105d798b16db None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:50.494234 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cc91d7-c8ba-4459-9d5f-105d798b16db None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:50.498722 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840da827-97aa-4983-b673-5a9091663711 None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:50.527891 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 334/686] 10.222.0.15 () {56 vars in 1135 bytes} [Sun Oct 9 00:42:50 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:42:50.534457 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cc91d7-c8ba-4459-9d5f-105d798b16db None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:50.566252 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cceb10c5-2ef1-4895-b676-b3ebfc571859 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:50.566986 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cceb10c5-2ef1-4895-b676-b3ebfc571859 None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:50.567409 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cceb10c5-2ef1-4895-b676-b3ebfc571859 None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:50.568169 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cceb10c5-2ef1-4895-b676-b3ebfc571859 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:50.587743 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cceb10c5-2ef1-4895-b676-b3ebfc571859 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:50.591771 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cceb10c5-2ef1-4895-b676-b3ebfc571859 None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:50.612325 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application [None req-cceb10c5-2ef1-4895-b676-b3ebfc571859 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:42:50.612325 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:42:50.612325 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:42:50.612325 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:42:50.612325 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:42:50.612325 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:42:50.612325 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:42:50.612325 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:42:50.612325 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:42:50.612325 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:42:50.612325 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:42:50.612325 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:42:50.612325 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 09 00:42:50.612325 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 09 00:42:50.612325 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 09 00:42:50.612325 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 09 00:42:50.614051 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:42:50.614051 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:42:50.614051 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:42:50.614051 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:42:50.614051 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:42:50.614051 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:42:50.614051 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:42:50.614051 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application with Lock( Oct 09 00:42:50.614051 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:42:50.614051 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:42:50.614051 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:42:50.614051 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:42:50.614051 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:42:50.614051 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:42:50.614051 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:42:50.614051 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:42:50.614051 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 09 00:42:50.615806 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 09 00:42:50.615806 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:42:50.615806 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Oct 09 00:42:50.617686 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 353/687] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Oct 9 00:42:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 307 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:42:50.627098 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cceb10c5-2ef1-4895-b676-b3ebfc571859 None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:50.679654 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cc91d7-c8ba-4459-9d5f-105d798b16db None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:50.711771 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:50.728847 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b245da47-bac0-4d3b-9e36-77cc0151a59b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:50.729476 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b245da47-bac0-4d3b-9e36-77cc0151a59b None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:50.729754 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b245da47-bac0-4d3b-9e36-77cc0151a59b None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:50.730038 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b245da47-bac0-4d3b-9e36-77cc0151a59b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:50.768035 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:50.778087 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cceb10c5-2ef1-4895-b676-b3ebfc571859 None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:50.856202 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3443aef-ee5d-4a84-9453-dc6cbf9d0fac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:50.856832 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3443aef-ee5d-4a84-9453-dc6cbf9d0fac None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:50.857103 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3443aef-ee5d-4a84-9453-dc6cbf9d0fac None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:50.857368 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3443aef-ee5d-4a84-9453-dc6cbf9d0fac None admin] PATH_INFO: `/v3/domains` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:50.858013 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3443aef-ee5d-4a84-9453-dc6cbf9d0fac None admin] RBAC: Adding query filter params (name=Default) {{(pid=81525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:42:50.858308 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3443aef-ee5d-4a84-9453-dc6cbf9d0fac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:50.859721 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3443aef-ee5d-4a84-9453-dc6cbf9d0fac None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:50.877650 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b245da47-bac0-4d3b-9e36-77cc0151a59b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:50.879590 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b245da47-bac0-4d3b-9e36-77cc0151a59b None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:50.886464 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 354/688] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Oct 9 00:42:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:42:50.890277 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3443aef-ee5d-4a84-9453-dc6cbf9d0fac None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:51.068969 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3443aef-ee5d-4a84-9453-dc6cbf9d0fac None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:51.095496 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 335/689] 10.222.0.15 () {58 vars in 1282 bytes} [Sun Oct 9 00:42:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 557 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 09 00:42:51.100591 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b245da47-bac0-4d3b-9e36-77cc0151a59b None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:51.101244 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:51.148868 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5425419-58a2-48d0-868d-cfbb9cc3dc4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:51.149928 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5425419-58a2-48d0-868d-cfbb9cc3dc4f None admin] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:51.150401 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5425419-58a2-48d0-868d-cfbb9cc3dc4f None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:51.150891 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5425419-58a2-48d0-868d-cfbb9cc3dc4f None admin] PATH_INFO: `/v3/users` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:51.151815 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5425419-58a2-48d0-868d-cfbb9cc3dc4f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:51.153554 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5425419-58a2-48d0-868d-cfbb9cc3dc4f None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:51.193361 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:51.209662 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 355/690] 10.222.0.15 () {60 vars in 1132 bytes} [Sun Oct 9 00:42:50 2022] POST /identity/v3/users => generated 254 bytes in 320 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 09 00:42:51.256343 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b245da47-bac0-4d3b-9e36-77cc0151a59b None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:51.301101 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b86d278-0cfd-45f2-9df2-d59e5d149c6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:51.301766 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b86d278-0cfd-45f2-9df2-d59e5d149c6c None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:51.302041 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b86d278-0cfd-45f2-9df2-d59e5d149c6c None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:51.302316 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b86d278-0cfd-45f2-9df2-d59e5d149c6c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:51.316803 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b86d278-0cfd-45f2-9df2-d59e5d149c6c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:51.318305 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b86d278-0cfd-45f2-9df2-d59e5d149c6c None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:51.344876 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application [None req-8b86d278-0cfd-45f2-9df2-d59e5d149c6c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:42:51.344876 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:42:51.344876 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:42:51.344876 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:42:51.344876 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:42:51.344876 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:42:51.344876 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:42:51.344876 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:42:51.344876 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:42:51.344876 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:42:51.344876 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:42:51.344876 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:42:51.344876 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 09 00:42:51.344876 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 09 00:42:51.344876 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 09 00:42:51.344876 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 09 00:42:51.345856 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:42:51.345856 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:42:51.345856 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:42:51.345856 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:42:51.345856 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:42:51.345856 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:42:51.345856 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:42:51.345856 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application with Lock( Oct 09 00:42:51.345856 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:42:51.345856 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:42:51.345856 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:42:51.345856 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:42:51.345856 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:42:51.345856 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:42:51.345856 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:42:51.345856 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:42:51.345856 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 09 00:42:51.346784 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 09 00:42:51.346784 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:42:51.346784 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application Oct 09 00:42:51.346784 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 336/691] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Oct 9 00:42:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:42:51.353606 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5425419-58a2-48d0-868d-cfbb9cc3dc4f None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:51.515767 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5425419-58a2-48d0-868d-cfbb9cc3dc4f None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:51.553578 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4eaed54-7997-412c-b38b-d623e8b2755e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:51.554217 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4eaed54-7997-412c-b38b-d623e8b2755e None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:51.554489 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4eaed54-7997-412c-b38b-d623e8b2755e None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:51.554757 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4eaed54-7997-412c-b38b-d623e8b2755e None admin] PATH_INFO: `/v3/domains` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:51.555520 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4eaed54-7997-412c-b38b-d623e8b2755e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:42:51.555821 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4eaed54-7997-412c-b38b-d623e8b2755e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:51.557256 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4eaed54-7997-412c-b38b-d623e8b2755e None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:51.570864 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 356/692] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Oct 9 00:42:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:42:51.576545 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b86d278-0cfd-45f2-9df2-d59e5d149c6c None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:51.685581 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b86d278-0cfd-45f2-9df2-d59e5d149c6c None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:51.687125 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:51.731140 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3579e6cf-1308-4ac0-a37e-fe12c9e452bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:51.732224 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3579e6cf-1308-4ac0-a37e-fe12c9e452bd None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:51.732713 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3579e6cf-1308-4ac0-a37e-fe12c9e452bd None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:51.733175 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3579e6cf-1308-4ac0-a37e-fe12c9e452bd None admin] PATH_INFO: `/v3/projects/service` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:51.741976 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3579e6cf-1308-4ac0-a37e-fe12c9e452bd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:51.743864 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3579e6cf-1308-4ac0-a37e-fe12c9e452bd None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:51.756522 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application [None req-3579e6cf-1308-4ac0-a37e-fe12c9e452bd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 09 00:42:51.756522 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:42:51.756522 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:42:51.756522 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:42:51.756522 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:42:51.756522 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:42:51.756522 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:42:51.756522 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:42:51.756522 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:42:51.756522 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:42:51.756522 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:42:51.756522 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:42:51.756522 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 09 00:42:51.756522 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 09 00:42:51.756522 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 09 00:42:51.757450 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 09 00:42:51.757450 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:42:51.757450 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:42:51.757450 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:42:51.757450 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:42:51.757450 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:42:51.757450 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:42:51.757450 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:42:51.757450 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application with Lock( Oct 09 00:42:51.757450 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:42:51.757450 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:42:51.757450 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:42:51.757450 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:42:51.757450 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:42:51.757450 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:42:51.757450 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:42:51.757450 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:42:51.758378 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 09 00:42:51.758378 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 09 00:42:51.758378 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 09 00:42:51.758378 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 09 00:42:51.758378 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 09 00:42:51.758378 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 09 00:42:51.758378 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 09 00:42:51.758378 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application Oct 09 00:42:51.760799 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 337/693] 10.222.0.15 () {56 vars in 1111 bytes} [Sun Oct 9 00:42:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 09 00:42:51.766783 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4eaed54-7997-412c-b38b-d623e8b2755e None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:51.797478 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:51.881348 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4eaed54-7997-412c-b38b-d623e8b2755e None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:51.929471 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8ec6f5-4625-4bca-ac0d-bdfa9b0a9415 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:51.930551 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8ec6f5-4625-4bca-ac0d-bdfa9b0a9415 None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:51.931123 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8ec6f5-4625-4bca-ac0d-bdfa9b0a9415 None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:51.931616 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8ec6f5-4625-4bca-ac0d-bdfa9b0a9415 None admin] PATH_INFO: `/v3/projects` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:51.932538 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8ec6f5-4625-4bca-ac0d-bdfa9b0a9415 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:42:51.933054 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8ec6f5-4625-4bca-ac0d-bdfa9b0a9415 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:51.934740 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8ec6f5-4625-4bca-ac0d-bdfa9b0a9415 None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:51.951469 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 357/694] 10.222.0.15 () {56 vars in 1148 bytes} [Sun Oct 9 00:42:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:42:51.957814 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3579e6cf-1308-4ac0-a37e-fe12c9e452bd None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:52.105568 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3579e6cf-1308-4ac0-a37e-fe12c9e452bd None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:52.159484 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7cb43a-9377-406b-aefb-a6b351ee7ed5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:52.160177 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7cb43a-9377-406b-aefb-a6b351ee7ed5 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:52.160458 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7cb43a-9377-406b-aefb-a6b351ee7ed5 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:52.160731 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7cb43a-9377-406b-aefb-a6b351ee7ed5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:52.161502 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7cb43a-9377-406b-aefb-a6b351ee7ed5 None admin] RBAC: Adding query filter params (role.id=6fe3faf520bd402f9bd78d3ed08eec34, scope.project.id=f148d39ced534860abfbe8fc3f98ace4, user.id=c4c467943b8f4d31a2f067ca6ed3b25c) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:42:52.161806 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7cb43a-9377-406b-aefb-a6b351ee7ed5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:52.163455 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7cb43a-9377-406b-aefb-a6b351ee7ed5 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:52.170897 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 338/695] 10.222.0.15 () {56 vars in 1374 bytes} [Sun Oct 9 00:42:51 2022] GET /identity/v3/role_assignments?user.id=c4c467943b8f4d31a2f067ca6ed3b25c&scope.project.id=f148d39ced534860abfbe8fc3f98ace4&role.id=6fe3faf520bd402f9bd78d3ed08eec34 => generated 608 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:42:52.619780 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893b1f95-d01a-49cc-a969-0adb2314d36a None None] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:52.620305 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893b1f95-d01a-49cc-a969-0adb2314d36a None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:52.620414 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893b1f95-d01a-49cc-a969-0adb2314d36a None None] PATH_INFO: `/` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:52.622075 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 358/696] 10.222.0.15 () {54 vars in 927 bytes} [Sun Oct 9 00:42:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:42:52.628106 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7616b465-27ab-48ee-a378-2eefc7f2341d None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:52.628618 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7616b465-27ab-48ee-a378-2eefc7f2341d None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:52.628618 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7616b465-27ab-48ee-a378-2eefc7f2341d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:52.648191 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-7616b465-27ab-48ee-a378-2eefc7f2341d None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:42:52.649542 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-7616b465-27ab-48ee-a378-2eefc7f2341d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:42:52.672495 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:52.689409 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676b38c2-7e94-4060-9eee-ddcafa8ed74f None None] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:52.689726 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676b38c2-7e94-4060-9eee-ddcafa8ed74f None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:52.689940 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676b38c2-7e94-4060-9eee-ddcafa8ed74f None None] PATH_INFO: `/` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:52.691721 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 359/697] 10.222.0.15 () {54 vars in 927 bytes} [Sun Oct 9 00:42:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:42:52.697358 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e126855-1727-4e39-9608-df3746c16e7b None None] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:52.697594 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e126855-1727-4e39-9608-df3746c16e7b None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:52.697836 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e126855-1727-4e39-9608-df3746c16e7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:52.718457 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.auth.core [None req-6e126855-1727-4e39-9608-df3746c16e7b None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:42:52.719783 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-6e126855-1727-4e39-9608-df3746c16e7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:42:52.729866 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 339/698] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Oct 9 00:42:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 09 00:42:52.792238 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 360/699] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Oct 9 00:42:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 09 00:42:53.020027 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7616b465-27ab-48ee-a378-2eefc7f2341d None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:53.040877 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88be49cc-7847-4efa-a31b-480700e70577 None None] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:53.041574 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88be49cc-7847-4efa-a31b-480700e70577 None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:53.042039 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88be49cc-7847-4efa-a31b-480700e70577 None None] PATH_INFO: `/` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:53.044106 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 361/700] 10.222.0.15 () {54 vars in 927 bytes} [Sun Oct 9 00:42:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:42:53.050353 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f394ce5e-24f0-4e5d-9742-b073fac3fedf None None] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:53.051085 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f394ce5e-24f0-4e5d-9742-b073fac3fedf None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:53.051671 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f394ce5e-24f0-4e5d-9742-b073fac3fedf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:53.071438 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.auth.core [None req-f394ce5e-24f0-4e5d-9742-b073fac3fedf None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:42:53.072980 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-f394ce5e-24f0-4e5d-9742-b073fac3fedf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:42:53.088263 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:53.150466 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 362/701] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Oct 9 00:42:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 09 00:42:53.157773 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f394ce5e-24f0-4e5d-9742-b073fac3fedf None None] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:53.178663 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7616b465-27ab-48ee-a378-2eefc7f2341d None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:53.254843 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6994ce3f-22a9-4d0d-b55b-a6a1cfeec153 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:53.255548 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6994ce3f-22a9-4d0d-b55b-a6a1cfeec153 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:53.255821 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6994ce3f-22a9-4d0d-b55b-a6a1cfeec153 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:53.256090 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6994ce3f-22a9-4d0d-b55b-a6a1cfeec153 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:53.279507 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6994ce3f-22a9-4d0d-b55b-a6a1cfeec153 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 09 00:42:53.285061 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application [None req-6994ce3f-22a9-4d0d-b55b-a6a1cfeec153 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 09 00:42:53.285061 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:42:53.285061 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:42:53.285061 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:42:53.285061 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:42:53.285061 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:42:53.285061 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:42:53.285061 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:42:53.285061 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:42:53.285061 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:42:53.285061 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:42:53.285061 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:42:53.285061 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 09 00:42:53.285061 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 09 00:42:53.285061 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 09 00:42:53.285061 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 09 00:42:53.286114 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 09 00:42:53.286114 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 09 00:42:53.286114 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 09 00:42:53.286114 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 09 00:42:53.286114 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:42:53.286114 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:42:53.286114 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:42:53.286114 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:42:53.286114 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:42:53.286114 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:42:53.286114 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:42:53.286114 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application with Lock( Oct 09 00:42:53.286114 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:42:53.286114 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:42:53.286114 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:42:53.286114 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:42:53.286973 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:42:53.286973 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:42:53.286973 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:42:53.286973 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:42:53.286973 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 09 00:42:53.286973 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 09 00:42:53.286973 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 09 00:42:53.286973 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 09 00:42:53.286973 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 09 00:42:53.286973 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 09 00:42:53.286973 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 09 00:42:53.286973 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application Oct 09 00:42:53.286973 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 340/702] 10.222.0.15 () {56 vars in 1096 bytes} [Sun Oct 9 00:42:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:42:53.301387 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6994ce3f-22a9-4d0d-b55b-a6a1cfeec153 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:53.340803 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:53.363681 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f394ce5e-24f0-4e5d-9742-b073fac3fedf None None] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:53.429260 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1934410d-9650-4c86-988c-4b8bfdd25674 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:53.429924 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1934410d-9650-4c86-988c-4b8bfdd25674 None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:53.430203 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1934410d-9650-4c86-988c-4b8bfdd25674 None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:53.430471 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1934410d-9650-4c86-988c-4b8bfdd25674 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:53.431063 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1934410d-9650-4c86-988c-4b8bfdd25674 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:53.432481 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1934410d-9650-4c86-988c-4b8bfdd25674 None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:53.452760 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application [None req-1934410d-9650-4c86-988c-4b8bfdd25674 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 09 00:42:53.452760 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:42:53.452760 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 09 00:42:53.452760 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 09 00:42:53.452760 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 09 00:42:53.452760 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 09 00:42:53.452760 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 09 00:42:53.452760 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 09 00:42:53.452760 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 09 00:42:53.452760 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Oct 09 00:42:53.452760 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 09 00:42:53.452760 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Oct 09 00:42:53.452760 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:42:53.452760 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:42:53.452760 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:42:53.452760 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:42:53.452760 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:42:53.453819 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:42:53.453819 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:42:53.453819 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:42:53.453819 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:42:53.453819 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:42:53.453819 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:42:53.453819 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 09 00:42:53.453819 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 09 00:42:53.453819 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 09 00:42:53.453819 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 09 00:42:53.453819 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:42:53.453819 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:42:53.453819 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:42:53.453819 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:42:53.453819 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:42:53.453819 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:42:53.454653 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:42:53.454653 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application with Lock( Oct 09 00:42:53.454653 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:42:53.454653 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:42:53.454653 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:42:53.454653 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:42:53.454653 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:42:53.454653 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:42:53.454653 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:42:53.454653 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:42:53.454653 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 09 00:42:53.454653 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 09 00:42:53.454653 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 09 00:42:53.454653 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Oct 09 00:42:53.454653 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 363/703] 10.222.0.15 () {56 vars in 1129 bytes} [Sun Oct 9 00:42:53 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 09 00:42:53.455995 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1934410d-9650-4c86-988c-4b8bfdd25674 None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:53.471198 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6994ce3f-22a9-4d0d-b55b-a6a1cfeec153 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:53.475648 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:53.509278 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e85deb7-64c9-4e45-ae95-a9fe801170ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:53.509891 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e85deb7-64c9-4e45-ae95-a9fe801170ea None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:53.510167 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e85deb7-64c9-4e45-ae95-a9fe801170ea None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:53.510437 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e85deb7-64c9-4e45-ae95-a9fe801170ea None admin] PATH_INFO: `/v3/roles` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:53.511108 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e85deb7-64c9-4e45-ae95-a9fe801170ea None admin] RBAC: Adding query filter params (name=admin) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:42:53.511466 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e85deb7-64c9-4e45-ae95-a9fe801170ea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:53.512869 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e85deb7-64c9-4e45-ae95-a9fe801170ea None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:53.526278 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 341/704] 10.222.0.15 () {56 vars in 1099 bytes} [Sun Oct 9 00:42:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 09 00:42:53.526278 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e85deb7-64c9-4e45-ae95-a9fe801170ea None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:53.569376 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1934410d-9650-4c86-988c-4b8bfdd25674 None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:53.605089 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febdf7e8-56e7-479b-aa58-d2ec31fee61c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:53.606202 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febdf7e8-56e7-479b-aa58-d2ec31fee61c None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:53.606686 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febdf7e8-56e7-479b-aa58-d2ec31fee61c None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:53.607145 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febdf7e8-56e7-479b-aa58-d2ec31fee61c None admin] PATH_INFO: `/v3/services/network` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:53.607942 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febdf7e8-56e7-479b-aa58-d2ec31fee61c None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:53.609831 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:53.610171 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febdf7e8-56e7-479b-aa58-d2ec31fee61c None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:53.622233 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application [None req-febdf7e8-56e7-479b-aa58-d2ec31fee61c None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 09 00:42:53.622233 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:42:53.622233 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 09 00:42:53.622233 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 09 00:42:53.622233 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 09 00:42:53.622233 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 09 00:42:53.622233 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 09 00:42:53.622233 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 09 00:42:53.622233 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 09 00:42:53.622233 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Oct 09 00:42:53.622233 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 09 00:42:53.622233 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Oct 09 00:42:53.622233 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:42:53.622233 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:42:53.622233 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:42:53.622233 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:42:53.622233 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:42:53.624111 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:42:53.624111 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:42:53.624111 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:42:53.624111 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:42:53.624111 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:42:53.624111 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:42:53.624111 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 09 00:42:53.624111 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 09 00:42:53.624111 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 09 00:42:53.624111 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 09 00:42:53.624111 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:42:53.624111 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:42:53.624111 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:42:53.624111 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:42:53.624111 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:42:53.624111 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:42:53.624947 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:42:53.624947 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application with Lock( Oct 09 00:42:53.624947 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:42:53.624947 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:42:53.624947 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:42:53.624947 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:42:53.624947 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:42:53.624947 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:42:53.624947 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:42:53.624947 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:42:53.624947 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 09 00:42:53.624947 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 09 00:42:53.624947 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 09 00:42:53.624947 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Oct 09 00:42:53.632691 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 364/705] 10.222.0.15 () {56 vars in 1111 bytes} [Sun Oct 9 00:42:53 2022] GET /identity/v3/services/network => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:42:53.632970 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e85deb7-64c9-4e45-ae95-a9fe801170ea None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:53.634422 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febdf7e8-56e7-479b-aa58-d2ec31fee61c None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:53.670091 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97911847-6b94-444e-9cdf-9bb19ae1c3dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:53.670899 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97911847-6b94-444e-9cdf-9bb19ae1c3dd None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:53.671291 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97911847-6b94-444e-9cdf-9bb19ae1c3dd None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:53.671664 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97911847-6b94-444e-9cdf-9bb19ae1c3dd None admin] PATH_INFO: `/v3/services` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:53.672408 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97911847-6b94-444e-9cdf-9bb19ae1c3dd None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:42:53.672823 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97911847-6b94-444e-9cdf-9bb19ae1c3dd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:53.674279 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97911847-6b94-444e-9cdf-9bb19ae1c3dd None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:53.683659 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 342/706] 10.222.0.15 () {56 vars in 1124 bytes} [Sun Oct 9 00:42:53 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:42:53.683659 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97911847-6b94-444e-9cdf-9bb19ae1c3dd None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:53.723831 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:53.753575 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febdf7e8-56e7-479b-aa58-d2ec31fee61c None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:53.794050 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97911847-6b94-444e-9cdf-9bb19ae1c3dd None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:53.796032 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02a2209-2f37-47fb-8582-30a11d414d59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:53.796678 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02a2209-2f37-47fb-8582-30a11d414d59 None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:53.796952 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02a2209-2f37-47fb-8582-30a11d414d59 None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:53.797217 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02a2209-2f37-47fb-8582-30a11d414d59 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:53.807733 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02a2209-2f37-47fb-8582-30a11d414d59 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:53.809280 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02a2209-2f37-47fb-8582-30a11d414d59 None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:53.825619 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application [None req-f02a2209-2f37-47fb-8582-30a11d414d59 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:42:53.825619 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:42:53.825619 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:42:53.825619 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:42:53.825619 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:42:53.825619 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:42:53.825619 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:42:53.825619 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:42:53.825619 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:42:53.825619 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:42:53.825619 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:42:53.825619 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:42:53.825619 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 09 00:42:53.825619 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 09 00:42:53.825619 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 09 00:42:53.825619 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 09 00:42:53.826599 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:42:53.826599 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:42:53.826599 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:42:53.826599 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:42:53.826599 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:42:53.826599 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:42:53.826599 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:42:53.826599 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application with Lock( Oct 09 00:42:53.826599 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:42:53.826599 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:42:53.826599 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:42:53.826599 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:42:53.826599 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:42:53.826599 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:42:53.826599 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:42:53.826599 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:42:53.826599 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 09 00:42:53.827520 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 09 00:42:53.827520 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:42:53.827520 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Oct 09 00:42:53.827520 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 365/707] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Oct 9 00:42:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:42:53.827784 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02a2209-2f37-47fb-8582-30a11d414d59 None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:53.838013 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0c7f39-16b5-4c7e-8b90-592c6070cdf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:53.839156 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0c7f39-16b5-4c7e-8b90-592c6070cdf2 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:53.839663 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0c7f39-16b5-4c7e-8b90-592c6070cdf2 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:53.840121 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0c7f39-16b5-4c7e-8b90-592c6070cdf2 None admin] PATH_INFO: `/v3/services` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:53.840968 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0c7f39-16b5-4c7e-8b90-592c6070cdf2 None admin] RBAC: Adding query filter params (name=network) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:42:53.841688 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0c7f39-16b5-4c7e-8b90-592c6070cdf2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:53.843422 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0c7f39-16b5-4c7e-8b90-592c6070cdf2 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:53.854498 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 343/708] 10.222.0.15 () {56 vars in 1112 bytes} [Sun Oct 9 00:42:53 2022] GET /identity/v3/services?name=network => generated 124 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:42:53.855997 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0c7f39-16b5-4c7e-8b90-592c6070cdf2 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:53.867883 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:53.934294 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02a2209-2f37-47fb-8582-30a11d414d59 None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:53.967506 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:53.978239 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107a580a-d0aa-43f1-9f4b-1fca5297323f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:53.978891 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107a580a-d0aa-43f1-9f4b-1fca5297323f None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:53.979288 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107a580a-d0aa-43f1-9f4b-1fca5297323f None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:53.979465 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107a580a-d0aa-43f1-9f4b-1fca5297323f None admin] PATH_INFO: `/v3/services` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:53.980097 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107a580a-d0aa-43f1-9f4b-1fca5297323f None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:42:53.980396 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107a580a-d0aa-43f1-9f4b-1fca5297323f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:53.981793 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107a580a-d0aa-43f1-9f4b-1fca5297323f None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:53.995293 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 366/709] 10.222.0.15 () {56 vars in 1124 bytes} [Sun Oct 9 00:42:53 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:42:53.995293 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107a580a-d0aa-43f1-9f4b-1fca5297323f None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:54.005390 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0c7f39-16b5-4c7e-8b90-592c6070cdf2 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:54.081847 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e361d0-af60-4a9c-81bd-3628176eda30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:54.082443 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e361d0-af60-4a9c-81bd-3628176eda30 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:54.082718 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e361d0-af60-4a9c-81bd-3628176eda30 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:54.083034 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e361d0-af60-4a9c-81bd-3628176eda30 None admin] PATH_INFO: `/v3/domains` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:54.083738 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e361d0-af60-4a9c-81bd-3628176eda30 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:42:54.084039 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e361d0-af60-4a9c-81bd-3628176eda30 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:54.085437 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e361d0-af60-4a9c-81bd-3628176eda30 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:54.108455 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 344/710] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Oct 9 00:42:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:42:54.114855 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e361d0-af60-4a9c-81bd-3628176eda30 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:54.203747 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107a580a-d0aa-43f1-9f4b-1fca5297323f None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:54.219390 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:54.253916 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adcca46-ef9d-4793-9a1e-7db47ac85fe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:54.254142 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adcca46-ef9d-4793-9a1e-7db47ac85fe2 None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:54.254382 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adcca46-ef9d-4793-9a1e-7db47ac85fe2 None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:54.254652 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adcca46-ef9d-4793-9a1e-7db47ac85fe2 None admin] PATH_INFO: `/v3/services` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:54.257114 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2adcca46-ef9d-4793-9a1e-7db47ac85fe2 None admin] RBAC: Adding query filter params (type=network) {{(pid=81525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:42:54.257114 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2adcca46-ef9d-4793-9a1e-7db47ac85fe2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:54.257114 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2adcca46-ef9d-4793-9a1e-7db47ac85fe2 None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:54.263787 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 367/711] 10.222.0.15 () {56 vars in 1112 bytes} [Sun Oct 9 00:42:53 2022] GET /identity/v3/services?type=network => generated 124 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:42:54.265024 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832fa0cb-8839-4a29-911c-da7a274132e0 None None] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:54.265306 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832fa0cb-8839-4a29-911c-da7a274132e0 None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:54.265582 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832fa0cb-8839-4a29-911c-da7a274132e0 None None] PATH_INFO: `/` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:54.268162 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e361d0-af60-4a9c-81bd-3628176eda30 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:54.275477 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 368/712] 10.222.0.15 () {54 vars in 927 bytes} [Sun Oct 9 00:42:54 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:42:54.281811 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f701e7f1-a24a-40b8-980d-4598dde52da1 None None] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:54.282656 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f701e7f1-a24a-40b8-980d-4598dde52da1 None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:54.283097 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f701e7f1-a24a-40b8-980d-4598dde52da1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:54.328416 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.auth.core [None req-f701e7f1-a24a-40b8-980d-4598dde52da1 None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:42:54.329642 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-f701e7f1-a24a-40b8-980d-4598dde52da1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:42:54.334525 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4181681c-9329-435a-9218-c1035740229f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:54.335110 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4181681c-9329-435a-9218-c1035740229f None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:54.335453 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4181681c-9329-435a-9218-c1035740229f None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:54.335730 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4181681c-9329-435a-9218-c1035740229f None admin] PATH_INFO: `/v3/users/nova` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:54.353171 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4181681c-9329-435a-9218-c1035740229f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:54.354686 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4181681c-9329-435a-9218-c1035740229f None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:54.374992 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application [None req-4181681c-9329-435a-9218-c1035740229f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 09 00:42:54.374992 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:42:54.374992 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:42:54.374992 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:42:54.374992 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:42:54.374992 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:42:54.374992 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:42:54.374992 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:42:54.374992 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:42:54.374992 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:42:54.374992 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:42:54.374992 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:42:54.374992 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 09 00:42:54.374992 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 09 00:42:54.374992 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 09 00:42:54.374992 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 09 00:42:54.376016 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:42:54.376016 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:42:54.376016 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 09 00:42:54.376016 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 09 00:42:54.376016 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 09 00:42:54.376016 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 09 00:42:54.376016 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:42:54.376016 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:42:54.376016 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:42:54.376016 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:42:54.376016 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:42:54.376016 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application with Lock( Oct 09 00:42:54.376016 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:42:54.376016 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:42:54.376016 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:42:54.376016 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:42:54.376016 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:42:54.376016 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:42:54.376946 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:42:54.376946 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:42:54.376946 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 09 00:42:54.376946 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 09 00:42:54.376946 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 09 00:42:54.376946 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 09 00:42:54.376946 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 09 00:42:54.376946 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 09 00:42:54.376946 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 09 00:42:54.376946 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application Oct 09 00:42:54.376946 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 345/713] 10.222.0.15 () {56 vars in 1093 bytes} [Sun Oct 9 00:42:54 2022] GET /identity/v3/users/nova => generated 82 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:42:54.384704 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4181681c-9329-435a-9218-c1035740229f None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:54.462061 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:54.501514 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 369/714] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Oct 9 00:42:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 09 00:42:54.570783 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4181681c-9329-435a-9218-c1035740229f None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:54.600761 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:54.611529 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771febeb-41b2-48d2-a595-bbeea8acdcee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:54.612201 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771febeb-41b2-48d2-a595-bbeea8acdcee None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:54.612644 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771febeb-41b2-48d2-a595-bbeea8acdcee None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:54.613058 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771febeb-41b2-48d2-a595-bbeea8acdcee None admin] PATH_INFO: `/v3/users` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:54.614343 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771febeb-41b2-48d2-a595-bbeea8acdcee None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:42:54.614862 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771febeb-41b2-48d2-a595-bbeea8acdcee None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:54.616872 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771febeb-41b2-48d2-a595-bbeea8acdcee None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:54.644578 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 346/715] 10.222.0.15 () {56 vars in 1133 bytes} [Sun Oct 9 00:42:54 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:42:54.650927 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f701e7f1-a24a-40b8-980d-4598dde52da1 None None] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:54.812993 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f701e7f1-a24a-40b8-980d-4598dde52da1 None None] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:54.822272 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771febeb-41b2-48d2-a595-bbeea8acdcee None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:54.880528 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a5eba1-76c8-42b9-ba77-8dc47e0c2dd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:54.881061 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a5eba1-76c8-42b9-ba77-8dc47e0c2dd5 None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:54.881332 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a5eba1-76c8-42b9-ba77-8dc47e0c2dd5 None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:54.881595 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a5eba1-76c8-42b9-ba77-8dc47e0c2dd5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:54.985930 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771febeb-41b2-48d2-a595-bbeea8acdcee None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:55.009106 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:55.044864 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f8f951-3845-454c-ac92-9e5b10f5a946 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:55.045914 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f8f951-3845-454c-ac92-9e5b10f5a946 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:55.046343 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f8f951-3845-454c-ac92-9e5b10f5a946 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:55.046774 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f8f951-3845-454c-ac92-9e5b10f5a946 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:55.057589 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a5eba1-76c8-42b9-ba77-8dc47e0c2dd5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:55.060208 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a5eba1-76c8-42b9-ba77-8dc47e0c2dd5 None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:55.067977 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f8f951-3845-454c-ac92-9e5b10f5a946 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 09 00:42:55.077892 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application [None req-44f8f951-3845-454c-ac92-9e5b10f5a946 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 09 00:42:55.077892 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:42:55.077892 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:42:55.077892 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:42:55.077892 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:42:55.077892 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:42:55.077892 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:42:55.077892 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:42:55.077892 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:42:55.077892 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:42:55.077892 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:42:55.077892 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:42:55.077892 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 09 00:42:55.077892 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 09 00:42:55.077892 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 09 00:42:55.077892 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 09 00:42:55.078862 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 09 00:42:55.078862 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 09 00:42:55.078862 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 09 00:42:55.078862 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 09 00:42:55.078862 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:42:55.078862 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:42:55.078862 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:42:55.078862 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:42:55.078862 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:42:55.078862 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:42:55.078862 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:42:55.078862 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application with Lock( Oct 09 00:42:55.078862 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:42:55.078862 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:42:55.078862 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:42:55.078862 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:42:55.079722 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:42:55.079722 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:42:55.079722 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:42:55.079722 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:42:55.079722 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 09 00:42:55.079722 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 09 00:42:55.079722 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 09 00:42:55.079722 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 09 00:42:55.079722 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 09 00:42:55.079722 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 09 00:42:55.079722 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 09 00:42:55.079722 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application Oct 09 00:42:55.082717 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 347/716] 10.222.0.15 () {56 vars in 1102 bytes} [Sun Oct 9 00:42:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:42:55.085079 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f8f951-3845-454c-ac92-9e5b10f5a946 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:55.194051 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:55.256114 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 370/717] 10.222.0.15 () {58 vars in 1282 bytes} [Sun Oct 9 00:42:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 606 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 09 00:42:55.257418 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dadb374-a35e-421a-a778-769d82c6af31 None None] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:55.257704 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dadb374-a35e-421a-a778-769d82c6af31 None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:55.258037 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dadb374-a35e-421a-a778-769d82c6af31 None None] PATH_INFO: `/` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:55.260945 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 371/718] 10.222.0.15 () {54 vars in 927 bytes} [Sun Oct 9 00:42:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:42:55.262470 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dadb374-a35e-421a-a778-769d82c6af31 None None] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:55.290964 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f8f951-3845-454c-ac92-9e5b10f5a946 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:55.328607 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3fe887-9fb5-4b6e-8b74-3cea0248a89e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:55.329593 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3fe887-9fb5-4b6e-8b74-3cea0248a89e None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:55.330248 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3fe887-9fb5-4b6e-8b74-3cea0248a89e None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:55.330712 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3fe887-9fb5-4b6e-8b74-3cea0248a89e None admin] PATH_INFO: `/v3/roles` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:55.332014 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3fe887-9fb5-4b6e-8b74-3cea0248a89e None admin] RBAC: Adding query filter params (name=service) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:42:55.332543 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3fe887-9fb5-4b6e-8b74-3cea0248a89e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:55.334168 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3fe887-9fb5-4b6e-8b74-3cea0248a89e None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:55.355701 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 348/719] 10.222.0.15 () {56 vars in 1103 bytes} [Sun Oct 9 00:42:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 09 00:42:55.358211 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da955ce-167b-41db-baeb-65ec3db2af5d None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:55.358933 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da955ce-167b-41db-baeb-65ec3db2af5d None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:55.359705 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da955ce-167b-41db-baeb-65ec3db2af5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:55.369518 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:55.388503 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dadb374-a35e-421a-a778-769d82c6af31 None None] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:55.389391 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-7da955ce-167b-41db-baeb-65ec3db2af5d None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:42:55.390804 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-7da955ce-167b-41db-baeb-65ec3db2af5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:42:55.441463 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb5db71-f404-4a1c-b889-a1a9d00c3176 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:55.442342 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb5db71-f404-4a1c-b889-a1a9d00c3176 None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:55.442763 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb5db71-f404-4a1c-b889-a1a9d00c3176 None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:55.443175 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb5db71-f404-4a1c-b889-a1a9d00c3176 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:55.457176 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb5db71-f404-4a1c-b889-a1a9d00c3176 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:55.458923 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb5db71-f404-4a1c-b889-a1a9d00c3176 None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:55.480868 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application [None req-4bb5db71-f404-4a1c-b889-a1a9d00c3176 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:42:55.480868 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:42:55.480868 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:42:55.480868 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:42:55.480868 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:42:55.480868 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:42:55.480868 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:42:55.480868 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:42:55.480868 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:42:55.480868 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:42:55.480868 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:42:55.480868 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:42:55.480868 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 09 00:42:55.480868 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 09 00:42:55.480868 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 09 00:42:55.480868 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 09 00:42:55.481908 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:42:55.481908 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:42:55.481908 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:42:55.481908 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:42:55.481908 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:42:55.481908 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:42:55.481908 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:42:55.481908 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application with Lock( Oct 09 00:42:55.481908 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:42:55.481908 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:42:55.481908 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:42:55.481908 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:42:55.481908 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:42:55.481908 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:42:55.481908 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:42:55.481908 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:42:55.481908 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 09 00:42:55.482793 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 09 00:42:55.482793 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:42:55.482793 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Oct 09 00:42:55.489630 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 372/720] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Oct 9 00:42:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:42:55.489630 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb5db71-f404-4a1c-b889-a1a9d00c3176 None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:55.499179 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 349/721] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Oct 9 00:42:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 09 00:42:55.500568 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da955ce-167b-41db-baeb-65ec3db2af5d None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:55.536976 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:55.608740 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da955ce-167b-41db-baeb-65ec3db2af5d None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:55.663769 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb5db71-f404-4a1c-b889-a1a9d00c3176 None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:55.682370 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab180da-686e-47ae-a4e6-31b89ebbaed8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:55.683792 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab180da-686e-47ae-a4e6-31b89ebbaed8 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:55.684273 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab180da-686e-47ae-a4e6-31b89ebbaed8 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:55.684781 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab180da-686e-47ae-a4e6-31b89ebbaed8 None admin] PATH_INFO: `/v3/domains` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:55.685670 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab180da-686e-47ae-a4e6-31b89ebbaed8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:42:55.686190 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab180da-686e-47ae-a4e6-31b89ebbaed8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:55.687849 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab180da-686e-47ae-a4e6-31b89ebbaed8 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:55.721912 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 350/722] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Oct 9 00:42:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:42:55.724612 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab180da-686e-47ae-a4e6-31b89ebbaed8 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:55.751365 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d299afd-75a3-4c25-8963-6f1e6d1016f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:55.752461 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d299afd-75a3-4c25-8963-6f1e6d1016f7 None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:55.754576 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d299afd-75a3-4c25-8963-6f1e6d1016f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:55.755150 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d299afd-75a3-4c25-8963-6f1e6d1016f7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:55.771665 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:55.781473 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d299afd-75a3-4c25-8963-6f1e6d1016f7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:55.782968 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d299afd-75a3-4c25-8963-6f1e6d1016f7 None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:55.803246 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application [None req-4d299afd-75a3-4c25-8963-6f1e6d1016f7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:42:55.803246 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:42:55.803246 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:42:55.803246 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:42:55.803246 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:42:55.803246 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:42:55.803246 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:42:55.803246 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:42:55.803246 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:42:55.803246 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:42:55.803246 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:42:55.803246 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:42:55.803246 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 09 00:42:55.803246 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 09 00:42:55.803246 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 09 00:42:55.803246 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 09 00:42:55.804295 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:42:55.804295 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:42:55.804295 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:42:55.804295 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:42:55.804295 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:42:55.804295 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:42:55.804295 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:42:55.804295 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application with Lock( Oct 09 00:42:55.804295 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:42:55.804295 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:42:55.804295 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:42:55.804295 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:42:55.804295 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:42:55.804295 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:42:55.804295 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:42:55.804295 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:42:55.804295 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 09 00:42:55.805258 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 09 00:42:55.805258 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:42:55.805258 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Oct 09 00:42:55.805258 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 373/723] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Oct 9 00:42:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 319 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:42:55.812352 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d299afd-75a3-4c25-8963-6f1e6d1016f7 None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:55.871791 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:55.881948 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab180da-686e-47ae-a4e6-31b89ebbaed8 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:55.920400 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89581b5-884c-466a-9a86-4c0b83d9ba60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:55.921031 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89581b5-884c-466a-9a86-4c0b83d9ba60 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:55.921304 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89581b5-884c-466a-9a86-4c0b83d9ba60 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:55.921569 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89581b5-884c-466a-9a86-4c0b83d9ba60 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:55.928870 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89581b5-884c-466a-9a86-4c0b83d9ba60 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:55.930532 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89581b5-884c-466a-9a86-4c0b83d9ba60 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:55.944586 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d299afd-75a3-4c25-8963-6f1e6d1016f7 None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:55.944782 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application [None req-c89581b5-884c-466a-9a86-4c0b83d9ba60 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 09 00:42:55.944782 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:42:55.944782 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:42:55.944782 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:42:55.944782 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:42:55.944782 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:42:55.944782 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:42:55.944782 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:42:55.944782 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:42:55.944782 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:42:55.944782 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:42:55.944782 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:42:55.944782 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 09 00:42:55.944782 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 09 00:42:55.944782 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 09 00:42:55.945912 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 09 00:42:55.945912 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:42:55.945912 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:42:55.945912 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:42:55.945912 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:42:55.945912 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:42:55.945912 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:42:55.945912 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:42:55.945912 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application with Lock( Oct 09 00:42:55.945912 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:42:55.945912 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:42:55.945912 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:42:55.945912 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:42:55.945912 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:42:55.945912 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:42:55.945912 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:42:55.945912 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:42:55.946822 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 09 00:42:55.946822 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 09 00:42:55.946822 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 09 00:42:55.946822 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 09 00:42:55.946822 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 09 00:42:55.946822 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 09 00:42:55.946822 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 09 00:42:55.946822 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application Oct 09 00:42:55.946822 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 351/724] 10.222.0.15 () {56 vars in 1111 bytes} [Sun Oct 9 00:42:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 09 00:42:55.946822 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89581b5-884c-466a-9a86-4c0b83d9ba60 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:55.984905 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29140241-676e-40bb-943a-0c0cd1afedac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:55.985476 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29140241-676e-40bb-943a-0c0cd1afedac None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:55.985747 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29140241-676e-40bb-943a-0c0cd1afedac None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:55.986013 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29140241-676e-40bb-943a-0c0cd1afedac None admin] PATH_INFO: `/v3/domains` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:55.986654 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29140241-676e-40bb-943a-0c0cd1afedac None admin] RBAC: Adding query filter params (name=Default) {{(pid=81525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:42:55.986949 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29140241-676e-40bb-943a-0c0cd1afedac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:55.988436 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29140241-676e-40bb-943a-0c0cd1afedac None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:56.007355 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 374/725] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Oct 9 00:42:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:42:56.008334 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29140241-676e-40bb-943a-0c0cd1afedac None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:56.063071 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:56.074563 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89581b5-884c-466a-9a86-4c0b83d9ba60 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:56.115331 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb6ea75-ebe2-403e-9739-87bc1021d91c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:56.116646 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb6ea75-ebe2-403e-9739-87bc1021d91c None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:56.117748 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb6ea75-ebe2-403e-9739-87bc1021d91c None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:56.118523 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb6ea75-ebe2-403e-9739-87bc1021d91c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:56.127713 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29140241-676e-40bb-943a-0c0cd1afedac None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:56.139902 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb6ea75-ebe2-403e-9739-87bc1021d91c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 09 00:42:56.148285 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application [None req-dbb6ea75-ebe2-403e-9739-87bc1021d91c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 09 00:42:56.148285 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:42:56.148285 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:42:56.148285 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:42:56.148285 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:42:56.148285 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:42:56.148285 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:42:56.148285 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:42:56.148285 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:42:56.148285 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:42:56.148285 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:42:56.148285 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:42:56.148285 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 09 00:42:56.148285 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 09 00:42:56.148285 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 09 00:42:56.148285 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 09 00:42:56.149365 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 09 00:42:56.149365 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 09 00:42:56.149365 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 09 00:42:56.149365 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 09 00:42:56.149365 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:42:56.149365 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:42:56.149365 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:42:56.149365 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:42:56.149365 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:42:56.149365 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:42:56.149365 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:42:56.149365 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application with Lock( Oct 09 00:42:56.149365 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:42:56.149365 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:42:56.149365 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:42:56.149365 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:42:56.150192 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:42:56.150192 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:42:56.150192 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:42:56.150192 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:42:56.150192 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 09 00:42:56.150192 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 09 00:42:56.150192 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 09 00:42:56.150192 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 09 00:42:56.150192 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 09 00:42:56.150192 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 09 00:42:56.150192 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 09 00:42:56.150192 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application Oct 09 00:42:56.157465 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 352/726] 10.222.0.15 () {56 vars in 1096 bytes} [Sun Oct 9 00:42:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:42:56.157465 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb6ea75-ebe2-403e-9739-87bc1021d91c None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:56.173130 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98f7bb7-acdb-4a10-bf41-2bc23cdd5fe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:56.173813 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98f7bb7-acdb-4a10-bf41-2bc23cdd5fe1 None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:56.174087 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98f7bb7-acdb-4a10-bf41-2bc23cdd5fe1 None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:56.174356 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98f7bb7-acdb-4a10-bf41-2bc23cdd5fe1 None admin] PATH_INFO: `/v3/projects` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:56.175106 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98f7bb7-acdb-4a10-bf41-2bc23cdd5fe1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:42:56.175452 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98f7bb7-acdb-4a10-bf41-2bc23cdd5fe1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:56.177196 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98f7bb7-acdb-4a10-bf41-2bc23cdd5fe1 None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:56.180648 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:56.191270 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 375/727] 10.222.0.15 () {56 vars in 1148 bytes} [Sun Oct 9 00:42:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:42:56.192571 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98f7bb7-acdb-4a10-bf41-2bc23cdd5fe1 None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:56.286550 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb6ea75-ebe2-403e-9739-87bc1021d91c None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:56.299819 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98f7bb7-acdb-4a10-bf41-2bc23cdd5fe1 None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:56.311222 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:56.328066 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2970873-b4fa-4b7e-b4d0-209759afa1bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:56.328668 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2970873-b4fa-4b7e-b4d0-209759afa1bc None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:56.328935 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2970873-b4fa-4b7e-b4d0-209759afa1bc None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:56.329244 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2970873-b4fa-4b7e-b4d0-209759afa1bc None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:56.338486 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2970873-b4fa-4b7e-b4d0-209759afa1bc None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:56.340060 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2970873-b4fa-4b7e-b4d0-209759afa1bc None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:56.340808 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6db3d3-639d-46c1-8c4a-d4c9b5289a3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:56.341642 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6db3d3-639d-46c1-8c4a-d4c9b5289a3f None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:56.342285 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6db3d3-639d-46c1-8c4a-d4c9b5289a3f None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:56.342742 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6db3d3-639d-46c1-8c4a-d4c9b5289a3f None admin] PATH_INFO: `/v3/roles` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:56.344065 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6db3d3-639d-46c1-8c4a-d4c9b5289a3f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:42:56.344376 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6db3d3-639d-46c1-8c4a-d4c9b5289a3f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:56.345816 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6db3d3-639d-46c1-8c4a-d4c9b5289a3f None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:56.357002 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application [None req-d2970873-b4fa-4b7e-b4d0-209759afa1bc None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 09 00:42:56.357002 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:42:56.357002 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:42:56.357002 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:42:56.357002 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:42:56.357002 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:42:56.357002 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:42:56.357002 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:42:56.357002 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:42:56.357002 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:42:56.357002 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:42:56.357002 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:42:56.357002 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 09 00:42:56.357002 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 09 00:42:56.357002 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 09 00:42:56.357002 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 09 00:42:56.358000 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:42:56.358000 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:42:56.358000 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 09 00:42:56.358000 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 09 00:42:56.358000 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 09 00:42:56.358000 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 09 00:42:56.358000 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:42:56.358000 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:42:56.358000 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:42:56.358000 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:42:56.358000 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:42:56.358000 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application with Lock( Oct 09 00:42:56.358000 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:42:56.358000 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:42:56.358000 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:42:56.358000 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:42:56.358000 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:42:56.358000 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:42:56.358916 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:42:56.358916 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:42:56.358916 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 09 00:42:56.358916 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 09 00:42:56.358916 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 09 00:42:56.358916 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 09 00:42:56.358916 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 09 00:42:56.358916 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 09 00:42:56.358916 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 09 00:42:56.358916 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application Oct 09 00:42:56.361243 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 376/728] 10.222.0.15 () {56 vars in 1099 bytes} [Sun Oct 9 00:42:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:42:56.366218 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 353/729] 10.222.0.15 () {56 vars in 1117 bytes} [Sun Oct 9 00:42:56 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:42:56.366360 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6db3d3-639d-46c1-8c4a-d4c9b5289a3f None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:56.369011 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2970873-b4fa-4b7e-b4d0-209759afa1bc None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:56.469993 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:56.490492 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6db3d3-639d-46c1-8c4a-d4c9b5289a3f None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:56.498099 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2970873-b4fa-4b7e-b4d0-209759afa1bc None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:56.531970 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edd3b93-45bc-4a3f-a3cb-c668f1898871 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:56.533149 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edd3b93-45bc-4a3f-a3cb-c668f1898871 None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:56.533571 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edd3b93-45bc-4a3f-a3cb-c668f1898871 None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:56.534025 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edd3b93-45bc-4a3f-a3cb-c668f1898871 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:56.535599 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edd3b93-45bc-4a3f-a3cb-c668f1898871 None admin] RBAC: Adding query filter params (role.id=f69dddf26daf4dd79d4c962beb877af5, scope.project.id=f148d39ced534860abfbe8fc3f98ace4, user.id=4ac83d57fba841e0a666710732249c49) {{(pid=81525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:42:56.536063 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edd3b93-45bc-4a3f-a3cb-c668f1898871 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:56.538244 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edd3b93-45bc-4a3f-a3cb-c668f1898871 None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:56.543828 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe6128e-30b7-4193-8764-3ef912f22e67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:56.544603 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe6128e-30b7-4193-8764-3ef912f22e67 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:56.544976 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe6128e-30b7-4193-8764-3ef912f22e67 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:56.545349 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe6128e-30b7-4193-8764-3ef912f22e67 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:56.551504 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 377/730] 10.222.0.15 () {56 vars in 1374 bytes} [Sun Oct 9 00:42:56 2022] GET /identity/v3/role_assignments?user.id=4ac83d57fba841e0a666710732249c49&scope.project.id=f148d39ced534860abfbe8fc3f98ace4&role.id=f69dddf26daf4dd79d4c962beb877af5 => generated 259 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:42:56.551504 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edd3b93-45bc-4a3f-a3cb-c668f1898871 None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:56.567761 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe6128e-30b7-4193-8764-3ef912f22e67 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:56.569715 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe6128e-30b7-4193-8764-3ef912f22e67 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:56.591838 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:56.592350 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application [None req-6fe6128e-30b7-4193-8764-3ef912f22e67 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:42:56.592350 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:42:56.592350 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:42:56.592350 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:42:56.592350 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:42:56.592350 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:42:56.592350 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:42:56.592350 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:42:56.592350 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:42:56.592350 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:42:56.592350 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:42:56.592350 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:42:56.592350 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 09 00:42:56.592350 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 09 00:42:56.592350 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 09 00:42:56.592350 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 09 00:42:56.593250 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:42:56.593250 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:42:56.593250 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:42:56.593250 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:42:56.593250 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:42:56.593250 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:42:56.593250 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:42:56.593250 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application with Lock( Oct 09 00:42:56.593250 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:42:56.593250 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:42:56.593250 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:42:56.593250 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:42:56.593250 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:42:56.593250 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:42:56.593250 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:42:56.593250 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:42:56.593250 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 09 00:42:56.594158 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 09 00:42:56.594158 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:42:56.594158 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application Oct 09 00:42:56.594158 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 354/731] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Oct 9 00:42:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:42:56.599665 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e75dd2f-46da-4498-93f8-63815bbd8a50 None None] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:56.599994 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e75dd2f-46da-4498-93f8-63815bbd8a50 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:56.600249 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e75dd2f-46da-4498-93f8-63815bbd8a50 None None] PATH_INFO: `/` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:56.603971 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 355/732] 10.222.0.15 () {54 vars in 927 bytes} [Sun Oct 9 00:42:56 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:42:56.604871 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e75dd2f-46da-4498-93f8-63815bbd8a50 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:56.683424 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edd3b93-45bc-4a3f-a3cb-c668f1898871 None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:56.721688 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d40353-8e5d-476c-88c8-c3367379ad72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:56.722306 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d40353-8e5d-476c-88c8-c3367379ad72 None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:56.722587 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d40353-8e5d-476c-88c8-c3367379ad72 None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:56.722855 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d40353-8e5d-476c-88c8-c3367379ad72 None admin] PATH_INFO: `/v3/users` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:56.723640 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d40353-8e5d-476c-88c8-c3367379ad72 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:42:56.723939 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d40353-8e5d-476c-88c8-c3367379ad72 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:56.725456 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d40353-8e5d-476c-88c8-c3367379ad72 None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:56.736553 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e75dd2f-46da-4498-93f8-63815bbd8a50 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:56.746096 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 378/733] 10.222.0.15 () {56 vars in 1149 bytes} [Sun Oct 9 00:42:56 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:42:56.747810 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ba9102-f1ab-4c67-a1d6-d0f3a1449b54 None None] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:56.748086 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ba9102-f1ab-4c67-a1d6-d0f3a1449b54 None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:56.748685 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ba9102-f1ab-4c67-a1d6-d0f3a1449b54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:56.769549 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.auth.core [None req-a6ba9102-f1ab-4c67-a1d6-d0f3a1449b54 None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:42:56.770764 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-a6ba9102-f1ab-4c67-a1d6-d0f3a1449b54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:42:56.774454 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:56.784317 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ad4011-dc63-4ce6-bd80-66d9cd56f4a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:56.784944 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ad4011-dc63-4ce6-bd80-66d9cd56f4a3 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:56.785222 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ad4011-dc63-4ce6-bd80-66d9cd56f4a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:56.785494 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ad4011-dc63-4ce6-bd80-66d9cd56f4a3 None admin] PATH_INFO: `/v3/domains` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:56.786316 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ad4011-dc63-4ce6-bd80-66d9cd56f4a3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:42:56.787029 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ad4011-dc63-4ce6-bd80-66d9cd56f4a3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:56.788622 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ad4011-dc63-4ce6-bd80-66d9cd56f4a3 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:56.802283 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 356/734] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Oct 9 00:42:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:42:56.808389 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd3484c-97ef-4c21-87da-512ac9f2e82a None None] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:56.808727 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd3484c-97ef-4c21-87da-512ac9f2e82a None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:56.809008 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd3484c-97ef-4c21-87da-512ac9f2e82a None None] PATH_INFO: `/` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:56.810503 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 357/735] 10.222.0.15 () {54 vars in 927 bytes} [Sun Oct 9 00:42:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:42:56.811053 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd3484c-97ef-4c21-87da-512ac9f2e82a None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:56.859628 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 379/736] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Oct 9 00:42:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 09 00:42:56.860712 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ba9102-f1ab-4c67-a1d6-d0f3a1449b54 None None] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:56.886962 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:56.927142 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd3484c-97ef-4c21-87da-512ac9f2e82a None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:56.969711 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ba9102-f1ab-4c67-a1d6-d0f3a1449b54 None None] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:56.970224 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f528f0-b747-4de4-acdc-43ac4ec26400 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:56.970846 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f528f0-b747-4de4-acdc-43ac4ec26400 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:56.971120 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f528f0-b747-4de4-acdc-43ac4ec26400 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:56.971419 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f528f0-b747-4de4-acdc-43ac4ec26400 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:57.014145 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b6bdc7-1986-4cbc-b345-8adeb2c06860 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:57.015150 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b6bdc7-1986-4cbc-b345-8adeb2c06860 None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:57.015668 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b6bdc7-1986-4cbc-b345-8adeb2c06860 None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:57.016126 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b6bdc7-1986-4cbc-b345-8adeb2c06860 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:57.024386 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b6bdc7-1986-4cbc-b345-8adeb2c06860 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:57.026199 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b6bdc7-1986-4cbc-b345-8adeb2c06860 None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:57.039513 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application [None req-b8b6bdc7-1986-4cbc-b345-8adeb2c06860 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 09 00:42:57.039513 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:42:57.039513 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:42:57.039513 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:42:57.039513 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:42:57.039513 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:42:57.039513 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:42:57.039513 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:42:57.039513 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:42:57.039513 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:42:57.039513 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:42:57.039513 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:42:57.039513 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 09 00:42:57.039513 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 09 00:42:57.039513 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 09 00:42:57.039513 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 09 00:42:57.040479 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:42:57.040479 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:42:57.040479 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 09 00:42:57.040479 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 09 00:42:57.040479 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 09 00:42:57.040479 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 09 00:42:57.040479 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:42:57.040479 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:42:57.040479 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:42:57.040479 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:42:57.040479 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:42:57.040479 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application with Lock( Oct 09 00:42:57.040479 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:42:57.040479 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:42:57.040479 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:42:57.040479 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:42:57.040479 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:42:57.040479 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:42:57.041449 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:42:57.041449 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:42:57.041449 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 09 00:42:57.041449 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 09 00:42:57.041449 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 09 00:42:57.041449 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 09 00:42:57.041449 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 09 00:42:57.041449 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 09 00:42:57.041449 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 09 00:42:57.041449 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Oct 09 00:42:57.048402 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 380/737] 10.222.0.15 () {56 vars in 1096 bytes} [Sun Oct 9 00:42:56 2022] GET /identity/v3/users/swift => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:42:57.048556 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:57.050433 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa431d7-5500-4241-99fa-132975e56c94 None None] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:57.050951 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa431d7-5500-4241-99fa-132975e56c94 None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:57.051468 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa431d7-5500-4241-99fa-132975e56c94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:57.058451 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f528f0-b747-4de4-acdc-43ac4ec26400 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:57.061577 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f528f0-b747-4de4-acdc-43ac4ec26400 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:57.072253 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.auth.core [None req-6aa431d7-5500-4241-99fa-132975e56c94 None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:42:57.073822 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-6aa431d7-5500-4241-99fa-132975e56c94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:42:57.147115 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 381/738] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Oct 9 00:42:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 09 00:42:57.148384 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa431d7-5500-4241-99fa-132975e56c94 None None] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:57.166705 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:57.182956 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 358/739] 10.222.0.15 () {58 vars in 1282 bytes} [Sun Oct 9 00:42:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 09 00:42:57.184226 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f528f0-b747-4de4-acdc-43ac4ec26400 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:57.280231 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa431d7-5500-4241-99fa-132975e56c94 None None] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:57.287546 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:57.301042 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f528f0-b747-4de4-acdc-43ac4ec26400 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:57.331875 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f504774c-3f5f-4926-9f37-8e01e73b4d13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:57.332989 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f504774c-3f5f-4926-9f37-8e01e73b4d13 None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:57.333797 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f504774c-3f5f-4926-9f37-8e01e73b4d13 None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:57.334344 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f504774c-3f5f-4926-9f37-8e01e73b4d13 None admin] PATH_INFO: `/v3/users` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:57.335430 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f504774c-3f5f-4926-9f37-8e01e73b4d13 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:42:57.335880 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f504774c-3f5f-4926-9f37-8e01e73b4d13 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:57.337552 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f504774c-3f5f-4926-9f37-8e01e73b4d13 None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:57.338684 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbf9fcb-9b41-4962-b695-a28c2101bfa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:57.339451 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbf9fcb-9b41-4962-b695-a28c2101bfa3 None admin] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:57.339853 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbf9fcb-9b41-4962-b695-a28c2101bfa3 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:57.340193 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbf9fcb-9b41-4962-b695-a28c2101bfa3 None admin] PATH_INFO: `/v3/services` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:57.340956 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbf9fcb-9b41-4962-b695-a28c2101bfa3 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:57.342419 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbf9fcb-9b41-4962-b695-a28c2101bfa3 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:57.365044 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 382/740] 10.222.0.15 () {56 vars in 1135 bytes} [Sun Oct 9 00:42:57 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:42:57.366456 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f504774c-3f5f-4926-9f37-8e01e73b4d13 None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:57.371856 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 359/741] 10.222.0.15 () {60 vars in 1141 bytes} [Sun Oct 9 00:42:57 2022] POST /identity/v3/services => generated 251 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 09 00:42:57.372965 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbf9fcb-9b41-4962-b695-a28c2101bfa3 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:57.466648 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:57.505141 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f504774c-3f5f-4926-9f37-8e01e73b4d13 None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:57.553004 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e945f6cc-f9b2-454c-b5d7-7d6b57c88056 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:57.554602 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e945f6cc-f9b2-454c-b5d7-7d6b57c88056 None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:57.555437 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e945f6cc-f9b2-454c-b5d7-7d6b57c88056 None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:57.555908 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e945f6cc-f9b2-454c-b5d7-7d6b57c88056 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:57.566589 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbf9fcb-9b41-4962-b695-a28c2101bfa3 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:57.577013 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e945f6cc-f9b2-454c-b5d7-7d6b57c88056 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:57.579346 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e945f6cc-f9b2-454c-b5d7-7d6b57c88056 None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:57.603160 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application [None req-e945f6cc-f9b2-454c-b5d7-7d6b57c88056 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:42:57.603160 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:42:57.603160 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:42:57.603160 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:42:57.603160 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:42:57.603160 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:42:57.603160 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:42:57.603160 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:42:57.603160 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:42:57.603160 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:42:57.603160 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:42:57.603160 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:42:57.603160 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 09 00:42:57.603160 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 09 00:42:57.603160 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 09 00:42:57.603160 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 09 00:42:57.604220 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:42:57.604220 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:42:57.604220 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:42:57.604220 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:42:57.604220 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:42:57.604220 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:42:57.604220 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:42:57.604220 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application with Lock( Oct 09 00:42:57.604220 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:42:57.604220 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:42:57.604220 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:42:57.604220 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:42:57.604220 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:42:57.604220 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:42:57.604220 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:42:57.604220 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:42:57.604220 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 09 00:42:57.605620 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 09 00:42:57.605620 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:42:57.605620 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Oct 09 00:42:57.605620 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 383/742] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Oct 9 00:42:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:42:57.605620 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e945f6cc-f9b2-454c-b5d7-7d6b57c88056 None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:57.622649 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017721d5-2c5a-4c46-92b0-cdc9ed372e57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:57.623637 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017721d5-2c5a-4c46-92b0-cdc9ed372e57 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:57.623913 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017721d5-2c5a-4c46-92b0-cdc9ed372e57 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:57.624180 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017721d5-2c5a-4c46-92b0-cdc9ed372e57 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:57.644008 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:57.713412 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017721d5-2c5a-4c46-92b0-cdc9ed372e57 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:57.715046 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017721d5-2c5a-4c46-92b0-cdc9ed372e57 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:57.728696 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e945f6cc-f9b2-454c-b5d7-7d6b57c88056 None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:57.760491 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:57.776967 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d311bb-cd86-4360-accc-96cafc49072b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:57.777788 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d311bb-cd86-4360-accc-96cafc49072b None admin] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:57.778159 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d311bb-cd86-4360-accc-96cafc49072b None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:57.778434 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d311bb-cd86-4360-accc-96cafc49072b None admin] PATH_INFO: `/v3/services` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:57.779103 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d311bb-cd86-4360-accc-96cafc49072b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:57.780701 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d311bb-cd86-4360-accc-96cafc49072b None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:57.799341 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 384/743] 10.222.0.15 () {60 vars in 1141 bytes} [Sun Oct 9 00:42:57 2022] POST /identity/v3/services => generated 240 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 09 00:42:57.800369 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d311bb-cd86-4360-accc-96cafc49072b None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:57.850279 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 360/744] 10.222.0.15 () {58 vars in 1282 bytes} [Sun Oct 9 00:42:57 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 478 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 09 00:42:57.856663 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017721d5-2c5a-4c46-92b0-cdc9ed372e57 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:57.926567 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d311bb-cd86-4360-accc-96cafc49072b None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:57.971858 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e6eef8-9554-42e7-a077-fec17f5e2f01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:57.971858 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e6eef8-9554-42e7-a077-fec17f5e2f01 None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:57.971858 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e6eef8-9554-42e7-a077-fec17f5e2f01 None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:57.971858 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e6eef8-9554-42e7-a077-fec17f5e2f01 None admin] PATH_INFO: `/v3/domains` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:57.972311 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e6eef8-9554-42e7-a077-fec17f5e2f01 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:42:57.972311 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e6eef8-9554-42e7-a077-fec17f5e2f01 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:57.972311 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e6eef8-9554-42e7-a077-fec17f5e2f01 None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:57.987305 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 385/745] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Oct 9 00:42:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:42:57.989884 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e6eef8-9554-42e7-a077-fec17f5e2f01 None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:57.995291 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:58.057899 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:58.081932 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017721d5-2c5a-4c46-92b0-cdc9ed372e57 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:58.129556 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd71d11a-9ac4-4eb4-89cd-9d5b02309cc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:58.130207 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd71d11a-9ac4-4eb4-89cd-9d5b02309cc7 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:58.130486 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd71d11a-9ac4-4eb4-89cd-9d5b02309cc7 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:58.130752 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd71d11a-9ac4-4eb4-89cd-9d5b02309cc7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:58.142932 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd71d11a-9ac4-4eb4-89cd-9d5b02309cc7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:58.144730 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd71d11a-9ac4-4eb4-89cd-9d5b02309cc7 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:58.162619 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application [None req-bd71d11a-9ac4-4eb4-89cd-9d5b02309cc7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:42:58.162619 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:42:58.162619 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:42:58.162619 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:42:58.162619 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:42:58.162619 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:42:58.162619 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:42:58.162619 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:42:58.162619 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:42:58.162619 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:42:58.162619 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:42:58.162619 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:42:58.162619 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 09 00:42:58.162619 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 09 00:42:58.162619 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 09 00:42:58.162619 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 09 00:42:58.163861 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:42:58.163861 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:42:58.163861 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:42:58.163861 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:42:58.163861 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:42:58.163861 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:42:58.163861 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:42:58.163861 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application with Lock( Oct 09 00:42:58.163861 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:42:58.163861 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:42:58.163861 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:42:58.163861 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:42:58.163861 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:42:58.163861 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:42:58.163861 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:42:58.163861 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:42:58.163861 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 09 00:42:58.165268 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 09 00:42:58.165268 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:42:58.165268 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application Oct 09 00:42:58.165268 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 361/746] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Oct 9 00:42:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 308 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 09 00:42:58.169899 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd71d11a-9ac4-4eb4-89cd-9d5b02309cc7 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:58.283539 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e6eef8-9554-42e7-a077-fec17f5e2f01 None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:58.308901 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:58.313392 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd71d11a-9ac4-4eb4-89cd-9d5b02309cc7 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:58.332870 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68ef11e-93ee-4e86-af45-e27b365916b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:58.333690 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68ef11e-93ee-4e86-af45-e27b365916b5 None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:58.334061 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68ef11e-93ee-4e86-af45-e27b365916b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:58.334446 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68ef11e-93ee-4e86-af45-e27b365916b5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:58.344545 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68ef11e-93ee-4e86-af45-e27b365916b5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:58.346468 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68ef11e-93ee-4e86-af45-e27b365916b5 None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:58.352054 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0830766a-27b6-44de-98aa-5a5c8be91d0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:58.352895 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0830766a-27b6-44de-98aa-5a5c8be91d0f None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:58.353327 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0830766a-27b6-44de-98aa-5a5c8be91d0f None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:58.353743 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0830766a-27b6-44de-98aa-5a5c8be91d0f None admin] PATH_INFO: `/v3/domains` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:58.354527 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0830766a-27b6-44de-98aa-5a5c8be91d0f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:42:58.354975 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0830766a-27b6-44de-98aa-5a5c8be91d0f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:58.356604 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0830766a-27b6-44de-98aa-5a5c8be91d0f None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:58.361784 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application [None req-f68ef11e-93ee-4e86-af45-e27b365916b5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 09 00:42:58.361784 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:42:58.361784 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:42:58.361784 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:42:58.361784 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:42:58.361784 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:42:58.361784 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:42:58.361784 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:42:58.361784 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:42:58.361784 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:42:58.361784 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:42:58.361784 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:42:58.361784 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 09 00:42:58.361784 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 09 00:42:58.361784 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 09 00:42:58.362892 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 09 00:42:58.362892 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:42:58.362892 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:42:58.362892 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:42:58.362892 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:42:58.362892 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:42:58.362892 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:42:58.362892 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:42:58.362892 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application with Lock( Oct 09 00:42:58.362892 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:42:58.362892 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:42:58.362892 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:42:58.362892 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:42:58.362892 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:42:58.362892 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:42:58.362892 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:42:58.362892 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:42:58.363863 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 09 00:42:58.363863 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 09 00:42:58.363863 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 09 00:42:58.363863 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 09 00:42:58.363863 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 09 00:42:58.363863 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 09 00:42:58.363863 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 09 00:42:58.363863 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Oct 09 00:42:58.364575 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 386/747] 10.222.0.15 () {56 vars in 1111 bytes} [Sun Oct 9 00:42:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 375 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:42:58.376406 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68ef11e-93ee-4e86-af45-e27b365916b5 None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:58.379713 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 362/748] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Oct 9 00:42:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:42:58.385732 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0830766a-27b6-44de-98aa-5a5c8be91d0f None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:58.494212 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0830766a-27b6-44de-98aa-5a5c8be91d0f None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:58.544551 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68ef11e-93ee-4e86-af45-e27b365916b5 None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:58.546749 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:58.560130 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef777e2-b4b9-444e-8ddf-c96a3fbe642f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:58.561045 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef777e2-b4b9-444e-8ddf-c96a3fbe642f None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:58.561459 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef777e2-b4b9-444e-8ddf-c96a3fbe642f None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:58.561896 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef777e2-b4b9-444e-8ddf-c96a3fbe642f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:58.570100 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef777e2-b4b9-444e-8ddf-c96a3fbe642f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:58.571960 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef777e2-b4b9-444e-8ddf-c96a3fbe642f None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:58.585581 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application [None req-9ef777e2-b4b9-444e-8ddf-c96a3fbe642f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 09 00:42:58.585581 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:42:58.585581 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:42:58.585581 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:42:58.585581 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:42:58.585581 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:42:58.585581 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:42:58.585581 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:42:58.585581 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:42:58.585581 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:42:58.585581 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:42:58.585581 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:42:58.585581 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 09 00:42:58.585581 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 09 00:42:58.585581 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 09 00:42:58.586786 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 09 00:42:58.586786 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:42:58.586786 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:42:58.586786 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:42:58.586786 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:42:58.586786 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:42:58.586786 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:42:58.586786 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:42:58.586786 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application with Lock( Oct 09 00:42:58.586786 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:42:58.586786 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:42:58.586786 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:42:58.586786 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:42:58.586786 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:42:58.586786 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:42:58.586786 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:42:58.586786 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:42:58.587842 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 09 00:42:58.587842 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 09 00:42:58.587842 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 09 00:42:58.587842 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 09 00:42:58.587842 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 09 00:42:58.587842 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 09 00:42:58.587842 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 09 00:42:58.587842 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application Oct 09 00:42:58.589828 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 363/749] 10.222.0.15 () {56 vars in 1111 bytes} [Sun Oct 9 00:42:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 09 00:42:58.595920 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef777e2-b4b9-444e-8ddf-c96a3fbe642f None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:58.619993 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:58.636095 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c570ed3c-7f05-42e9-9be6-137f93904844 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:58.636642 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c570ed3c-7f05-42e9-9be6-137f93904844 None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:58.636916 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c570ed3c-7f05-42e9-9be6-137f93904844 None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:58.637186 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c570ed3c-7f05-42e9-9be6-137f93904844 None admin] PATH_INFO: `/v3/projects` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:58.637885 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c570ed3c-7f05-42e9-9be6-137f93904844 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:42:58.638184 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c570ed3c-7f05-42e9-9be6-137f93904844 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:58.639653 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c570ed3c-7f05-42e9-9be6-137f93904844 None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:58.661144 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 387/750] 10.222.0.15 () {56 vars in 1148 bytes} [Sun Oct 9 00:42:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:42:58.666900 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c570ed3c-7f05-42e9-9be6-137f93904844 None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:58.704304 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef777e2-b4b9-444e-8ddf-c96a3fbe642f None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:58.739965 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8882189e-a1b2-41f4-beb4-cd16e4656299 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:58.740849 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8882189e-a1b2-41f4-beb4-cd16e4656299 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:58.741262 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8882189e-a1b2-41f4-beb4-cd16e4656299 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:58.741667 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8882189e-a1b2-41f4-beb4-cd16e4656299 None admin] PATH_INFO: `/v3/projects` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:58.742604 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8882189e-a1b2-41f4-beb4-cd16e4656299 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:42:58.743044 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8882189e-a1b2-41f4-beb4-cd16e4656299 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:58.744788 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8882189e-a1b2-41f4-beb4-cd16e4656299 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:58.758497 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 364/751] 10.222.0.15 () {56 vars in 1148 bytes} [Sun Oct 9 00:42:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:42:58.764752 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8882189e-a1b2-41f4-beb4-cd16e4656299 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:58.859708 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:58.879954 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8882189e-a1b2-41f4-beb4-cd16e4656299 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:58.918385 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a1e42e-b6bf-4293-8cb6-66c08e600095 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:58.919288 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a1e42e-b6bf-4293-8cb6-66c08e600095 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:58.919864 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a1e42e-b6bf-4293-8cb6-66c08e600095 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:58.920271 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a1e42e-b6bf-4293-8cb6-66c08e600095 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:58.921278 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a1e42e-b6bf-4293-8cb6-66c08e600095 None admin] RBAC: Adding query filter params (role.id=f69dddf26daf4dd79d4c962beb877af5, scope.project.id=f148d39ced534860abfbe8fc3f98ace4, user.id=c4c467943b8f4d31a2f067ca6ed3b25c) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:42:58.921721 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a1e42e-b6bf-4293-8cb6-66c08e600095 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:58.923442 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a1e42e-b6bf-4293-8cb6-66c08e600095 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:58.929972 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 365/752] 10.222.0.15 () {56 vars in 1374 bytes} [Sun Oct 9 00:42:58 2022] GET /identity/v3/role_assignments?user.id=c4c467943b8f4d31a2f067ca6ed3b25c&scope.project.id=f148d39ced534860abfbe8fc3f98ace4&role.id=f69dddf26daf4dd79d4c962beb877af5 => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 09 00:42:58.933816 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c570ed3c-7f05-42e9-9be6-137f93904844 None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:58.945030 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2e3489-23b8-4b38-8946-658219d5a4a6 None None] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:58.945425 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2e3489-23b8-4b38-8946-658219d5a4a6 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:58.945640 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2e3489-23b8-4b38-8946-658219d5a4a6 None None] PATH_INFO: `/` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:58.947868 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 366/753] 10.222.0.15 () {54 vars in 927 bytes} [Sun Oct 9 00:42:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 09 00:42:58.962669 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d91e451-8b19-47db-aae2-5d97e8b6347d None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:58.963019 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d91e451-8b19-47db-aae2-5d97e8b6347d None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:58.963210 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d91e451-8b19-47db-aae2-5d97e8b6347d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:58.998040 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422d0d32-8bac-49ae-b4f3-746fdfe67600 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:58.999411 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422d0d32-8bac-49ae-b4f3-746fdfe67600 None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:58.999934 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422d0d32-8bac-49ae-b4f3-746fdfe67600 None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:59.001121 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-8d91e451-8b19-47db-aae2-5d97e8b6347d None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:42:59.001636 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422d0d32-8bac-49ae-b4f3-746fdfe67600 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:59.002608 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422d0d32-8bac-49ae-b4f3-746fdfe67600 None admin] RBAC: Adding query filter params (role.id=6fe3faf520bd402f9bd78d3ed08eec34, scope.project.id=f148d39ced534860abfbe8fc3f98ace4, user.id=3a6cfef106c84f759ce0874be77f7380) {{(pid=81525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:42:59.004213 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-8d91e451-8b19-47db-aae2-5d97e8b6347d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:42:59.004863 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422d0d32-8bac-49ae-b4f3-746fdfe67600 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:59.006579 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422d0d32-8bac-49ae-b4f3-746fdfe67600 None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:59.021408 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 388/754] 10.222.0.15 () {56 vars in 1374 bytes} [Sun Oct 9 00:42:58 2022] GET /identity/v3/role_assignments?user.id=3a6cfef106c84f759ce0874be77f7380&scope.project.id=f148d39ced534860abfbe8fc3f98ace4&role.id=6fe3faf520bd402f9bd78d3ed08eec34 => generated 259 bytes in 355 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 09 00:42:59.099512 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 367/755] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Oct 9 00:42:58 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 09 00:42:59.380526 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422d0d32-8bac-49ae-b4f3-746fdfe67600 None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:59.407665 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:59.506941 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422d0d32-8bac-49ae-b4f3-746fdfe67600 None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:59.547653 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed742fe1-d789-466d-aaa2-3f4a55d51bac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:59.548675 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed742fe1-d789-466d-aaa2-3f4a55d51bac None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:59.549170 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed742fe1-d789-466d-aaa2-3f4a55d51bac None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:59.549651 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed742fe1-d789-466d-aaa2-3f4a55d51bac None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:59.567664 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed742fe1-d789-466d-aaa2-3f4a55d51bac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 09 00:42:59.573052 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application [None req-ed742fe1-d789-466d-aaa2-3f4a55d51bac None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 09 00:42:59.573052 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:42:59.573052 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:42:59.573052 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:42:59.573052 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:42:59.573052 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:42:59.573052 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:42:59.573052 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:42:59.573052 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:42:59.573052 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:42:59.573052 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:42:59.573052 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:42:59.573052 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 09 00:42:59.573052 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 09 00:42:59.573052 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 09 00:42:59.573052 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 09 00:42:59.573990 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 09 00:42:59.573990 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 09 00:42:59.573990 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 09 00:42:59.573990 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 09 00:42:59.573990 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:42:59.573990 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:42:59.573990 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:42:59.573990 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:42:59.573990 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:42:59.573990 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:42:59.573990 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:42:59.573990 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application with Lock( Oct 09 00:42:59.573990 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:42:59.573990 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:42:59.573990 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:42:59.573990 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:42:59.574836 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:42:59.574836 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:42:59.574836 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:42:59.574836 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:42:59.574836 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 09 00:42:59.574836 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 09 00:42:59.574836 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 09 00:42:59.574836 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 09 00:42:59.574836 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 09 00:42:59.574836 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 09 00:42:59.574836 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 09 00:42:59.574836 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Oct 09 00:42:59.577266 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 389/756] 10.222.0.15 () {56 vars in 1096 bytes} [Sun Oct 9 00:42:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 09 00:42:59.583815 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d91e451-8b19-47db-aae2-5d97e8b6347d None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:59.675691 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:59.701384 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d91e451-8b19-47db-aae2-5d97e8b6347d None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:59.735815 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb387a6-6d61-4994-a86d-8ce29481b117 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:59.736429 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb387a6-6d61-4994-a86d-8ce29481b117 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:59.736700 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb387a6-6d61-4994-a86d-8ce29481b117 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:59.736963 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb387a6-6d61-4994-a86d-8ce29481b117 None admin] PATH_INFO: `/v3/roles` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:59.737630 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb387a6-6d61-4994-a86d-8ce29481b117 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:42:59.737930 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb387a6-6d61-4994-a86d-8ce29481b117 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:59.739331 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb387a6-6d61-4994-a86d-8ce29481b117 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:42:59.748702 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 368/757] 10.222.0.15 () {56 vars in 1099 bytes} [Sun Oct 9 00:42:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:42:59.754329 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed742fe1-d789-466d-aaa2-3f4a55d51bac None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:42:59.911670 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:42:59.946552 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed742fe1-d789-466d-aaa2-3f4a55d51bac None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:42:59.983564 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4880310a-3363-4a55-b5e9-00400b42e1e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:42:59.984466 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4880310a-3363-4a55-b5e9-00400b42e1e1 None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:42:59.984917 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4880310a-3363-4a55-b5e9-00400b42e1e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:42:59.985326 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4880310a-3363-4a55-b5e9-00400b42e1e1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:42:59.996777 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4880310a-3363-4a55-b5e9-00400b42e1e1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:42:59.998886 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4880310a-3363-4a55-b5e9-00400b42e1e1 None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:00.014704 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application [None req-4880310a-3363-4a55-b5e9-00400b42e1e1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:43:00.014704 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:43:00.014704 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:43:00.014704 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:43:00.014704 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:43:00.014704 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:43:00.014704 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:43:00.014704 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:43:00.014704 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:43:00.014704 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:43:00.014704 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:43:00.014704 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:43:00.014704 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 09 00:43:00.014704 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 09 00:43:00.014704 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 09 00:43:00.014704 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 09 00:43:00.015958 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:43:00.015958 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:43:00.015958 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:43:00.015958 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:43:00.015958 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:43:00.015958 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:43:00.015958 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:43:00.015958 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application with Lock( Oct 09 00:43:00.015958 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:43:00.015958 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:43:00.015958 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:43:00.015958 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:43:00.015958 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:43:00.015958 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:43:00.015958 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:43:00.015958 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:43:00.015958 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 09 00:43:00.017100 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 09 00:43:00.017100 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:43:00.017100 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Oct 09 00:43:00.022969 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 390/758] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Oct 9 00:42:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:43:00.025212 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb387a6-6d61-4994-a86d-8ce29481b117 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:00.167373 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb387a6-6d61-4994-a86d-8ce29481b117 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:00.168003 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b83b814-1844-44e5-a8bf-c385b06e73e1 None None] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:00.168280 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b83b814-1844-44e5-a8bf-c385b06e73e1 None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:00.168547 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b83b814-1844-44e5-a8bf-c385b06e73e1 None None] PATH_INFO: `/` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:00.170213 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 391/759] 10.222.0.15 () {54 vars in 927 bytes} [Sun Oct 9 00:43:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:43:00.176121 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3181acd0-0766-488f-92db-f72862641412 None None] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:00.176392 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3181acd0-0766-488f-92db-f72862641412 None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:00.176665 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3181acd0-0766-488f-92db-f72862641412 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:00.196524 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.auth.core [None req-3181acd0-0766-488f-92db-f72862641412 None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:43:00.197784 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-3181acd0-0766-488f-92db-f72862641412 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:43:00.224301 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0893e2bb-cac7-43c0-8e2a-c31748bfcc21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:00.225273 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0893e2bb-cac7-43c0-8e2a-c31748bfcc21 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:00.225782 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0893e2bb-cac7-43c0-8e2a-c31748bfcc21 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:00.226205 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0893e2bb-cac7-43c0-8e2a-c31748bfcc21 None admin] PATH_INFO: `/v3/domains` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:00.227116 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0893e2bb-cac7-43c0-8e2a-c31748bfcc21 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:43:00.227585 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0893e2bb-cac7-43c0-8e2a-c31748bfcc21 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:00.229327 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0893e2bb-cac7-43c0-8e2a-c31748bfcc21 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:00.236690 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:00.261857 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 369/760] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Oct 9 00:43:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 09 00:43:00.267668 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0893e2bb-cac7-43c0-8e2a-c31748bfcc21 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:00.300737 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 392/761] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Oct 9 00:43:00 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 09 00:43:00.376959 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0893e2bb-cac7-43c0-8e2a-c31748bfcc21 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:00.422993 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e004af-7c05-4b78-b16f-8b398bf2732c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:00.423913 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e004af-7c05-4b78-b16f-8b398bf2732c None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:00.424337 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e004af-7c05-4b78-b16f-8b398bf2732c None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:00.424753 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e004af-7c05-4b78-b16f-8b398bf2732c None admin] PATH_INFO: `/v3/users/nova` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:00.432975 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e004af-7c05-4b78-b16f-8b398bf2732c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:00.434737 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e004af-7c05-4b78-b16f-8b398bf2732c None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:00.457835 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application [None req-06e004af-7c05-4b78-b16f-8b398bf2732c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 09 00:43:00.457835 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:43:00.457835 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:43:00.457835 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:43:00.457835 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:43:00.457835 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:43:00.457835 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:43:00.457835 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:43:00.457835 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:43:00.457835 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:43:00.457835 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:43:00.457835 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:43:00.457835 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 09 00:43:00.457835 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 09 00:43:00.457835 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 09 00:43:00.457835 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 09 00:43:00.459029 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:43:00.459029 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:43:00.459029 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 09 00:43:00.459029 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 09 00:43:00.459029 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 09 00:43:00.459029 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 09 00:43:00.459029 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:43:00.459029 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:43:00.459029 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:43:00.459029 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:43:00.459029 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:43:00.459029 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application with Lock( Oct 09 00:43:00.459029 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:43:00.459029 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:43:00.459029 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:43:00.459029 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:43:00.459029 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:43:00.459029 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:43:00.460221 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:43:00.460221 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:43:00.460221 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 09 00:43:00.460221 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 09 00:43:00.460221 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 09 00:43:00.460221 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 09 00:43:00.460221 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 09 00:43:00.460221 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 09 00:43:00.460221 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 09 00:43:00.460221 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application Oct 09 00:43:00.466597 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 370/762] 10.222.0.15 () {56 vars in 1093 bytes} [Sun Oct 9 00:43:00 2022] GET /identity/v3/users/nova => generated 82 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:43:00.468004 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3181acd0-0766-488f-92db-f72862641412 None None] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:00.553726 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:00.601632 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3181acd0-0766-488f-92db-f72862641412 None None] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:00.636935 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b32593-f0fd-4386-b92d-3b3248dd8e7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:00.637547 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b32593-f0fd-4386-b92d-3b3248dd8e7a None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:00.637817 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b32593-f0fd-4386-b92d-3b3248dd8e7a None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:00.638080 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b32593-f0fd-4386-b92d-3b3248dd8e7a None admin] PATH_INFO: `/v3/users` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:00.638940 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b32593-f0fd-4386-b92d-3b3248dd8e7a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:43:00.639240 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b32593-f0fd-4386-b92d-3b3248dd8e7a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:00.640722 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b32593-f0fd-4386-b92d-3b3248dd8e7a None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:00.659593 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 393/763] 10.222.0.15 () {56 vars in 1133 bytes} [Sun Oct 9 00:43:00 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:43:00.668664 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e004af-7c05-4b78-b16f-8b398bf2732c None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:00.712067 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b32593-f0fd-4386-b92d-3b3248dd8e7a None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:00.780674 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:00.827574 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b32593-f0fd-4386-b92d-3b3248dd8e7a None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:00.834235 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e004af-7c05-4b78-b16f-8b398bf2732c None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:00.850313 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:00.873949 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45688275-11e9-4e8a-9001-5d8c93107a2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:00.874198 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df7c2b6-fb38-4484-a0a8-9415390e9de1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:00.874818 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df7c2b6-fb38-4484-a0a8-9415390e9de1 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:00.875096 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df7c2b6-fb38-4484-a0a8-9415390e9de1 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:00.875398 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df7c2b6-fb38-4484-a0a8-9415390e9de1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:00.875746 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45688275-11e9-4e8a-9001-5d8c93107a2c None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:00.876274 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45688275-11e9-4e8a-9001-5d8c93107a2c None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:00.876725 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45688275-11e9-4e8a-9001-5d8c93107a2c None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:00.877777 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45688275-11e9-4e8a-9001-5d8c93107a2c None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:00.879944 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45688275-11e9-4e8a-9001-5d8c93107a2c None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:00.886891 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df7c2b6-fb38-4484-a0a8-9415390e9de1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:00.888388 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df7c2b6-fb38-4484-a0a8-9415390e9de1 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:00.892217 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application [None req-45688275-11e9-4e8a-9001-5d8c93107a2c None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 09 00:43:00.892217 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:43:00.892217 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 09 00:43:00.892217 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 09 00:43:00.892217 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 09 00:43:00.892217 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 09 00:43:00.892217 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 09 00:43:00.892217 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 09 00:43:00.892217 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 09 00:43:00.892217 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Oct 09 00:43:00.892217 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 09 00:43:00.892217 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Oct 09 00:43:00.892217 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:43:00.892217 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:43:00.892217 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:43:00.892217 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:43:00.892217 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:43:00.893212 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:43:00.893212 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:43:00.893212 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:43:00.893212 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:43:00.893212 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:43:00.893212 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:43:00.893212 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 09 00:43:00.893212 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 09 00:43:00.893212 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 09 00:43:00.893212 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 09 00:43:00.893212 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:43:00.893212 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:43:00.893212 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:43:00.893212 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:43:00.893212 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:43:00.893212 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:43:00.894043 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:43:00.894043 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application with Lock( Oct 09 00:43:00.894043 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:43:00.894043 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:43:00.894043 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:43:00.894043 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:43:00.894043 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:43:00.894043 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:43:00.894043 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:43:00.894043 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:43:00.894043 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 09 00:43:00.894043 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 09 00:43:00.894043 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 09 00:43:00.894043 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Oct 09 00:43:00.896784 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 394/764] 10.222.0.15 () {56 vars in 1129 bytes} [Sun Oct 9 00:43:00 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:43:00.897859 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4826d330-66af-4ba0-b1de-eaaea1261d65 None None] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:00.898135 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4826d330-66af-4ba0-b1de-eaaea1261d65 None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:00.898469 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4826d330-66af-4ba0-b1de-eaaea1261d65 None None] PATH_INFO: `/` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:00.899988 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 395/765] 10.222.0.15 () {54 vars in 927 bytes} [Sun Oct 9 00:43:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:43:00.906382 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619cc89c-79fe-4aa7-a7df-30f09e0466fe None None] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:00.906783 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619cc89c-79fe-4aa7-a7df-30f09e0466fe None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:00.907151 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619cc89c-79fe-4aa7-a7df-30f09e0466fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:00.908581 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application [None req-2df7c2b6-fb38-4484-a0a8-9415390e9de1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:43:00.908581 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:43:00.908581 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:43:00.908581 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:43:00.908581 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:43:00.908581 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:43:00.908581 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:43:00.908581 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:43:00.908581 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:43:00.908581 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:43:00.908581 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:43:00.908581 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:43:00.908581 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 09 00:43:00.908581 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 09 00:43:00.908581 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 09 00:43:00.908581 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 09 00:43:00.909682 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:43:00.909682 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:43:00.909682 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:43:00.909682 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:43:00.909682 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:43:00.909682 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:43:00.909682 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:43:00.909682 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application with Lock( Oct 09 00:43:00.909682 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:43:00.909682 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:43:00.909682 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:43:00.909682 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:43:00.909682 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:43:00.909682 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:43:00.909682 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:43:00.909682 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:43:00.909682 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 09 00:43:00.910768 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 09 00:43:00.910768 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:43:00.910768 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application Oct 09 00:43:00.912445 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 371/766] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Oct 9 00:43:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:43:00.917775 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df7c2b6-fb38-4484-a0a8-9415390e9de1 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:00.928216 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.auth.core [None req-619cc89c-79fe-4aa7-a7df-30f09e0466fe None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:43:00.929609 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-619cc89c-79fe-4aa7-a7df-30f09e0466fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:43:01.011447 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 396/767] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Oct 9 00:43:00 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 09 00:43:01.013004 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619cc89c-79fe-4aa7-a7df-30f09e0466fe None None] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:01.047540 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df7c2b6-fb38-4484-a0a8-9415390e9de1 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:01.065329 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:01.112323 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67465cf4-010f-4fc9-8eb9-601f460b2ca4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:01.113530 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67465cf4-010f-4fc9-8eb9-601f460b2ca4 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:01.113961 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67465cf4-010f-4fc9-8eb9-601f460b2ca4 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:01.114409 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67465cf4-010f-4fc9-8eb9-601f460b2ca4 None admin] PATH_INFO: `/v3/services` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:01.115193 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67465cf4-010f-4fc9-8eb9-601f460b2ca4 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:43:01.119856 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67465cf4-010f-4fc9-8eb9-601f460b2ca4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:01.122207 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67465cf4-010f-4fc9-8eb9-601f460b2ca4 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:01.132729 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 372/768] 10.222.0.15 () {56 vars in 1124 bytes} [Sun Oct 9 00:43:00 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:43:01.138359 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67465cf4-010f-4fc9-8eb9-601f460b2ca4 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:01.203845 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619cc89c-79fe-4aa7-a7df-30f09e0466fe None None] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:01.244552 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:01.285195 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67465cf4-010f-4fc9-8eb9-601f460b2ca4 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:01.316554 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a858bcc-72e1-4e8a-92a1-401098f178c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:01.317365 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a858bcc-72e1-4e8a-92a1-401098f178c7 None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:01.317727 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a858bcc-72e1-4e8a-92a1-401098f178c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:01.318088 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a858bcc-72e1-4e8a-92a1-401098f178c7 None admin] PATH_INFO: `/v3/domains` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:01.318851 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a858bcc-72e1-4e8a-92a1-401098f178c7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:43:01.319279 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a858bcc-72e1-4e8a-92a1-401098f178c7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:01.320830 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a858bcc-72e1-4e8a-92a1-401098f178c7 None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:01.323513 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bba712-f1c4-4d6e-ad76-125bf2f56675 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:01.324337 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bba712-f1c4-4d6e-ad76-125bf2f56675 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:01.324736 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bba712-f1c4-4d6e-ad76-125bf2f56675 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:01.325122 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bba712-f1c4-4d6e-ad76-125bf2f56675 None admin] PATH_INFO: `/v3/services` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:01.325870 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bba712-f1c4-4d6e-ad76-125bf2f56675 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:43:01.326288 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bba712-f1c4-4d6e-ad76-125bf2f56675 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:01.327804 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bba712-f1c4-4d6e-ad76-125bf2f56675 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:01.334480 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 397/769] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Oct 9 00:43:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:43:01.339295 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a858bcc-72e1-4e8a-92a1-401098f178c7 None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:01.340545 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 373/770] 10.222.0.15 () {56 vars in 1124 bytes} [Sun Oct 9 00:43:01 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:43:01.342391 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bba712-f1c4-4d6e-ad76-125bf2f56675 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:01.381212 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:01.441312 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a858bcc-72e1-4e8a-92a1-401098f178c7 None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:01.453148 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bba712-f1c4-4d6e-ad76-125bf2f56675 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:01.476782 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174bee43-c9b6-4039-a022-9e6f83d04eaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:01.477435 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174bee43-c9b6-4039-a022-9e6f83d04eaf None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:01.477714 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174bee43-c9b6-4039-a022-9e6f83d04eaf None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:01.478004 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174bee43-c9b6-4039-a022-9e6f83d04eaf None admin] PATH_INFO: `/v3/services/network` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:01.478584 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174bee43-c9b6-4039-a022-9e6f83d04eaf None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:01.480125 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174bee43-c9b6-4039-a022-9e6f83d04eaf None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:01.490072 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application [None req-174bee43-c9b6-4039-a022-9e6f83d04eaf None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 09 00:43:01.490072 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:43:01.490072 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 09 00:43:01.490072 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 09 00:43:01.490072 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 09 00:43:01.490072 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 09 00:43:01.490072 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 09 00:43:01.490072 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 09 00:43:01.490072 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 09 00:43:01.490072 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Oct 09 00:43:01.490072 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 09 00:43:01.490072 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Oct 09 00:43:01.490072 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:43:01.490072 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:43:01.490072 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:43:01.490072 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:43:01.490072 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:43:01.491312 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:43:01.491312 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:43:01.491312 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:43:01.491312 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:43:01.491312 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:43:01.491312 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:43:01.491312 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 09 00:43:01.491312 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 09 00:43:01.491312 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 09 00:43:01.491312 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 09 00:43:01.491312 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:43:01.491312 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:43:01.491312 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:43:01.491312 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:43:01.491312 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:43:01.491312 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:43:01.492437 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:43:01.492437 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application with Lock( Oct 09 00:43:01.492437 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:43:01.492437 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:43:01.492437 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:43:01.492437 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:43:01.492437 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:43:01.492437 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:43:01.492437 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:43:01.492437 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:43:01.492437 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 09 00:43:01.492437 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 09 00:43:01.492437 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 09 00:43:01.492437 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Oct 09 00:43:01.493560 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f06e11-de06-424d-b57d-75f8cad23f48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:01.494371 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f06e11-de06-424d-b57d-75f8cad23f48 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:01.494815 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f06e11-de06-424d-b57d-75f8cad23f48 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:01.495211 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f06e11-de06-424d-b57d-75f8cad23f48 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:01.495404 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 398/771] 10.222.0.15 () {56 vars in 1111 bytes} [Sun Oct 9 00:43:01 2022] GET /identity/v3/services/network => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:43:01.496470 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174bee43-c9b6-4039-a022-9e6f83d04eaf None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:01.504190 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f06e11-de06-424d-b57d-75f8cad23f48 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:01.506061 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f06e11-de06-424d-b57d-75f8cad23f48 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:01.520148 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application [None req-e4f06e11-de06-424d-b57d-75f8cad23f48 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 09 00:43:01.520148 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:43:01.520148 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:43:01.520148 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:43:01.520148 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:43:01.520148 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:43:01.520148 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:43:01.520148 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:43:01.520148 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:43:01.520148 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:43:01.520148 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:43:01.520148 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:43:01.520148 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 09 00:43:01.520148 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 09 00:43:01.520148 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 09 00:43:01.521175 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 09 00:43:01.521175 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:43:01.521175 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:43:01.521175 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:43:01.521175 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:43:01.521175 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:43:01.521175 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:43:01.521175 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:43:01.521175 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application with Lock( Oct 09 00:43:01.521175 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:43:01.521175 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:43:01.521175 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:43:01.521175 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:43:01.521175 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:43:01.521175 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:43:01.521175 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:43:01.521175 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:43:01.522051 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 09 00:43:01.522051 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 09 00:43:01.522051 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 09 00:43:01.522051 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 09 00:43:01.522051 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 09 00:43:01.522051 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 09 00:43:01.522051 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 09 00:43:01.522051 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application Oct 09 00:43:01.525930 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 374/772] 10.222.0.15 () {56 vars in 1111 bytes} [Sun Oct 9 00:43:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 09 00:43:01.532164 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f06e11-de06-424d-b57d-75f8cad23f48 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:01.555745 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:01.610865 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174bee43-c9b6-4039-a022-9e6f83d04eaf None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:01.633172 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:01.640246 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f06e11-de06-424d-b57d-75f8cad23f48 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:01.649154 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a354849-5811-4499-bd2f-75c9dae7bb77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:01.649786 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a354849-5811-4499-bd2f-75c9dae7bb77 None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:01.650101 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a354849-5811-4499-bd2f-75c9dae7bb77 None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:01.650378 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a354849-5811-4499-bd2f-75c9dae7bb77 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:01.651088 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a354849-5811-4499-bd2f-75c9dae7bb77 None admin] RBAC: Adding query filter params (interface=public, service_id=28c17dbe1179492bb6d4a331542dd841, region_id=RegionOne) {{(pid=81525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:43:01.651432 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a354849-5811-4499-bd2f-75c9dae7bb77 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:01.652827 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a354849-5811-4499-bd2f-75c9dae7bb77 None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:01.660685 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 399/773] 10.222.0.15 () {56 vars in 1251 bytes} [Sun Oct 9 00:43:01 2022] GET /identity/v3/endpoints?service_id=28c17dbe1179492bb6d4a331542dd841&interface=public®ion_id=RegionOne => generated 194 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:43:01.661629 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a354849-5811-4499-bd2f-75c9dae7bb77 None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:01.678480 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89580aee-ee0b-4d60-819d-dae6d0e424d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:01.679564 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89580aee-ee0b-4d60-819d-dae6d0e424d2 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:01.680068 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89580aee-ee0b-4d60-819d-dae6d0e424d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:01.680394 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89580aee-ee0b-4d60-819d-dae6d0e424d2 None admin] PATH_INFO: `/v3/services` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:01.681162 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89580aee-ee0b-4d60-819d-dae6d0e424d2 None admin] RBAC: Adding query filter params (name=network) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:43:01.681402 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89580aee-ee0b-4d60-819d-dae6d0e424d2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:01.682748 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89580aee-ee0b-4d60-819d-dae6d0e424d2 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:01.687626 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 375/774] 10.222.0.15 () {56 vars in 1112 bytes} [Sun Oct 9 00:43:01 2022] GET /identity/v3/services?name=network => generated 124 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:43:01.688669 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dc4c96-2f04-420d-9e10-22cbbf3bc321 None None] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:01.688971 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dc4c96-2f04-420d-9e10-22cbbf3bc321 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:01.689213 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dc4c96-2f04-420d-9e10-22cbbf3bc321 None None] PATH_INFO: `/` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:01.694458 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 376/775] 10.222.0.15 () {54 vars in 927 bytes} [Sun Oct 9 00:43:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:43:01.694458 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dc4c96-2f04-420d-9e10-22cbbf3bc321 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:01.790384 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a354849-5811-4499-bd2f-75c9dae7bb77 None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:01.792759 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:01.802831 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dc4c96-2f04-420d-9e10-22cbbf3bc321 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:01.836779 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64084f76-43f1-47e5-9b43-c9d1eb23ed5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:01.837726 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64084f76-43f1-47e5-9b43-c9d1eb23ed5d None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:01.838160 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64084f76-43f1-47e5-9b43-c9d1eb23ed5d None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:01.838575 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64084f76-43f1-47e5-9b43-c9d1eb23ed5d None admin] PATH_INFO: `/v3/projects` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:01.839457 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64084f76-43f1-47e5-9b43-c9d1eb23ed5d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:43:01.839908 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64084f76-43f1-47e5-9b43-c9d1eb23ed5d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:01.840906 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098ec24b-27f4-4089-ad6c-b949b270c90e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:01.841524 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098ec24b-27f4-4089-ad6c-b949b270c90e None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:01.841804 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098ec24b-27f4-4089-ad6c-b949b270c90e None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:01.841935 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64084f76-43f1-47e5-9b43-c9d1eb23ed5d None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:01.842080 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098ec24b-27f4-4089-ad6c-b949b270c90e None admin] PATH_INFO: `/v3/services` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:01.842686 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098ec24b-27f4-4089-ad6c-b949b270c90e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:01.844079 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098ec24b-27f4-4089-ad6c-b949b270c90e None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:01.849299 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 377/776] 10.222.0.15 () {56 vars in 1087 bytes} [Sun Oct 9 00:43:01 2022] GET /identity/v3/services => generated 772 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:43:01.850121 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098ec24b-27f4-4089-ad6c-b949b270c90e None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:01.864205 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 400/777] 10.222.0.15 () {56 vars in 1148 bytes} [Sun Oct 9 00:43:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:43:01.865912 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4079c9-c481-439d-a195-c24111b194aa None None] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:01.867165 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4079c9-c481-439d-a195-c24111b194aa None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:01.867677 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4079c9-c481-439d-a195-c24111b194aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:01.886173 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:01.892917 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.auth.core [None req-5a4079c9-c481-439d-a195-c24111b194aa None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:43:01.894140 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-5a4079c9-c481-439d-a195-c24111b194aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:43:01.972719 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 401/778] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Oct 9 00:43:01 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 09 00:43:01.973792 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f3f5ef-52f3-4e93-b0c9-90114038d427 None None] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:01.974062 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f3f5ef-52f3-4e93-b0c9-90114038d427 None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:01.974327 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f3f5ef-52f3-4e93-b0c9-90114038d427 None None] PATH_INFO: `/` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:01.975796 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 402/779] 10.222.0.15 () {54 vars in 927 bytes} [Sun Oct 9 00:43:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:43:01.980880 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f3f5ef-52f3-4e93-b0c9-90114038d427 None None] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:01.986725 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098ec24b-27f4-4089-ad6c-b949b270c90e None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:02.043031 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ad63c2-9308-4476-8ddf-9b717369808a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:02.043680 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ad63c2-9308-4476-8ddf-9b717369808a None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:02.043955 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ad63c2-9308-4476-8ddf-9b717369808a None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:02.044221 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ad63c2-9308-4476-8ddf-9b717369808a None admin] PATH_INFO: `/v3/services` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:02.044855 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ad63c2-9308-4476-8ddf-9b717369808a None admin] RBAC: Adding query filter params (type=network) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:43:02.045153 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ad63c2-9308-4476-8ddf-9b717369808a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:02.046531 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ad63c2-9308-4476-8ddf-9b717369808a None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:02.053167 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 378/780] 10.222.0.15 () {56 vars in 1112 bytes} [Sun Oct 9 00:43:01 2022] GET /identity/v3/services?type=network => generated 350 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:43:02.054397 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f98248-10be-46e3-9bbb-a00b437593bc None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:02.054758 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f98248-10be-46e3-9bbb-a00b437593bc None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:02.055132 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f98248-10be-46e3-9bbb-a00b437593bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:02.075697 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-30f98248-10be-46e3-9bbb-a00b437593bc None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:43:02.076894 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-30f98248-10be-46e3-9bbb-a00b437593bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:43:02.106084 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:02.120320 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f3f5ef-52f3-4e93-b0c9-90114038d427 None None] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:02.155725 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 379/781] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Oct 9 00:43:02 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 09 00:43:02.156890 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f98248-10be-46e3-9bbb-a00b437593bc None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:02.170766 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a933e8-cb72-4804-a31e-30865cc037f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:02.171812 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a933e8-cb72-4804-a31e-30865cc037f9 None admin] REQUEST_METHOD: `PUT` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:02.173159 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a933e8-cb72-4804-a31e-30865cc037f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:02.174677 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a933e8-cb72-4804-a31e-30865cc037f9 None admin] PATH_INFO: `/v3/projects/f148d39ced534860abfbe8fc3f98ace4/users/4ac83d57fba841e0a666710732249c49/roles/f69dddf26daf4dd79d4c962beb877af5` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:02.178328 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a933e8-cb72-4804-a31e-30865cc037f9 None admin] RBAC: Authorizing `identity:create_grant(project_id=f148d39ced534860abfbe8fc3f98ace4, user_id=4ac83d57fba841e0a666710732249c49, role_id=f69dddf26daf4dd79d4c962beb877af5)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:02.182077 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a933e8-cb72-4804-a31e-30865cc037f9 None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:02.197831 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:02.205847 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 403/782] 10.222.0.15 () {58 vars in 1439 bytes} [Sun Oct 9 00:43:01 2022] PUT /identity/v3/projects/f148d39ced534860abfbe8fc3f98ace4/users/4ac83d57fba841e0a666710732249c49/roles/f69dddf26daf4dd79d4c962beb877af5 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 00:43:02.262336 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a933e8-cb72-4804-a31e-30865cc037f9 None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:02.325787 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f98248-10be-46e3-9bbb-a00b437593bc None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:02.378655 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185416dc-c249-4b6a-b94d-20d045796894 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:02.379194 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185416dc-c249-4b6a-b94d-20d045796894 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:02.379511 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185416dc-c249-4b6a-b94d-20d045796894 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:02.379776 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185416dc-c249-4b6a-b94d-20d045796894 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:02.383285 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185416dc-c249-4b6a-b94d-20d045796894 None admin] RBAC: Adding query filter params (interface=public, service_id=e17b81e3f498416ea3a6e6a3259c847e, region_id=RegionOne) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:43:02.383285 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185416dc-c249-4b6a-b94d-20d045796894 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:02.383285 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185416dc-c249-4b6a-b94d-20d045796894 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:02.392816 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 380/783] 10.222.0.15 () {56 vars in 1251 bytes} [Sun Oct 9 00:43:02 2022] GET /identity/v3/endpoints?service_id=e17b81e3f498416ea3a6e6a3259c847e&interface=public®ion_id=RegionOne => generated 194 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:43:02.399250 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185416dc-c249-4b6a-b94d-20d045796894 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:02.472157 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a933e8-cb72-4804-a31e-30865cc037f9 None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:02.509560 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9528491-1423-422e-a4db-a8eff4962d4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:02.510202 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9528491-1423-422e-a4db-a8eff4962d4b None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:02.510481 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9528491-1423-422e-a4db-a8eff4962d4b None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:02.510753 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9528491-1423-422e-a4db-a8eff4962d4b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:02.522018 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9528491-1423-422e-a4db-a8eff4962d4b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 09 00:43:02.527726 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application [None req-f9528491-1423-422e-a4db-a8eff4962d4b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 09 00:43:02.527726 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:43:02.527726 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:43:02.527726 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:43:02.527726 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:43:02.527726 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:43:02.527726 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:43:02.527726 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:43:02.527726 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:43:02.527726 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:43:02.527726 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:43:02.527726 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:43:02.527726 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 09 00:43:02.527726 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 09 00:43:02.527726 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 09 00:43:02.527726 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 09 00:43:02.528683 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 09 00:43:02.528683 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 09 00:43:02.528683 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 09 00:43:02.528683 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 09 00:43:02.528683 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:43:02.528683 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:43:02.528683 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:43:02.528683 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:43:02.528683 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:43:02.528683 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:43:02.528683 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:43:02.528683 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application with Lock( Oct 09 00:43:02.528683 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:43:02.528683 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:43:02.528683 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:43:02.528683 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:43:02.529526 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:43:02.529526 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:43:02.529526 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:43:02.529526 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:43:02.529526 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 09 00:43:02.529526 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 09 00:43:02.529526 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 09 00:43:02.529526 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 09 00:43:02.529526 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 09 00:43:02.529526 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 09 00:43:02.529526 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 09 00:43:02.529526 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Oct 09 00:43:02.529526 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 404/784] 10.222.0.15 () {56 vars in 1096 bytes} [Sun Oct 9 00:43:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:43:02.530245 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9528491-1423-422e-a4db-a8eff4962d4b None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:02.536155 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:02.549770 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:02.565145 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185416dc-c249-4b6a-b94d-20d045796894 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:02.610735 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bbfa32-b711-4df0-9def-00bffd67435e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:02.611556 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bbfa32-b711-4df0-9def-00bffd67435e None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:02.611934 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bbfa32-b711-4df0-9def-00bffd67435e None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:02.612308 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bbfa32-b711-4df0-9def-00bffd67435e None admin] PATH_INFO: `/v3/services` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:02.613033 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bbfa32-b711-4df0-9def-00bffd67435e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:02.614530 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bbfa32-b711-4df0-9def-00bffd67435e None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:02.627485 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 381/785] 10.222.0.15 () {56 vars in 1087 bytes} [Sun Oct 9 00:43:02 2022] GET /identity/v3/services => generated 772 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:43:02.628789 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bbfa32-b711-4df0-9def-00bffd67435e None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:02.653310 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9528491-1423-422e-a4db-a8eff4962d4b None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:02.698495 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd70c920-27e3-4360-ab9e-d610d38b6cec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:02.699201 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd70c920-27e3-4360-ab9e-d610d38b6cec None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:02.699514 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd70c920-27e3-4360-ab9e-d610d38b6cec None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:02.699983 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd70c920-27e3-4360-ab9e-d610d38b6cec None admin] PATH_INFO: `/v3/roles/service` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:02.713948 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd70c920-27e3-4360-ab9e-d610d38b6cec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 09 00:43:02.720113 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application [None req-dd70c920-27e3-4360-ab9e-d610d38b6cec None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 09 00:43:02.720113 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:43:02.720113 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:43:02.720113 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:43:02.720113 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:43:02.720113 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:43:02.720113 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:43:02.720113 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:43:02.720113 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:43:02.720113 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:43:02.720113 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:43:02.720113 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:43:02.720113 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 09 00:43:02.720113 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 09 00:43:02.720113 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 09 00:43:02.720113 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 09 00:43:02.722320 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 09 00:43:02.722320 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 09 00:43:02.722320 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 09 00:43:02.722320 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 09 00:43:02.722320 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:43:02.722320 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:43:02.722320 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:43:02.722320 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:43:02.722320 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:43:02.722320 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:43:02.722320 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:43:02.722320 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application with Lock( Oct 09 00:43:02.722320 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:43:02.722320 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:43:02.722320 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:43:02.722320 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:43:02.724318 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:43:02.724318 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:43:02.724318 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:43:02.724318 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:43:02.724318 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 09 00:43:02.724318 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 09 00:43:02.724318 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 09 00:43:02.724318 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 09 00:43:02.724318 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 09 00:43:02.724318 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 09 00:43:02.724318 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 09 00:43:02.724318 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Oct 09 00:43:02.724318 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 405/786] 10.222.0.15 () {56 vars in 1102 bytes} [Sun Oct 9 00:43:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:43:02.732485 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd70c920-27e3-4360-ab9e-d610d38b6cec None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:02.819670 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:02.854773 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd70c920-27e3-4360-ab9e-d610d38b6cec None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:02.898073 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbf5b82-4759-4749-91d2-2e1d8571eb97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:02.898767 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbf5b82-4759-4749-91d2-2e1d8571eb97 None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:02.899038 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbf5b82-4759-4749-91d2-2e1d8571eb97 None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:02.899330 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbf5b82-4759-4749-91d2-2e1d8571eb97 None admin] PATH_INFO: `/v3/roles` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:02.900007 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbf5b82-4759-4749-91d2-2e1d8571eb97 None admin] RBAC: Adding query filter params (name=service) {{(pid=81525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:43:02.900312 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbf5b82-4759-4749-91d2-2e1d8571eb97 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:02.901811 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbf5b82-4759-4749-91d2-2e1d8571eb97 None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:02.913210 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 406/787] 10.222.0.15 () {56 vars in 1103 bytes} [Sun Oct 9 00:43:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:43:02.921802 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbf5b82-4759-4749-91d2-2e1d8571eb97 None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:02.935580 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bbfa32-b711-4df0-9def-00bffd67435e None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:02.981680 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1e1dbe-bccb-4b14-b26f-26bc71fd8137 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:02.982602 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1e1dbe-bccb-4b14-b26f-26bc71fd8137 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:02.982878 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1e1dbe-bccb-4b14-b26f-26bc71fd8137 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:02.983148 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1e1dbe-bccb-4b14-b26f-26bc71fd8137 None admin] PATH_INFO: `/v3/roles` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:02.984039 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1e1dbe-bccb-4b14-b26f-26bc71fd8137 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:43:02.984345 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1e1dbe-bccb-4b14-b26f-26bc71fd8137 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:02.986159 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1e1dbe-bccb-4b14-b26f-26bc71fd8137 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:02.998676 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 382/788] 10.222.0.15 () {56 vars in 1099 bytes} [Sun Oct 9 00:43:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 370 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:43:03.006950 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1e1dbe-bccb-4b14-b26f-26bc71fd8137 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:03.021086 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:03.037426 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbf5b82-4759-4749-91d2-2e1d8571eb97 None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:03.077018 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688ff2e3-be2b-42ff-88c0-a167905c778b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:03.077670 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688ff2e3-be2b-42ff-88c0-a167905c778b None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:03.077995 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688ff2e3-be2b-42ff-88c0-a167905c778b None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:03.078208 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688ff2e3-be2b-42ff-88c0-a167905c778b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:03.090304 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688ff2e3-be2b-42ff-88c0-a167905c778b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:03.091829 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688ff2e3-be2b-42ff-88c0-a167905c778b None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:03.108022 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application [None req-688ff2e3-be2b-42ff-88c0-a167905c778b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:43:03.108022 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:43:03.108022 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:43:03.108022 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:43:03.108022 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:43:03.108022 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:43:03.108022 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:43:03.108022 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:43:03.108022 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:43:03.108022 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:43:03.108022 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:43:03.108022 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:43:03.108022 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 09 00:43:03.108022 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 09 00:43:03.108022 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 09 00:43:03.108022 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 09 00:43:03.109471 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:43:03.109471 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:43:03.109471 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:43:03.109471 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:43:03.109471 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:43:03.109471 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:43:03.109471 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:43:03.109471 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application with Lock( Oct 09 00:43:03.109471 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:43:03.109471 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:43:03.109471 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:43:03.109471 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:43:03.109471 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:43:03.109471 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:43:03.109471 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:43:03.109471 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:43:03.109471 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 09 00:43:03.110353 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 09 00:43:03.110353 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:43:03.110353 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Oct 09 00:43:03.111700 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:03.114124 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 407/789] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Oct 9 00:43:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:43:03.115460 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688ff2e3-be2b-42ff-88c0-a167905c778b None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:03.132428 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1e1dbe-bccb-4b14-b26f-26bc71fd8137 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:03.171370 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933a656b-f0a7-4a13-96e0-fbfa02d4b221 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:03.172379 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933a656b-f0a7-4a13-96e0-fbfa02d4b221 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:03.172850 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933a656b-f0a7-4a13-96e0-fbfa02d4b221 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:03.173312 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933a656b-f0a7-4a13-96e0-fbfa02d4b221 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:03.186043 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933a656b-f0a7-4a13-96e0-fbfa02d4b221 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:03.187895 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933a656b-f0a7-4a13-96e0-fbfa02d4b221 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:03.204498 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application [None req-933a656b-f0a7-4a13-96e0-fbfa02d4b221 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:43:03.204498 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:43:03.204498 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:43:03.204498 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:43:03.204498 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:43:03.204498 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:43:03.204498 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:43:03.204498 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:43:03.204498 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:43:03.204498 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:43:03.204498 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:43:03.204498 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:43:03.204498 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 09 00:43:03.204498 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 09 00:43:03.204498 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 09 00:43:03.204498 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 09 00:43:03.205612 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:43:03.205612 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:43:03.205612 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:43:03.205612 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:43:03.205612 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:43:03.205612 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:43:03.205612 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:43:03.205612 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application with Lock( Oct 09 00:43:03.205612 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:43:03.205612 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:43:03.205612 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:43:03.205612 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:43:03.205612 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:43:03.205612 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:43:03.205612 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:43:03.205612 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:43:03.205612 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 09 00:43:03.206491 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 09 00:43:03.206491 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:43:03.206491 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application Oct 09 00:43:03.209067 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 383/790] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Oct 9 00:43:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:43:03.215560 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933a656b-f0a7-4a13-96e0-fbfa02d4b221 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:03.280596 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:03.314188 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688ff2e3-be2b-42ff-88c0-a167905c778b None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:03.325032 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933a656b-f0a7-4a13-96e0-fbfa02d4b221 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:03.362104 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3762f6-0e3e-4cf6-9125-1ea94c1e11ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:03.363108 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3762f6-0e3e-4cf6-9125-1ea94c1e11ec None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:03.363829 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3762f6-0e3e-4cf6-9125-1ea94c1e11ec None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:03.364305 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3762f6-0e3e-4cf6-9125-1ea94c1e11ec None admin] PATH_INFO: `/v3/domains` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:03.365157 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3762f6-0e3e-4cf6-9125-1ea94c1e11ec None admin] RBAC: Adding query filter params (name=Default) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:43:03.365700 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3762f6-0e3e-4cf6-9125-1ea94c1e11ec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:03.367363 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3762f6-0e3e-4cf6-9125-1ea94c1e11ec None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:03.382257 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 384/791] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Oct 9 00:43:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 09 00:43:03.388772 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3762f6-0e3e-4cf6-9125-1ea94c1e11ec None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:03.406207 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14f452f-5e0b-4f3c-ae47-634f4d8116c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:03.407224 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14f452f-5e0b-4f3c-ae47-634f4d8116c0 None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:03.409257 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14f452f-5e0b-4f3c-ae47-634f4d8116c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:03.409769 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14f452f-5e0b-4f3c-ae47-634f4d8116c0 None admin] PATH_INFO: `/v3/domains` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:03.410631 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14f452f-5e0b-4f3c-ae47-634f4d8116c0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:43:03.411135 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14f452f-5e0b-4f3c-ae47-634f4d8116c0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:03.413608 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14f452f-5e0b-4f3c-ae47-634f4d8116c0 None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:03.438917 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 408/792] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Oct 9 00:43:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:43:03.444347 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14f452f-5e0b-4f3c-ae47-634f4d8116c0 None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:03.531633 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:03.595294 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3762f6-0e3e-4cf6-9125-1ea94c1e11ec None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:03.633794 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:03.637173 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14f452f-5e0b-4f3c-ae47-634f4d8116c0 None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:03.676232 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f61c74-0d1b-47e0-8e44-d69768339af9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:03.676890 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f61c74-0d1b-47e0-8e44-d69768339af9 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:03.677161 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f61c74-0d1b-47e0-8e44-d69768339af9 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:03.677432 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f61c74-0d1b-47e0-8e44-d69768339af9 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:03.692165 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f61c74-0d1b-47e0-8e44-d69768339af9 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:03.693662 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f61c74-0d1b-47e0-8e44-d69768339af9 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:03.707989 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da89d5bd-073d-4131-932b-9df4f287adbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:03.708635 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da89d5bd-073d-4131-932b-9df4f287adbe None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:03.708899 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da89d5bd-073d-4131-932b-9df4f287adbe None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:03.709166 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da89d5bd-073d-4131-932b-9df4f287adbe None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:03.712044 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application [None req-78f61c74-0d1b-47e0-8e44-d69768339af9 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 09 00:43:03.712044 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:43:03.712044 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:43:03.712044 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:43:03.712044 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:43:03.712044 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:43:03.712044 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:43:03.712044 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:43:03.712044 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:43:03.712044 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:43:03.712044 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:43:03.712044 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:43:03.712044 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 09 00:43:03.712044 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 09 00:43:03.712044 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 09 00:43:03.712044 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 09 00:43:03.712954 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:43:03.712954 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:43:03.712954 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 09 00:43:03.712954 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 09 00:43:03.712954 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 09 00:43:03.712954 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 09 00:43:03.712954 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:43:03.712954 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:43:03.712954 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:43:03.712954 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:43:03.712954 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:43:03.712954 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application with Lock( Oct 09 00:43:03.712954 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:43:03.712954 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:43:03.712954 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:43:03.712954 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:43:03.712954 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:43:03.712954 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:43:03.713892 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:43:03.713892 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:43:03.713892 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 09 00:43:03.713892 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 09 00:43:03.713892 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 09 00:43:03.713892 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 09 00:43:03.713892 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 09 00:43:03.713892 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 09 00:43:03.713892 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 09 00:43:03.713892 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application Oct 09 00:43:03.713892 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 385/793] 10.222.0.15 () {56 vars in 1096 bytes} [Sun Oct 9 00:43:03 2022] GET /identity/v3/users/swift => generated 83 bytes in 325 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 09 00:43:03.721081 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f61c74-0d1b-47e0-8e44-d69768339af9 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:03.722798 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da89d5bd-073d-4131-932b-9df4f287adbe None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:03.724313 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da89d5bd-073d-4131-932b-9df4f287adbe None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:03.744674 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application [None req-da89d5bd-073d-4131-932b-9df4f287adbe None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 09 00:43:03.744674 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:43:03.744674 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:43:03.744674 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:43:03.744674 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:43:03.744674 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:43:03.744674 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:43:03.744674 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:43:03.744674 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:43:03.744674 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:43:03.744674 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:43:03.744674 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:43:03.744674 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 09 00:43:03.744674 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 09 00:43:03.744674 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 09 00:43:03.744674 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 09 00:43:03.745711 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:43:03.745711 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:43:03.745711 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 09 00:43:03.745711 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 09 00:43:03.745711 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 09 00:43:03.745711 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 09 00:43:03.745711 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:43:03.745711 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:43:03.745711 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:43:03.745711 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:43:03.745711 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:43:03.745711 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application with Lock( Oct 09 00:43:03.745711 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:43:03.745711 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:43:03.745711 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:43:03.745711 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:43:03.745711 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:43:03.745711 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:43:03.746639 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:43:03.746639 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:43:03.746639 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 09 00:43:03.746639 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 09 00:43:03.746639 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 09 00:43:03.746639 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 09 00:43:03.746639 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 09 00:43:03.746639 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 09 00:43:03.746639 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 09 00:43:03.746639 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Oct 09 00:43:03.746639 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 409/794] 10.222.0.15 () {56 vars in 1117 bytes} [Sun Oct 9 00:43:03 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:43:03.752052 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da89d5bd-073d-4131-932b-9df4f287adbe None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:03.925266 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f61c74-0d1b-47e0-8e44-d69768339af9 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:03.940087 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da89d5bd-073d-4131-932b-9df4f287adbe None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:03.959715 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:04.004009 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516192d0-9f13-4ace-b2c1-0ca351522b2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:04.004898 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516192d0-9f13-4ace-b2c1-0ca351522b2c None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:04.005352 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516192d0-9f13-4ace-b2c1-0ca351522b2c None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:04.005759 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516192d0-9f13-4ace-b2c1-0ca351522b2c None admin] PATH_INFO: `/v3/users` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:04.006643 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516192d0-9f13-4ace-b2c1-0ca351522b2c None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:43:04.007138 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516192d0-9f13-4ace-b2c1-0ca351522b2c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:04.012777 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516192d0-9f13-4ace-b2c1-0ca351522b2c None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:04.015399 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb98367-0a0a-4367-9698-e79307968c0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:04.016030 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb98367-0a0a-4367-9698-e79307968c0b None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:04.016305 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb98367-0a0a-4367-9698-e79307968c0b None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:04.016591 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb98367-0a0a-4367-9698-e79307968c0b None admin] PATH_INFO: `/v3/users` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:04.017652 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb98367-0a0a-4367-9698-e79307968c0b None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:43:04.018159 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb98367-0a0a-4367-9698-e79307968c0b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:04.020738 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb98367-0a0a-4367-9698-e79307968c0b None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:04.060615 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 386/795] 10.222.0.15 () {56 vars in 1135 bytes} [Sun Oct 9 00:43:03 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:43:04.062162 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516192d0-9f13-4ace-b2c1-0ca351522b2c None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:04.062738 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 410/796] 10.222.0.15 () {56 vars in 1149 bytes} [Sun Oct 9 00:43:03 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:43:04.076146 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb98367-0a0a-4367-9698-e79307968c0b None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:04.114368 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:04.189688 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516192d0-9f13-4ace-b2c1-0ca351522b2c None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:04.233712 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319e93fa-8f5d-4dee-8a86-e77d41e7512f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:04.234287 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319e93fa-8f5d-4dee-8a86-e77d41e7512f None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:04.234557 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319e93fa-8f5d-4dee-8a86-e77d41e7512f None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:04.234823 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319e93fa-8f5d-4dee-8a86-e77d41e7512f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:04.260557 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319e93fa-8f5d-4dee-8a86-e77d41e7512f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:04.262027 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319e93fa-8f5d-4dee-8a86-e77d41e7512f None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:04.292269 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application [None req-319e93fa-8f5d-4dee-8a86-e77d41e7512f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:43:04.292269 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:43:04.292269 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:43:04.292269 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:43:04.292269 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:43:04.292269 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:43:04.292269 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:43:04.292269 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:43:04.292269 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:43:04.292269 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:43:04.292269 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:43:04.292269 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:43:04.292269 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 09 00:43:04.292269 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 09 00:43:04.292269 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 09 00:43:04.292269 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 09 00:43:04.293282 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:43:04.293282 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:43:04.293282 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:43:04.293282 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:43:04.293282 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:43:04.293282 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:43:04.293282 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:43:04.293282 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application with Lock( Oct 09 00:43:04.293282 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:43:04.293282 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:43:04.293282 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:43:04.293282 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:43:04.293282 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:43:04.293282 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:43:04.293282 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:43:04.293282 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:43:04.293282 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 09 00:43:04.294172 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 09 00:43:04.294172 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:43:04.294172 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application Oct 09 00:43:04.298264 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 387/797] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Oct 9 00:43:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:43:04.304178 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319e93fa-8f5d-4dee-8a86-e77d41e7512f None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:04.326027 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb98367-0a0a-4367-9698-e79307968c0b None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:04.386149 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b1b9f3-076c-4565-aca4-2b3f54d83ad7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:04.386811 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b1b9f3-076c-4565-aca4-2b3f54d83ad7 None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:04.387093 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b1b9f3-076c-4565-aca4-2b3f54d83ad7 None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:04.387413 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b1b9f3-076c-4565-aca4-2b3f54d83ad7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:04.413113 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b1b9f3-076c-4565-aca4-2b3f54d83ad7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:04.414638 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b1b9f3-076c-4565-aca4-2b3f54d83ad7 None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:04.436935 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application [None req-f6b1b9f3-076c-4565-aca4-2b3f54d83ad7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:43:04.436935 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:43:04.436935 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:43:04.436935 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:43:04.436935 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:43:04.436935 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:43:04.436935 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:43:04.436935 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:43:04.436935 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:43:04.436935 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:43:04.436935 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:43:04.436935 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:43:04.436935 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 09 00:43:04.436935 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 09 00:43:04.436935 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 09 00:43:04.436935 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 09 00:43:04.438025 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:43:04.438025 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:43:04.438025 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:43:04.438025 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:43:04.438025 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:43:04.438025 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:43:04.438025 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:43:04.438025 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application with Lock( Oct 09 00:43:04.438025 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:43:04.438025 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:43:04.438025 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:43:04.438025 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:43:04.438025 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:43:04.438025 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:43:04.438025 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:43:04.438025 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:43:04.438025 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 09 00:43:04.438905 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 09 00:43:04.438905 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:43:04.438905 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Oct 09 00:43:04.442767 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 411/798] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Oct 9 00:43:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 363 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 09 00:43:04.444412 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7aaab1-e1a5-4329-a421-6972fc1175a9 None None] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:04.444697 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7aaab1-e1a5-4329-a421-6972fc1175a9 None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:04.444972 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7aaab1-e1a5-4329-a421-6972fc1175a9 None None] PATH_INFO: `/` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:04.451101 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 412/799] 10.222.0.15 () {54 vars in 927 bytes} [Sun Oct 9 00:43:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:43:04.451101 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7aaab1-e1a5-4329-a421-6972fc1175a9 None None] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:04.472677 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:04.484169 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:04.499398 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319e93fa-8f5d-4dee-8a86-e77d41e7512f None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:04.546624 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c4feb9-b796-4c90-bd26-b6f2f8d7f4e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:04.547763 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c4feb9-b796-4c90-bd26-b6f2f8d7f4e9 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:04.548295 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c4feb9-b796-4c90-bd26-b6f2f8d7f4e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:04.548819 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c4feb9-b796-4c90-bd26-b6f2f8d7f4e9 None admin] PATH_INFO: `/v3/domains` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:04.549672 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c4feb9-b796-4c90-bd26-b6f2f8d7f4e9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:43:04.550166 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c4feb9-b796-4c90-bd26-b6f2f8d7f4e9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:04.551781 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c4feb9-b796-4c90-bd26-b6f2f8d7f4e9 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:04.566407 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 388/800] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Oct 9 00:43:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:43:04.568013 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358619ad-480f-49ad-9531-0bab53b14154 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:04.568518 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358619ad-480f-49ad-9531-0bab53b14154 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:04.568989 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358619ad-480f-49ad-9531-0bab53b14154 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:04.589441 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-358619ad-480f-49ad-9531-0bab53b14154 None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:43:04.590479 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7aaab1-e1a5-4329-a421-6972fc1175a9 None None] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:04.590681 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-358619ad-480f-49ad-9531-0bab53b14154 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:43:04.634526 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a7192d-4f32-4435-962b-8bf3485a5dd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:04.635626 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a7192d-4f32-4435-962b-8bf3485a5dd4 None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:04.635929 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a7192d-4f32-4435-962b-8bf3485a5dd4 None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:04.636189 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a7192d-4f32-4435-962b-8bf3485a5dd4 None admin] PATH_INFO: `/v3/domains` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:04.637272 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a7192d-4f32-4435-962b-8bf3485a5dd4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:43:04.637696 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a7192d-4f32-4435-962b-8bf3485a5dd4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:04.639481 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a7192d-4f32-4435-962b-8bf3485a5dd4 None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:04.655463 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 413/801] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Oct 9 00:43:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 09 00:43:04.656668 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a7192d-4f32-4435-962b-8bf3485a5dd4 None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:04.664500 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 389/802] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Oct 9 00:43:04 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 09 00:43:04.666231 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313865ed-20b3-4b12-98ea-5a06d801aa19 None None] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:04.666718 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313865ed-20b3-4b12-98ea-5a06d801aa19 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:04.667185 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313865ed-20b3-4b12-98ea-5a06d801aa19 None None] PATH_INFO: `/` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:04.669025 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 390/803] 10.222.0.15 () {54 vars in 927 bytes} [Sun Oct 9 00:43:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:43:04.669950 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313865ed-20b3-4b12-98ea-5a06d801aa19 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:04.747100 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:04.771853 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:04.779032 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a7192d-4f32-4435-962b-8bf3485a5dd4 None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:04.795922 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313865ed-20b3-4b12-98ea-5a06d801aa19 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:04.816198 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d88c2d1-08cd-49a4-861d-fcf4fc9c5832 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:04.817344 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d88c2d1-08cd-49a4-861d-fcf4fc9c5832 None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:04.817807 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d88c2d1-08cd-49a4-861d-fcf4fc9c5832 None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:04.818247 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d88c2d1-08cd-49a4-861d-fcf4fc9c5832 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:04.826035 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d88c2d1-08cd-49a4-861d-fcf4fc9c5832 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:04.828069 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d88c2d1-08cd-49a4-861d-fcf4fc9c5832 None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:04.836156 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218beced-6222-4f09-8e2d-76079ede50ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:04.837101 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218beced-6222-4f09-8e2d-76079ede50ba None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:04.837572 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218beced-6222-4f09-8e2d-76079ede50ba None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:04.838033 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218beced-6222-4f09-8e2d-76079ede50ba None admin] PATH_INFO: `/v3/projects/service` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:04.841840 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application [None req-0d88c2d1-08cd-49a4-861d-fcf4fc9c5832 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 09 00:43:04.841840 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:43:04.841840 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:43:04.841840 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:43:04.841840 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:43:04.841840 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:43:04.841840 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:43:04.841840 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:43:04.841840 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:43:04.841840 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:43:04.841840 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:43:04.841840 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:43:04.841840 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 09 00:43:04.841840 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 09 00:43:04.841840 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 09 00:43:04.842725 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 09 00:43:04.842725 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:43:04.842725 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:43:04.842725 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:43:04.842725 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:43:04.842725 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:43:04.842725 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:43:04.842725 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:43:04.842725 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application with Lock( Oct 09 00:43:04.842725 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:43:04.842725 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:43:04.842725 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:43:04.842725 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:43:04.842725 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:43:04.842725 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:43:04.842725 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:43:04.842725 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:43:04.843658 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 09 00:43:04.843658 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 09 00:43:04.843658 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 09 00:43:04.843658 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 09 00:43:04.843658 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 09 00:43:04.843658 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 09 00:43:04.843658 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 09 00:43:04.843658 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Oct 09 00:43:04.843658 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 414/804] 10.222.0.15 () {56 vars in 1111 bytes} [Sun Oct 9 00:43:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:43:04.844689 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a659bcd-81dd-4a51-adb2-34b12d8f5150 None None] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:04.844966 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a659bcd-81dd-4a51-adb2-34b12d8f5150 None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:04.845291 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a659bcd-81dd-4a51-adb2-34b12d8f5150 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:04.849134 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218beced-6222-4f09-8e2d-76079ede50ba None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:04.850811 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218beced-6222-4f09-8e2d-76079ede50ba None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:04.865789 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.auth.core [None req-0a659bcd-81dd-4a51-adb2-34b12d8f5150 None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:43:04.867055 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-0a659bcd-81dd-4a51-adb2-34b12d8f5150 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:43:04.958903 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 415/805] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Oct 9 00:43:04 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 09 00:43:04.960406 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a659bcd-81dd-4a51-adb2-34b12d8f5150 None None] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:04.988162 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application [None req-218beced-6222-4f09-8e2d-76079ede50ba None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 09 00:43:04.988162 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:43:04.988162 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:43:04.988162 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:43:04.988162 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:43:04.988162 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:43:04.988162 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:43:04.988162 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:43:04.988162 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:43:04.988162 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:43:04.988162 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:43:04.988162 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:43:04.988162 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 09 00:43:04.988162 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 09 00:43:04.988162 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 09 00:43:04.989153 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 09 00:43:04.989153 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:43:04.989153 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:43:04.989153 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:43:04.989153 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:43:04.989153 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:43:04.989153 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:43:04.989153 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:43:04.989153 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application with Lock( Oct 09 00:43:04.989153 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:43:04.989153 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:43:04.989153 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:43:04.989153 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:43:04.989153 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:43:04.989153 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:43:04.989153 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:43:04.989153 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:43:04.990096 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 09 00:43:04.990096 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 09 00:43:04.990096 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 09 00:43:04.990096 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 09 00:43:04.990096 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 09 00:43:04.990096 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 09 00:43:04.990096 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 09 00:43:04.990096 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application Oct 09 00:43:04.990096 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 391/806] 10.222.0.15 () {56 vars in 1111 bytes} [Sun Oct 9 00:43:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 320 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:43:04.994808 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218beced-6222-4f09-8e2d-76079ede50ba None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:05.055095 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:05.100055 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a659bcd-81dd-4a51-adb2-34b12d8f5150 None None] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:05.114667 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218beced-6222-4f09-8e2d-76079ede50ba None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:05.146201 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a71e3f-18e9-45c0-8f27-d3144e4d97aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:05.147536 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a71e3f-18e9-45c0-8f27-d3144e4d97aa None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:05.148212 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a71e3f-18e9-45c0-8f27-d3144e4d97aa None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:05.148688 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a71e3f-18e9-45c0-8f27-d3144e4d97aa None admin] PATH_INFO: `/v3/projects` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:05.150132 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a71e3f-18e9-45c0-8f27-d3144e4d97aa None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:43:05.150714 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a71e3f-18e9-45c0-8f27-d3144e4d97aa None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:05.152602 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a71e3f-18e9-45c0-8f27-d3144e4d97aa None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:05.153648 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de729aa-d8d4-4730-8b0f-9a2c0ef94e39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:05.154287 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de729aa-d8d4-4730-8b0f-9a2c0ef94e39 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:05.154562 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de729aa-d8d4-4730-8b0f-9a2c0ef94e39 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:05.154831 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de729aa-d8d4-4730-8b0f-9a2c0ef94e39 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:05.155527 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de729aa-d8d4-4730-8b0f-9a2c0ef94e39 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:05.156981 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de729aa-d8d4-4730-8b0f-9a2c0ef94e39 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:05.172138 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application [None req-3de729aa-d8d4-4730-8b0f-9a2c0ef94e39 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 09 00:43:05.172138 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:43:05.172138 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 09 00:43:05.172138 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 09 00:43:05.172138 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 09 00:43:05.172138 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 09 00:43:05.172138 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 09 00:43:05.172138 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 09 00:43:05.172138 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 09 00:43:05.172138 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application Oct 09 00:43:05.172138 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 09 00:43:05.172138 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application Oct 09 00:43:05.172138 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:43:05.172138 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:43:05.172138 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:43:05.172138 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:43:05.172138 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:43:05.173296 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:43:05.173296 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:43:05.173296 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:43:05.173296 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:43:05.173296 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:43:05.173296 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:43:05.173296 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 09 00:43:05.173296 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 09 00:43:05.173296 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 09 00:43:05.173296 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 09 00:43:05.173296 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:43:05.173296 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:43:05.173296 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:43:05.173296 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:43:05.173296 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:43:05.173296 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:43:05.174132 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:43:05.174132 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application with Lock( Oct 09 00:43:05.174132 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:43:05.174132 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:43:05.174132 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:43:05.174132 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:43:05.174132 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:43:05.174132 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:43:05.174132 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:43:05.174132 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:43:05.174132 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 09 00:43:05.174132 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 09 00:43:05.174132 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 09 00:43:05.174132 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application Oct 09 00:43:05.174132 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 392/807] 10.222.0.15 () {56 vars in 1129 bytes} [Sun Oct 9 00:43:04 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:43:05.174934 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de729aa-d8d4-4730-8b0f-9a2c0ef94e39 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:05.175002 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 416/808] 10.222.0.15 () {56 vars in 1148 bytes} [Sun Oct 9 00:43:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:43:05.180688 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:05.183021 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a71e3f-18e9-45c0-8f27-d3144e4d97aa None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:05.293973 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de729aa-d8d4-4730-8b0f-9a2c0ef94e39 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:05.294729 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a71e3f-18e9-45c0-8f27-d3144e4d97aa None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:05.322801 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:05.330646 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37128bf1-b41a-4b43-8920-9ca132757d85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:05.331354 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37128bf1-b41a-4b43-8920-9ca132757d85 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:05.331573 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37128bf1-b41a-4b43-8920-9ca132757d85 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:05.331831 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37128bf1-b41a-4b43-8920-9ca132757d85 None admin] PATH_INFO: `/v3/projects` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:05.332385 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8450bf90-0af4-41cb-ac83-9fd8e25efef8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:05.332831 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37128bf1-b41a-4b43-8920-9ca132757d85 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:43:05.332831 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37128bf1-b41a-4b43-8920-9ca132757d85 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:05.333102 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8450bf90-0af4-41cb-ac83-9fd8e25efef8 None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:05.333279 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8450bf90-0af4-41cb-ac83-9fd8e25efef8 None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:05.333552 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8450bf90-0af4-41cb-ac83-9fd8e25efef8 None admin] PATH_INFO: `/v3/services` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:05.334178 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8450bf90-0af4-41cb-ac83-9fd8e25efef8 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:43:05.334270 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37128bf1-b41a-4b43-8920-9ca132757d85 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:05.334481 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8450bf90-0af4-41cb-ac83-9fd8e25efef8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:05.336091 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8450bf90-0af4-41cb-ac83-9fd8e25efef8 None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:05.345501 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 417/809] 10.222.0.15 () {56 vars in 1124 bytes} [Sun Oct 9 00:43:05 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 09 00:43:05.351529 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8450bf90-0af4-41cb-ac83-9fd8e25efef8 None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:05.351732 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 393/810] 10.222.0.15 () {56 vars in 1148 bytes} [Sun Oct 9 00:43:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:43:05.351732 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37128bf1-b41a-4b43-8920-9ca132757d85 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:05.417545 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:05.459777 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8450bf90-0af4-41cb-ac83-9fd8e25efef8 None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:05.465853 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37128bf1-b41a-4b43-8920-9ca132757d85 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:05.497731 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbd1fd9-c0e4-4699-ae37-80ad46d10f43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:05.498748 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbd1fd9-c0e4-4699-ae37-80ad46d10f43 None admin] REQUEST_METHOD: `PUT` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:05.499024 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbd1fd9-c0e4-4699-ae37-80ad46d10f43 None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:05.499324 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbd1fd9-c0e4-4699-ae37-80ad46d10f43 None admin] PATH_INFO: `/v3/projects/f148d39ced534860abfbe8fc3f98ace4/users/c4c467943b8f4d31a2f067ca6ed3b25c/roles/f69dddf26daf4dd79d4c962beb877af5` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:05.501236 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbd1fd9-c0e4-4699-ae37-80ad46d10f43 None admin] RBAC: Authorizing `identity:create_grant(project_id=f148d39ced534860abfbe8fc3f98ace4, user_id=c4c467943b8f4d31a2f067ca6ed3b25c, role_id=f69dddf26daf4dd79d4c962beb877af5)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:05.502685 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbd1fd9-c0e4-4699-ae37-80ad46d10f43 None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:05.511841 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30eced32-6d3a-4a5e-abe7-fd78043914f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:05.512484 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30eced32-6d3a-4a5e-abe7-fd78043914f1 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:05.512750 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30eced32-6d3a-4a5e-abe7-fd78043914f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:05.513052 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30eced32-6d3a-4a5e-abe7-fd78043914f1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:05.527304 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 418/811] 10.222.0.15 () {58 vars in 1439 bytes} [Sun Oct 9 00:43:05 2022] PUT /identity/v3/projects/f148d39ced534860abfbe8fc3f98ace4/users/c4c467943b8f4d31a2f067ca6ed3b25c/roles/f69dddf26daf4dd79d4c962beb877af5 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 00:43:05.527304 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbd1fd9-c0e4-4699-ae37-80ad46d10f43 None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:05.533988 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30eced32-6d3a-4a5e-abe7-fd78043914f1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 09 00:43:05.539911 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application [None req-30eced32-6d3a-4a5e-abe7-fd78043914f1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 09 00:43:05.539911 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:43:05.539911 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:43:05.539911 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:43:05.539911 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:43:05.539911 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:43:05.539911 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:43:05.539911 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:43:05.539911 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:43:05.539911 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:43:05.539911 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:43:05.539911 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:43:05.539911 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 09 00:43:05.539911 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 09 00:43:05.539911 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 09 00:43:05.539911 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 09 00:43:05.541142 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 09 00:43:05.541142 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 09 00:43:05.541142 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 09 00:43:05.541142 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 09 00:43:05.541142 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:43:05.541142 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:43:05.541142 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:43:05.541142 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:43:05.541142 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:43:05.541142 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:43:05.541142 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:43:05.541142 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application with Lock( Oct 09 00:43:05.541142 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:43:05.541142 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:43:05.541142 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:43:05.541142 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:43:05.542166 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:43:05.542166 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:43:05.542166 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:43:05.542166 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:43:05.542166 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 09 00:43:05.542166 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 09 00:43:05.542166 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 09 00:43:05.542166 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 09 00:43:05.542166 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 09 00:43:05.542166 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 09 00:43:05.542166 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 09 00:43:05.542166 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application Oct 09 00:43:05.544314 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 394/812] 10.222.0.15 () {56 vars in 1096 bytes} [Sun Oct 9 00:43:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:43:05.544992 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30eced32-6d3a-4a5e-abe7-fd78043914f1 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:05.599799 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:05.661510 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbd1fd9-c0e4-4699-ae37-80ad46d10f43 None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:05.668836 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30eced32-6d3a-4a5e-abe7-fd78043914f1 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:05.694858 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:05.701548 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dca78f8-fea8-410b-9b5a-c30ce6a0743d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:05.702185 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dca78f8-fea8-410b-9b5a-c30ce6a0743d None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:05.702461 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dca78f8-fea8-410b-9b5a-c30ce6a0743d None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:05.702728 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dca78f8-fea8-410b-9b5a-c30ce6a0743d None admin] PATH_INFO: `/v3/services` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:05.703412 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dca78f8-fea8-410b-9b5a-c30ce6a0743d None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:43:05.703716 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dca78f8-fea8-410b-9b5a-c30ce6a0743d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:05.705147 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dca78f8-fea8-410b-9b5a-c30ce6a0743d None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:05.708995 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3529dc-e792-435b-97d6-9a8b484c7df5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:05.709689 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3529dc-e792-435b-97d6-9a8b484c7df5 None admin] REQUEST_METHOD: `PUT` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:05.709961 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3529dc-e792-435b-97d6-9a8b484c7df5 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:05.710228 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3529dc-e792-435b-97d6-9a8b484c7df5 None admin] PATH_INFO: `/v3/projects/f148d39ced534860abfbe8fc3f98ace4/users/3a6cfef106c84f759ce0874be77f7380/roles/6fe3faf520bd402f9bd78d3ed08eec34` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:05.715561 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 419/813] 10.222.0.15 () {56 vars in 1124 bytes} [Sun Oct 9 00:43:05 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:43:05.715561 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dca78f8-fea8-410b-9b5a-c30ce6a0743d None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:05.736775 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3529dc-e792-435b-97d6-9a8b484c7df5 None admin] RBAC: Authorizing `identity:create_grant(project_id=f148d39ced534860abfbe8fc3f98ace4, user_id=3a6cfef106c84f759ce0874be77f7380, role_id=6fe3faf520bd402f9bd78d3ed08eec34)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:05.738247 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3529dc-e792-435b-97d6-9a8b484c7df5 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:05.755768 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 395/814] 10.222.0.15 () {58 vars in 1439 bytes} [Sun Oct 9 00:43:05 2022] PUT /identity/v3/projects/f148d39ced534860abfbe8fc3f98ace4/users/3a6cfef106c84f759ce0874be77f7380/roles/6fe3faf520bd402f9bd78d3ed08eec34 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 00:43:05.757032 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b48e736-5ae3-4aa4-8682-1c109967a182 None None] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:05.757317 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b48e736-5ae3-4aa4-8682-1c109967a182 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:05.757732 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b48e736-5ae3-4aa4-8682-1c109967a182 None None] PATH_INFO: `/` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:05.759252 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 396/815] 10.222.0.15 () {54 vars in 927 bytes} [Sun Oct 9 00:43:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:43:05.759252 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b48e736-5ae3-4aa4-8682-1c109967a182 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:05.833940 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dca78f8-fea8-410b-9b5a-c30ce6a0743d None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:05.850056 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:05.873805 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49dd4d8-fb53-419e-b54f-66b2885eeaf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:05.874421 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49dd4d8-fb53-419e-b54f-66b2885eeaf4 None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:05.874697 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49dd4d8-fb53-419e-b54f-66b2885eeaf4 None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:05.874967 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49dd4d8-fb53-419e-b54f-66b2885eeaf4 None admin] PATH_INFO: `/v3/roles` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:05.875770 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49dd4d8-fb53-419e-b54f-66b2885eeaf4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:43:05.876077 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49dd4d8-fb53-419e-b54f-66b2885eeaf4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:05.877498 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49dd4d8-fb53-419e-b54f-66b2885eeaf4 None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:05.888880 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 420/816] 10.222.0.15 () {56 vars in 1099 bytes} [Sun Oct 9 00:43:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:43:05.890305 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e777ea71-6cb4-408e-afc5-6b77f9e766c5 None None] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:05.890587 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e777ea71-6cb4-408e-afc5-6b77f9e766c5 None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:05.890889 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e777ea71-6cb4-408e-afc5-6b77f9e766c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:05.911033 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.auth.core [None req-e777ea71-6cb4-408e-afc5-6b77f9e766c5 None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:43:05.912346 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-e777ea71-6cb4-408e-afc5-6b77f9e766c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:43:05.933397 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b48e736-5ae3-4aa4-8682-1c109967a182 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:05.975506 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596dc551-d07a-4419-9e28-77647c1d456e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:05.976214 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596dc551-d07a-4419-9e28-77647c1d456e None admin] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:05.976523 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596dc551-d07a-4419-9e28-77647c1d456e None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:05.976791 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596dc551-d07a-4419-9e28-77647c1d456e None admin] PATH_INFO: `/v3/endpoints` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:05.977468 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596dc551-d07a-4419-9e28-77647c1d456e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:05.979008 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596dc551-d07a-4419-9e28-77647c1d456e None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:05.992718 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 421/817] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Oct 9 00:43:05 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 09 00:43:05.993966 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e777ea71-6cb4-408e-afc5-6b77f9e766c5 None None] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:06.006871 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 397/818] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Oct 9 00:43:05 2022] POST /identity/v3/endpoints => generated 346 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 09 00:43:06.109894 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e777ea71-6cb4-408e-afc5-6b77f9e766c5 None None] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:06.120160 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:06.177358 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d9ddd9-5908-434b-b813-31f4d655ba22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:06.178025 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d9ddd9-5908-434b-b813-31f4d655ba22 None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:06.178301 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d9ddd9-5908-434b-b813-31f4d655ba22 None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:06.178570 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d9ddd9-5908-434b-b813-31f4d655ba22 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:06.195245 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d9ddd9-5908-434b-b813-31f4d655ba22 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:06.196785 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d9ddd9-5908-434b-b813-31f4d655ba22 None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:06.215065 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application [None req-35d9ddd9-5908-434b-b813-31f4d655ba22 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:43:06.215065 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:43:06.215065 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:43:06.215065 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:43:06.215065 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:43:06.215065 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:43:06.215065 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:43:06.215065 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:43:06.215065 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:43:06.215065 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:43:06.215065 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:43:06.215065 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:43:06.215065 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 09 00:43:06.215065 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 09 00:43:06.215065 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 09 00:43:06.215065 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 09 00:43:06.216114 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:43:06.216114 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:43:06.216114 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:43:06.216114 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:43:06.216114 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:43:06.216114 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:43:06.216114 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:43:06.216114 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application with Lock( Oct 09 00:43:06.216114 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:43:06.216114 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:43:06.216114 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:43:06.216114 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:43:06.216114 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:43:06.216114 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:43:06.216114 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:43:06.216114 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:43:06.216114 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 09 00:43:06.217021 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 09 00:43:06.217021 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:43:06.217021 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Oct 09 00:43:06.217021 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 422/819] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Oct 9 00:43:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:43:06.222087 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596dc551-d07a-4419-9e28-77647c1d456e None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:06.271128 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:06.339995 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d9ddd9-5908-434b-b813-31f4d655ba22 None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:06.345430 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596dc551-d07a-4419-9e28-77647c1d456e None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:06.380854 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70113a5-4159-4b8a-9cc2-e596fcee5017 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:06.381494 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70113a5-4159-4b8a-9cc2-e596fcee5017 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:06.381773 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70113a5-4159-4b8a-9cc2-e596fcee5017 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:06.382038 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70113a5-4159-4b8a-9cc2-e596fcee5017 None admin] PATH_INFO: `/v3/domains` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:06.382811 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70113a5-4159-4b8a-9cc2-e596fcee5017 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:43:06.383113 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70113a5-4159-4b8a-9cc2-e596fcee5017 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:06.384536 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70113a5-4159-4b8a-9cc2-e596fcee5017 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:06.402330 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 398/820] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Oct 9 00:43:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:43:06.403800 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70113a5-4159-4b8a-9cc2-e596fcee5017 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:06.487218 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d9ddd9-5908-434b-b813-31f4d655ba22 None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:06.508811 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:06.518280 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70113a5-4159-4b8a-9cc2-e596fcee5017 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:06.537317 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f16610-779c-4e5a-85f8-b5b3b91e326c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:06.538360 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f16610-779c-4e5a-85f8-b5b3b91e326c None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:06.538885 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f16610-779c-4e5a-85f8-b5b3b91e326c None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:06.539468 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f16610-779c-4e5a-85f8-b5b3b91e326c None admin] PATH_INFO: `/v3/services/network` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:06.540253 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f16610-779c-4e5a-85f8-b5b3b91e326c None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:06.541880 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f16610-779c-4e5a-85f8-b5b3b91e326c None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:06.553509 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2249b0c7-b545-4196-b5a9-888c5d7f7379 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:06.554141 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2249b0c7-b545-4196-b5a9-888c5d7f7379 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:06.554468 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2249b0c7-b545-4196-b5a9-888c5d7f7379 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:06.554734 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2249b0c7-b545-4196-b5a9-888c5d7f7379 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:06.558346 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application [None req-22f16610-779c-4e5a-85f8-b5b3b91e326c None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 09 00:43:06.558346 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:43:06.558346 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 09 00:43:06.558346 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 09 00:43:06.558346 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 09 00:43:06.558346 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 09 00:43:06.558346 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 09 00:43:06.558346 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 09 00:43:06.558346 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 09 00:43:06.558346 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Oct 09 00:43:06.558346 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 09 00:43:06.558346 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Oct 09 00:43:06.558346 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:43:06.558346 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:43:06.558346 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:43:06.558346 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:43:06.558346 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:43:06.559359 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:43:06.559359 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:43:06.559359 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:43:06.559359 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:43:06.559359 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:43:06.559359 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:43:06.559359 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 09 00:43:06.559359 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 09 00:43:06.559359 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 09 00:43:06.559359 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 09 00:43:06.559359 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:43:06.559359 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:43:06.559359 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:43:06.559359 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:43:06.559359 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:43:06.559359 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:43:06.560196 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:43:06.560196 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application with Lock( Oct 09 00:43:06.560196 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:43:06.560196 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:43:06.560196 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:43:06.560196 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:43:06.560196 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:43:06.560196 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:43:06.560196 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:43:06.560196 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:43:06.560196 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 09 00:43:06.560196 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 09 00:43:06.560196 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 09 00:43:06.560196 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Oct 09 00:43:06.566264 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2249b0c7-b545-4196-b5a9-888c5d7f7379 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:06.566264 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2249b0c7-b545-4196-b5a9-888c5d7f7379 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:06.568388 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 423/821] 10.222.0.15 () {56 vars in 1111 bytes} [Sun Oct 9 00:43:06 2022] GET /identity/v3/services/network => generated 88 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 09 00:43:06.574429 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f16610-779c-4e5a-85f8-b5b3b91e326c None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:06.576704 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application [None req-2249b0c7-b545-4196-b5a9-888c5d7f7379 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 09 00:43:06.576704 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:43:06.576704 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:43:06.576704 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:43:06.576704 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:43:06.576704 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:43:06.576704 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:43:06.576704 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:43:06.576704 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:43:06.576704 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:43:06.576704 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:43:06.576704 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:43:06.576704 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 09 00:43:06.576704 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 09 00:43:06.576704 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 09 00:43:06.576704 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 09 00:43:06.577651 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:43:06.577651 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:43:06.577651 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 09 00:43:06.577651 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 09 00:43:06.577651 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 09 00:43:06.577651 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 09 00:43:06.577651 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:43:06.577651 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:43:06.577651 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:43:06.577651 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:43:06.577651 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:43:06.577651 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application with Lock( Oct 09 00:43:06.577651 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:43:06.577651 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:43:06.577651 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:43:06.577651 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:43:06.577651 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:43:06.577651 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:43:06.578669 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:43:06.578669 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:43:06.578669 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 09 00:43:06.578669 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 09 00:43:06.578669 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 09 00:43:06.578669 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 09 00:43:06.578669 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 09 00:43:06.578669 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 09 00:43:06.578669 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 09 00:43:06.578669 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application Oct 09 00:43:06.578669 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 399/822] 10.222.0.15 () {56 vars in 1093 bytes} [Sun Oct 9 00:43:06 2022] GET /identity/v3/users/nova => generated 82 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 09 00:43:06.583739 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2249b0c7-b545-4196-b5a9-888c5d7f7379 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:06.617332 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:06.722345 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2249b0c7-b545-4196-b5a9-888c5d7f7379 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:06.764068 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f16610-779c-4e5a-85f8-b5b3b91e326c None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:06.795999 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586130fa-61d0-49e0-8aa0-b16ecdc070c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:06.796844 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586130fa-61d0-49e0-8aa0-b16ecdc070c8 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:06.797127 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586130fa-61d0-49e0-8aa0-b16ecdc070c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:06.797490 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586130fa-61d0-49e0-8aa0-b16ecdc070c8 None admin] PATH_INFO: `/v3/users` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:06.798253 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586130fa-61d0-49e0-8aa0-b16ecdc070c8 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:43:06.798667 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586130fa-61d0-49e0-8aa0-b16ecdc070c8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:06.799120 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210d1c84-65b7-485d-94de-fbe1862bfc7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:06.799786 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210d1c84-65b7-485d-94de-fbe1862bfc7b None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:06.800061 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210d1c84-65b7-485d-94de-fbe1862bfc7b None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:06.800219 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586130fa-61d0-49e0-8aa0-b16ecdc070c8 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:06.800308 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210d1c84-65b7-485d-94de-fbe1862bfc7b None admin] PATH_INFO: `/v3/services` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:06.800941 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210d1c84-65b7-485d-94de-fbe1862bfc7b None admin] RBAC: Adding query filter params (name=network) {{(pid=81525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:43:06.801240 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210d1c84-65b7-485d-94de-fbe1862bfc7b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:06.802879 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210d1c84-65b7-485d-94de-fbe1862bfc7b None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:06.807894 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 424/823] 10.222.0.15 () {56 vars in 1112 bytes} [Sun Oct 9 00:43:06 2022] GET /identity/v3/services?name=network => generated 124 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 09 00:43:06.815011 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210d1c84-65b7-485d-94de-fbe1862bfc7b None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:06.839488 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 400/824] 10.222.0.15 () {56 vars in 1133 bytes} [Sun Oct 9 00:43:06 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 09 00:43:06.845552 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586130fa-61d0-49e0-8aa0-b16ecdc070c8 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:06.868765 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:06.921532 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:06.935464 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210d1c84-65b7-485d-94de-fbe1862bfc7b None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:06.994100 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4666dd98-52ef-40be-b214-b892960f9967 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:06.994628 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4666dd98-52ef-40be-b214-b892960f9967 None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:06.994892 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4666dd98-52ef-40be-b214-b892960f9967 None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:06.995227 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4666dd98-52ef-40be-b214-b892960f9967 None admin] PATH_INFO: `/v3/services` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:06.995832 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4666dd98-52ef-40be-b214-b892960f9967 None admin] RBAC: Adding query filter params (type=network) {{(pid=81525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:43:06.996129 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4666dd98-52ef-40be-b214-b892960f9967 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:06.997509 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4666dd98-52ef-40be-b214-b892960f9967 None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:07.003053 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 425/825] 10.222.0.15 () {56 vars in 1112 bytes} [Sun Oct 9 00:43:06 2022] GET /identity/v3/services?type=network => generated 350 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:43:07.012227 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4666dd98-52ef-40be-b214-b892960f9967 None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:07.014648 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586130fa-61d0-49e0-8aa0-b16ecdc070c8 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:07.051479 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c119770-b3ea-41f4-997b-54b8cad88990 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:07.052499 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c119770-b3ea-41f4-997b-54b8cad88990 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:07.052929 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c119770-b3ea-41f4-997b-54b8cad88990 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:07.053336 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c119770-b3ea-41f4-997b-54b8cad88990 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:07.129161 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c119770-b3ea-41f4-997b-54b8cad88990 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:07.130991 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c119770-b3ea-41f4-997b-54b8cad88990 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:07.142124 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:07.181200 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4666dd98-52ef-40be-b214-b892960f9967 None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:07.236560 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971cedf6-73d7-42a6-a623-539397d47ea8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:07.237195 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971cedf6-73d7-42a6-a623-539397d47ea8 None admin] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:07.237457 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971cedf6-73d7-42a6-a623-539397d47ea8 None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:07.237717 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971cedf6-73d7-42a6-a623-539397d47ea8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:07.238406 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971cedf6-73d7-42a6-a623-539397d47ea8 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:07.239789 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971cedf6-73d7-42a6-a623-539397d47ea8 None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:07.251121 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 401/826] 10.222.0.15 () {58 vars in 1282 bytes} [Sun Oct 9 00:43:06 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Oct 09 00:43:07.256407 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c119770-b3ea-41f4-997b-54b8cad88990 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:07.298543 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 426/827] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Oct 9 00:43:07 2022] POST /identity/v3/endpoints => generated 337 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 09 00:43:07.371695 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c119770-b3ea-41f4-997b-54b8cad88990 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:07.383118 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:07.424118 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca4f0ba-f2de-4a2e-ab95-964bab2f8463 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:07.425115 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca4f0ba-f2de-4a2e-ab95-964bab2f8463 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:07.425556 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca4f0ba-f2de-4a2e-ab95-964bab2f8463 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:07.425983 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca4f0ba-f2de-4a2e-ab95-964bab2f8463 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:07.438869 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca4f0ba-f2de-4a2e-ab95-964bab2f8463 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:07.440711 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca4f0ba-f2de-4a2e-ab95-964bab2f8463 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:07.456573 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application [None req-3ca4f0ba-f2de-4a2e-ab95-964bab2f8463 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:43:07.456573 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:43:07.456573 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:43:07.456573 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:43:07.456573 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:43:07.456573 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:43:07.456573 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:43:07.456573 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:43:07.456573 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:43:07.456573 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:43:07.456573 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:43:07.456573 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:43:07.456573 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 09 00:43:07.456573 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 09 00:43:07.456573 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 09 00:43:07.456573 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 09 00:43:07.457761 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:43:07.457761 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:43:07.457761 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:43:07.457761 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:43:07.457761 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:43:07.457761 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:43:07.457761 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:43:07.457761 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application with Lock( Oct 09 00:43:07.457761 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:43:07.457761 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:43:07.457761 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:43:07.457761 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:43:07.457761 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:43:07.457761 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:43:07.457761 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:43:07.457761 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:43:07.457761 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 09 00:43:07.458887 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 09 00:43:07.458887 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:43:07.458887 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application Oct 09 00:43:07.460850 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 402/828] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Oct 9 00:43:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:43:07.466759 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971cedf6-73d7-42a6-a623-539397d47ea8 None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:07.469875 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:07.620280 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971cedf6-73d7-42a6-a623-539397d47ea8 None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:07.657033 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da762dde-6ea9-478c-b0e4-e9f78b2d644d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:07.657641 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da762dde-6ea9-478c-b0e4-e9f78b2d644d None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:07.657914 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da762dde-6ea9-478c-b0e4-e9f78b2d644d None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:07.658177 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da762dde-6ea9-478c-b0e4-e9f78b2d644d None admin] PATH_INFO: `/v3/domains` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:07.658820 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da762dde-6ea9-478c-b0e4-e9f78b2d644d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:43:07.659114 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da762dde-6ea9-478c-b0e4-e9f78b2d644d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:07.660520 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da762dde-6ea9-478c-b0e4-e9f78b2d644d None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:07.674041 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 427/829] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Oct 9 00:43:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:43:07.679654 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca4f0ba-f2de-4a2e-ab95-964bab2f8463 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:07.786379 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca4f0ba-f2de-4a2e-ab95-964bab2f8463 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:07.822336 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb562a5-0b04-4503-867d-8a8cd5b92a8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:07.823441 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb562a5-0b04-4503-867d-8a8cd5b92a8f None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:07.823915 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb562a5-0b04-4503-867d-8a8cd5b92a8f None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:07.824376 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb562a5-0b04-4503-867d-8a8cd5b92a8f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:07.832030 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb562a5-0b04-4503-867d-8a8cd5b92a8f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:07.833860 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb562a5-0b04-4503-867d-8a8cd5b92a8f None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:07.846350 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application [None req-1fb562a5-0b04-4503-867d-8a8cd5b92a8f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 09 00:43:07.846350 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:43:07.846350 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:43:07.846350 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:43:07.846350 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:43:07.846350 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:43:07.846350 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:43:07.846350 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:43:07.846350 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:43:07.846350 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:43:07.846350 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:43:07.846350 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:43:07.846350 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 09 00:43:07.846350 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 09 00:43:07.846350 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 09 00:43:07.847347 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 09 00:43:07.847347 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:43:07.847347 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:43:07.847347 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:43:07.847347 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:43:07.847347 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:43:07.847347 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:43:07.847347 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:43:07.847347 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application with Lock( Oct 09 00:43:07.847347 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:43:07.847347 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:43:07.847347 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:43:07.847347 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:43:07.847347 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:43:07.847347 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:43:07.847347 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:43:07.847347 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:43:07.848324 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 09 00:43:07.848324 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 09 00:43:07.848324 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 09 00:43:07.848324 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 09 00:43:07.848324 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 09 00:43:07.848324 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 09 00:43:07.848324 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 09 00:43:07.848324 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application Oct 09 00:43:07.850751 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 403/830] 10.222.0.15 () {56 vars in 1111 bytes} [Sun Oct 9 00:43:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:43:07.856396 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da762dde-6ea9-478c-b0e4-e9f78b2d644d None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:07.934969 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:07.979167 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da762dde-6ea9-478c-b0e4-e9f78b2d644d None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:08.017912 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8388217-6516-40c9-b1a6-3284939183fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:08.018528 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8388217-6516-40c9-b1a6-3284939183fa None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:08.018799 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8388217-6516-40c9-b1a6-3284939183fa None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:08.019065 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8388217-6516-40c9-b1a6-3284939183fa None admin] PATH_INFO: `/v3/projects` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:08.019784 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8388217-6516-40c9-b1a6-3284939183fa None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:43:08.020082 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8388217-6516-40c9-b1a6-3284939183fa None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:08.021516 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8388217-6516-40c9-b1a6-3284939183fa None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:08.034602 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 428/831] 10.222.0.15 () {56 vars in 1148 bytes} [Sun Oct 9 00:43:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:43:08.040726 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb562a5-0b04-4503-867d-8a8cd5b92a8f None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:08.065026 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:08.159006 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb562a5-0b04-4503-867d-8a8cd5b92a8f None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:08.193588 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e5ec10-ae55-497f-a864-7fdb000d2c96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:08.194550 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e5ec10-ae55-497f-a864-7fdb000d2c96 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:08.195134 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e5ec10-ae55-497f-a864-7fdb000d2c96 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:08.195676 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e5ec10-ae55-497f-a864-7fdb000d2c96 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:08.196711 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e5ec10-ae55-497f-a864-7fdb000d2c96 None admin] RBAC: Adding query filter params (role.id=f69dddf26daf4dd79d4c962beb877af5, scope.project.id=f148d39ced534860abfbe8fc3f98ace4, user.id=4ac83d57fba841e0a666710732249c49) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:43:08.197231 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e5ec10-ae55-497f-a864-7fdb000d2c96 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:08.198915 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e5ec10-ae55-497f-a864-7fdb000d2c96 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:08.205677 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 404/832] 10.222.0.15 () {56 vars in 1374 bytes} [Sun Oct 9 00:43:08 2022] GET /identity/v3/role_assignments?user.id=4ac83d57fba841e0a666710732249c49&scope.project.id=f148d39ced534860abfbe8fc3f98ace4&role.id=f69dddf26daf4dd79d4c962beb877af5 => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:43:08.220315 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43366ae-8c68-40ff-90ec-e8a7934974eb None None] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:08.220671 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43366ae-8c68-40ff-90ec-e8a7934974eb None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:08.220853 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43366ae-8c68-40ff-90ec-e8a7934974eb None None] PATH_INFO: `/` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:08.221944 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8396be1b-b4ed-4561-86bb-e22726cde05b None None] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:08.222441 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8396be1b-b4ed-4561-86bb-e22726cde05b None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:08.222548 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 429/833] 10.222.0.15 () {54 vars in 927 bytes} [Sun Oct 9 00:43:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:43:08.223022 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8396be1b-b4ed-4561-86bb-e22726cde05b None None] PATH_INFO: `/` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:08.225057 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 405/834] 10.222.0.15 () {54 vars in 927 bytes} [Sun Oct 9 00:43:08 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:43:08.228392 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d75a020-6dd0-45aa-84d5-0dde82faed20 None None] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:08.228689 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d75a020-6dd0-45aa-84d5-0dde82faed20 None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:08.228933 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d75a020-6dd0-45aa-84d5-0dde82faed20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:08.232245 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a86c975-3995-4b5e-99b1-4404e1665264 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:08.232906 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a86c975-3995-4b5e-99b1-4404e1665264 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:08.233423 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a86c975-3995-4b5e-99b1-4404e1665264 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:08.249672 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.auth.core [None req-1d75a020-6dd0-45aa-84d5-0dde82faed20 None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:43:08.251036 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-1d75a020-6dd0-45aa-84d5-0dde82faed20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:43:08.256278 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-0a86c975-3995-4b5e-99b1-4404e1665264 None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:43:08.257839 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-0a86c975-3995-4b5e-99b1-4404e1665264 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:43:08.330013 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 430/835] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Oct 9 00:43:08 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 09 00:43:08.346826 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 406/836] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Oct 9 00:43:08 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 09 00:43:08.604004 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d75a020-6dd0-45aa-84d5-0dde82faed20 None None] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:08.619222 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a86c975-3995-4b5e-99b1-4404e1665264 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:08.632912 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:08.679628 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:08.737549 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a86c975-3995-4b5e-99b1-4404e1665264 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:08.748383 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d75a020-6dd0-45aa-84d5-0dde82faed20 None None] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:08.779549 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b27f29e-d88c-4035-be4d-dc8a3c1e0938 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:08.780199 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b27f29e-d88c-4035-be4d-dc8a3c1e0938 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:08.780475 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b27f29e-d88c-4035-be4d-dc8a3c1e0938 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:08.780746 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b27f29e-d88c-4035-be4d-dc8a3c1e0938 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:08.790412 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449dda2e-9eff-4b99-be93-ec741b204122 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:08.791290 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449dda2e-9eff-4b99-be93-ec741b204122 None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:08.791631 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b27f29e-d88c-4035-be4d-dc8a3c1e0938 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 09 00:43:08.791868 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449dda2e-9eff-4b99-be93-ec741b204122 None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:08.792277 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449dda2e-9eff-4b99-be93-ec741b204122 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:08.796453 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application [None req-9b27f29e-d88c-4035-be4d-dc8a3c1e0938 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 09 00:43:08.796453 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:43:08.796453 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:43:08.796453 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:43:08.796453 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:43:08.796453 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:43:08.796453 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:43:08.796453 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:43:08.796453 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:43:08.796453 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:43:08.796453 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:43:08.796453 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:43:08.796453 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 09 00:43:08.796453 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 09 00:43:08.796453 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 09 00:43:08.796453 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 09 00:43:08.797571 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 09 00:43:08.797571 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 09 00:43:08.797571 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 09 00:43:08.797571 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 09 00:43:08.797571 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:43:08.797571 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:43:08.797571 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:43:08.797571 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:43:08.797571 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:43:08.797571 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:43:08.797571 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:43:08.797571 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application with Lock( Oct 09 00:43:08.797571 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:43:08.797571 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:43:08.797571 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:43:08.797571 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:43:08.798681 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:43:08.798681 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:43:08.798681 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:43:08.798681 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:43:08.798681 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 09 00:43:08.798681 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 09 00:43:08.798681 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 09 00:43:08.798681 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 09 00:43:08.798681 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 09 00:43:08.798681 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 09 00:43:08.798681 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 09 00:43:08.798681 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application Oct 09 00:43:08.802770 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 407/837] 10.222.0.15 () {56 vars in 1102 bytes} [Sun Oct 9 00:43:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 09 00:43:08.804117 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3a9739-c0a2-41ee-a2ef-1615c1d8c0e7 None None] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:08.804455 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3a9739-c0a2-41ee-a2ef-1615c1d8c0e7 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:08.804733 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3a9739-c0a2-41ee-a2ef-1615c1d8c0e7 None None] PATH_INFO: `/` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:08.806530 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 408/838] 10.222.0.15 () {54 vars in 927 bytes} [Sun Oct 9 00:43:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:43:08.807222 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3a9739-c0a2-41ee-a2ef-1615c1d8c0e7 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:08.811343 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449dda2e-9eff-4b99-be93-ec741b204122 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 09 00:43:08.816649 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application [None req-449dda2e-9eff-4b99-be93-ec741b204122 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 09 00:43:08.816649 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:43:08.816649 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:43:08.816649 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:43:08.816649 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:43:08.816649 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:43:08.816649 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:43:08.816649 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:43:08.816649 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:43:08.816649 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:43:08.816649 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:43:08.816649 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:43:08.816649 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 09 00:43:08.816649 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 09 00:43:08.816649 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 09 00:43:08.816649 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 09 00:43:08.817768 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 09 00:43:08.817768 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 09 00:43:08.817768 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 09 00:43:08.817768 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 09 00:43:08.817768 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:43:08.817768 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:43:08.817768 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:43:08.817768 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:43:08.817768 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:43:08.817768 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:43:08.817768 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:43:08.817768 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application with Lock( Oct 09 00:43:08.817768 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:43:08.817768 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:43:08.817768 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:43:08.817768 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:43:08.818783 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:43:08.818783 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:43:08.818783 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:43:08.818783 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:43:08.818783 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 09 00:43:08.818783 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 09 00:43:08.818783 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 09 00:43:08.818783 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 09 00:43:08.818783 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 09 00:43:08.818783 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 09 00:43:08.818783 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 09 00:43:08.818783 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Oct 09 00:43:08.821146 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 431/839] 10.222.0.15 () {56 vars in 1096 bytes} [Sun Oct 9 00:43:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:43:08.822596 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a786b297-843b-4df3-9845-a5c677855b85 None None] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:08.822879 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a786b297-843b-4df3-9845-a5c677855b85 None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:08.823153 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a786b297-843b-4df3-9845-a5c677855b85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:08.847437 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.auth.core [None req-a786b297-843b-4df3-9845-a5c677855b85 None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:43:08.848663 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-a786b297-843b-4df3-9845-a5c677855b85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:43:08.882974 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:08.921882 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3a9739-c0a2-41ee-a2ef-1615c1d8c0e7 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:08.935776 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 432/840] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Oct 9 00:43:08 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 09 00:43:08.935776 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a786b297-843b-4df3-9845-a5c677855b85 None None] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:08.965680 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d82364e-beca-467d-bcb3-9f88f82270d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:08.966592 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d82364e-beca-467d-bcb3-9f88f82270d2 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:08.967017 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d82364e-beca-467d-bcb3-9f88f82270d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:08.967460 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d82364e-beca-467d-bcb3-9f88f82270d2 None admin] PATH_INFO: `/v3/roles` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:08.968364 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d82364e-beca-467d-bcb3-9f88f82270d2 None admin] RBAC: Adding query filter params (name=service) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:43:08.968808 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d82364e-beca-467d-bcb3-9f88f82270d2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:08.970415 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d82364e-beca-467d-bcb3-9f88f82270d2 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:08.979128 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:08.980823 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 409/841] 10.222.0.15 () {56 vars in 1103 bytes} [Sun Oct 9 00:43:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:43:08.986460 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d82364e-beca-467d-bcb3-9f88f82270d2 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:09.061709 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a786b297-843b-4df3-9845-a5c677855b85 None None] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:09.106755 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99dbbe6-f454-4a90-b045-c74017ffbe2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:09.107419 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99dbbe6-f454-4a90-b045-c74017ffbe2d None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:09.107697 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99dbbe6-f454-4a90-b045-c74017ffbe2d None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:09.107978 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99dbbe6-f454-4a90-b045-c74017ffbe2d None admin] PATH_INFO: `/v3/roles` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:09.108230 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d82364e-beca-467d-bcb3-9f88f82270d2 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:09.108791 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99dbbe6-f454-4a90-b045-c74017ffbe2d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:43:09.109093 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99dbbe6-f454-4a90-b045-c74017ffbe2d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:09.110751 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99dbbe6-f454-4a90-b045-c74017ffbe2d None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:09.125308 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 433/842] 10.222.0.15 () {56 vars in 1099 bytes} [Sun Oct 9 00:43:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:43:09.131462 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99dbbe6-f454-4a90-b045-c74017ffbe2d None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:09.148601 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:09.154146 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5568eff-f56d-48bb-9a87-79f902f74c20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:09.155865 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5568eff-f56d-48bb-9a87-79f902f74c20 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:09.156431 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5568eff-f56d-48bb-9a87-79f902f74c20 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:09.157308 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5568eff-f56d-48bb-9a87-79f902f74c20 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:09.170141 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5568eff-f56d-48bb-9a87-79f902f74c20 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:09.171630 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5568eff-f56d-48bb-9a87-79f902f74c20 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:09.193294 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application [None req-f5568eff-f56d-48bb-9a87-79f902f74c20 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:43:09.193294 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:43:09.193294 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:43:09.193294 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:43:09.193294 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:43:09.193294 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:43:09.193294 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:43:09.193294 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:43:09.193294 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:43:09.193294 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:43:09.193294 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:43:09.193294 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:43:09.193294 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 09 00:43:09.193294 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 09 00:43:09.193294 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 09 00:43:09.193294 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 09 00:43:09.194364 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:43:09.194364 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:43:09.194364 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:43:09.194364 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:43:09.194364 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:43:09.194364 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:43:09.194364 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:43:09.194364 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application with Lock( Oct 09 00:43:09.194364 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:43:09.194364 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:43:09.194364 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:43:09.194364 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:43:09.194364 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:43:09.194364 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:43:09.194364 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:43:09.194364 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:43:09.194364 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 09 00:43:09.195445 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 09 00:43:09.195445 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:43:09.195445 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application Oct 09 00:43:09.199409 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 410/843] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Oct 9 00:43:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:43:09.200449 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5568eff-f56d-48bb-9a87-79f902f74c20 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:09.253576 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99dbbe6-f454-4a90-b045-c74017ffbe2d None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:09.256287 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:09.289275 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ab9fcb-8c27-471d-ba57-cb24e87e682d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:09.289877 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ab9fcb-8c27-471d-ba57-cb24e87e682d None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:09.290149 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ab9fcb-8c27-471d-ba57-cb24e87e682d None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:09.290442 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ab9fcb-8c27-471d-ba57-cb24e87e682d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:09.302567 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ab9fcb-8c27-471d-ba57-cb24e87e682d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:09.304287 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ab9fcb-8c27-471d-ba57-cb24e87e682d None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:09.313176 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5568eff-f56d-48bb-9a87-79f902f74c20 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:09.318612 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application [None req-41ab9fcb-8c27-471d-ba57-cb24e87e682d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:43:09.318612 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:43:09.318612 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:43:09.318612 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:43:09.318612 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:43:09.318612 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:43:09.318612 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:43:09.318612 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:43:09.318612 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:43:09.318612 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:43:09.318612 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:43:09.318612 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:43:09.318612 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 09 00:43:09.318612 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 09 00:43:09.318612 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 09 00:43:09.318612 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 09 00:43:09.319585 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:43:09.319585 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:43:09.319585 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:43:09.319585 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:43:09.319585 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:43:09.319585 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:43:09.319585 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:43:09.319585 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application with Lock( Oct 09 00:43:09.319585 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:43:09.319585 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:43:09.319585 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:43:09.319585 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:43:09.319585 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:43:09.319585 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:43:09.319585 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:43:09.319585 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:43:09.319585 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 09 00:43:09.321234 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 09 00:43:09.321234 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:43:09.321234 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Oct 09 00:43:09.321234 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 434/844] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Oct 9 00:43:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 09 00:43:09.321234 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ab9fcb-8c27-471d-ba57-cb24e87e682d None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:09.351248 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fa14d9-a5e5-426f-909c-4ed37cddbe7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:09.351721 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fa14d9-a5e5-426f-909c-4ed37cddbe7b None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:09.351995 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fa14d9-a5e5-426f-909c-4ed37cddbe7b None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:09.352263 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fa14d9-a5e5-426f-909c-4ed37cddbe7b None admin] PATH_INFO: `/v3/domains` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:09.352903 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fa14d9-a5e5-426f-909c-4ed37cddbe7b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:43:09.353201 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fa14d9-a5e5-426f-909c-4ed37cddbe7b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:09.354678 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fa14d9-a5e5-426f-909c-4ed37cddbe7b None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:09.371446 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 411/845] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Oct 9 00:43:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 09 00:43:09.372367 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fa14d9-a5e5-426f-909c-4ed37cddbe7b None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:09.420124 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:09.427403 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ab9fcb-8c27-471d-ba57-cb24e87e682d None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:09.465810 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72163e65-ace0-4fdc-92e9-05d1d9c13ed8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:09.466437 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72163e65-ace0-4fdc-92e9-05d1d9c13ed8 None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:09.466709 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72163e65-ace0-4fdc-92e9-05d1d9c13ed8 None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:09.466979 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72163e65-ace0-4fdc-92e9-05d1d9c13ed8 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:09.467594 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72163e65-ace0-4fdc-92e9-05d1d9c13ed8 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:09.468971 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72163e65-ace0-4fdc-92e9-05d1d9c13ed8 None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:09.477834 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application [None req-72163e65-ace0-4fdc-92e9-05d1d9c13ed8 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 09 00:43:09.477834 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:43:09.477834 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 09 00:43:09.477834 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 09 00:43:09.477834 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 09 00:43:09.477834 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 09 00:43:09.477834 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 09 00:43:09.477834 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 09 00:43:09.477834 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 09 00:43:09.477834 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Oct 09 00:43:09.477834 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 09 00:43:09.477834 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Oct 09 00:43:09.477834 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:43:09.477834 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:43:09.477834 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:43:09.477834 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:43:09.477834 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:43:09.478844 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:43:09.478844 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:43:09.478844 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:43:09.478844 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:43:09.478844 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:43:09.478844 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:43:09.478844 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 09 00:43:09.478844 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 09 00:43:09.478844 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 09 00:43:09.478844 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 09 00:43:09.478844 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:43:09.478844 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:43:09.478844 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:43:09.478844 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:43:09.478844 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:43:09.478844 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:43:09.479695 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:43:09.479695 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application with Lock( Oct 09 00:43:09.479695 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:43:09.479695 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:43:09.479695 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:43:09.479695 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:43:09.479695 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:43:09.479695 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:43:09.479695 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:43:09.479695 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:43:09.479695 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 09 00:43:09.479695 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 09 00:43:09.479695 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 09 00:43:09.479695 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Oct 09 00:43:09.479695 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 435/846] 10.222.0.15 () {56 vars in 1114 bytes} [Sun Oct 9 00:43:09 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:43:09.480938 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72163e65-ace0-4fdc-92e9-05d1d9c13ed8 None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:09.492278 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fa14d9-a5e5-426f-909c-4ed37cddbe7b None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:09.510065 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:09.527959 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721394cb-b837-4961-9ac7-17c3b6dcc6a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:09.528582 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721394cb-b837-4961-9ac7-17c3b6dcc6a8 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:09.528863 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721394cb-b837-4961-9ac7-17c3b6dcc6a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:09.529130 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721394cb-b837-4961-9ac7-17c3b6dcc6a8 None admin] PATH_INFO: `/v3/domains` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:09.529780 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721394cb-b837-4961-9ac7-17c3b6dcc6a8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:43:09.530114 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721394cb-b837-4961-9ac7-17c3b6dcc6a8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:09.531523 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721394cb-b837-4961-9ac7-17c3b6dcc6a8 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:09.542979 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 412/847] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Oct 9 00:43:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:43:09.543828 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721394cb-b837-4961-9ac7-17c3b6dcc6a8 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:09.597769 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72163e65-ace0-4fdc-92e9-05d1d9c13ed8 None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:09.632381 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a27193-10f5-4cd6-aa61-c9b774506152 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:09.633111 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a27193-10f5-4cd6-aa61-c9b774506152 None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:09.633273 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a27193-10f5-4cd6-aa61-c9b774506152 None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:09.633502 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a27193-10f5-4cd6-aa61-c9b774506152 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:09.640821 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a27193-10f5-4cd6-aa61-c9b774506152 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:09.642272 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a27193-10f5-4cd6-aa61-c9b774506152 None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:09.653757 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application [None req-48a27193-10f5-4cd6-aa61-c9b774506152 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 09 00:43:09.653757 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:43:09.653757 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:43:09.653757 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:43:09.653757 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:43:09.653757 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:43:09.653757 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:43:09.653757 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:43:09.653757 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:43:09.653757 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:43:09.653757 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:43:09.653757 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:43:09.653757 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 09 00:43:09.653757 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 09 00:43:09.653757 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 09 00:43:09.653757 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 09 00:43:09.654871 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:43:09.654871 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:43:09.654871 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 09 00:43:09.654871 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 09 00:43:09.654871 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 09 00:43:09.654871 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 09 00:43:09.654871 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:43:09.654871 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:43:09.654871 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:43:09.654871 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:43:09.654871 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:43:09.654871 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application with Lock( Oct 09 00:43:09.654871 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:43:09.654871 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:43:09.654871 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:43:09.654871 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:43:09.654871 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:43:09.654871 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:43:09.656047 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:43:09.656047 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:43:09.656047 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 09 00:43:09.656047 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 09 00:43:09.656047 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 09 00:43:09.656047 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 09 00:43:09.656047 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 09 00:43:09.656047 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 09 00:43:09.656047 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 09 00:43:09.656047 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Oct 09 00:43:09.657311 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721394cb-b837-4961-9ac7-17c3b6dcc6a8 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:09.659907 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 436/848] 10.222.0.15 () {56 vars in 1117 bytes} [Sun Oct 9 00:43:09 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:43:09.660610 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:09.660741 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a27193-10f5-4cd6-aa61-c9b774506152 None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:09.700140 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fc1793-f462-4386-a159-b5080c69986f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:09.700843 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fc1793-f462-4386-a159-b5080c69986f None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:09.701055 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fc1793-f462-4386-a159-b5080c69986f None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:09.701275 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fc1793-f462-4386-a159-b5080c69986f None admin] PATH_INFO: `/v3/services` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:09.701898 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fc1793-f462-4386-a159-b5080c69986f None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:43:09.702196 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fc1793-f462-4386-a159-b5080c69986f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:09.703601 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fc1793-f462-4386-a159-b5080c69986f None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:09.712886 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 413/849] 10.222.0.15 () {56 vars in 1114 bytes} [Sun Oct 9 00:43:09 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:43:09.712886 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fc1793-f462-4386-a159-b5080c69986f None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:09.742308 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:09.762671 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a27193-10f5-4cd6-aa61-c9b774506152 None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:09.799128 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca4a04b-9ddc-4199-8ff5-c884f82141aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:09.800123 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca4a04b-9ddc-4199-8ff5-c884f82141aa None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:09.800409 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca4a04b-9ddc-4199-8ff5-c884f82141aa None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:09.800755 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca4a04b-9ddc-4199-8ff5-c884f82141aa None admin] PATH_INFO: `/v3/users/swift` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:09.808758 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca4a04b-9ddc-4199-8ff5-c884f82141aa None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:09.810217 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca4a04b-9ddc-4199-8ff5-c884f82141aa None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:09.822005 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application [None req-8ca4a04b-9ddc-4199-8ff5-c884f82141aa None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 09 00:43:09.822005 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:43:09.822005 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:43:09.822005 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:43:09.822005 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:43:09.822005 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:43:09.822005 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:43:09.822005 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:43:09.822005 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:43:09.822005 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:43:09.822005 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:43:09.822005 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:43:09.822005 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 09 00:43:09.822005 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 09 00:43:09.822005 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 09 00:43:09.822005 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 09 00:43:09.822998 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:43:09.822998 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:43:09.822998 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 09 00:43:09.822998 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 09 00:43:09.822998 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 09 00:43:09.822998 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 09 00:43:09.822998 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:43:09.822998 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:43:09.822998 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:43:09.822998 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:43:09.822998 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:43:09.822998 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application with Lock( Oct 09 00:43:09.822998 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:43:09.822998 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:43:09.822998 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:43:09.822998 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:43:09.822998 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:43:09.822998 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:43:09.824098 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:43:09.824098 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:43:09.824098 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 09 00:43:09.824098 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 09 00:43:09.824098 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 09 00:43:09.824098 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 09 00:43:09.824098 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 09 00:43:09.824098 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 09 00:43:09.824098 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 09 00:43:09.824098 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Oct 09 00:43:09.824650 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fc1793-f462-4386-a159-b5080c69986f None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:09.828014 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 437/850] 10.222.0.15 () {56 vars in 1096 bytes} [Sun Oct 9 00:43:09 2022] GET /identity/v3/users/swift => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:43:09.828735 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca4a04b-9ddc-4199-8ff5-c884f82141aa None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:09.859933 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357f7ec6-df83-4960-822a-498e595cb156 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:09.860514 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357f7ec6-df83-4960-822a-498e595cb156 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:09.860789 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357f7ec6-df83-4960-822a-498e595cb156 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:09.861055 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357f7ec6-df83-4960-822a-498e595cb156 None admin] PATH_INFO: `/v3/users` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:09.861944 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357f7ec6-df83-4960-822a-498e595cb156 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:43:09.862361 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357f7ec6-df83-4960-822a-498e595cb156 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:09.863881 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357f7ec6-df83-4960-822a-498e595cb156 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:09.887070 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 414/851] 10.222.0.15 () {56 vars in 1149 bytes} [Sun Oct 9 00:43:09 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:43:09.888032 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357f7ec6-df83-4960-822a-498e595cb156 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:09.915921 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:09.932066 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca4a04b-9ddc-4199-8ff5-c884f82141aa None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:09.967309 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0889c5ad-3203-4093-a90b-b85976ca5cb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:09.967937 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0889c5ad-3203-4093-a90b-b85976ca5cb5 None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:09.968210 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0889c5ad-3203-4093-a90b-b85976ca5cb5 None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:09.968477 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0889c5ad-3203-4093-a90b-b85976ca5cb5 None admin] PATH_INFO: `/v3/services` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:09.969468 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0889c5ad-3203-4093-a90b-b85976ca5cb5 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:43:09.969770 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0889c5ad-3203-4093-a90b-b85976ca5cb5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:09.971778 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0889c5ad-3203-4093-a90b-b85976ca5cb5 None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:09.987689 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 438/852] 10.222.0.15 () {56 vars in 1114 bytes} [Sun Oct 9 00:43:09 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:43:09.988560 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0889c5ad-3203-4093-a90b-b85976ca5cb5 None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:09.992957 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357f7ec6-df83-4960-822a-498e595cb156 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:10.002934 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:10.040758 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59198074-36cd-441b-8118-aa6e61a145d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:10.041443 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59198074-36cd-441b-8118-aa6e61a145d5 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:10.041714 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59198074-36cd-441b-8118-aa6e61a145d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:10.042025 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59198074-36cd-441b-8118-aa6e61a145d5 None admin] PATH_INFO: `/v3/users` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:10.042768 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59198074-36cd-441b-8118-aa6e61a145d5 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:43:10.043066 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59198074-36cd-441b-8118-aa6e61a145d5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:10.044623 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59198074-36cd-441b-8118-aa6e61a145d5 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:10.076330 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 415/853] 10.222.0.15 () {56 vars in 1135 bytes} [Sun Oct 9 00:43:09 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:43:10.077986 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59198074-36cd-441b-8118-aa6e61a145d5 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:10.143678 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0889c5ad-3203-4093-a90b-b85976ca5cb5 None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:10.189283 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:10.193991 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fb6268-2e9c-4965-a38b-65eb39e2c58c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:10.194670 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fb6268-2e9c-4965-a38b-65eb39e2c58c None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:10.195352 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fb6268-2e9c-4965-a38b-65eb39e2c58c None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:10.196782 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fb6268-2e9c-4965-a38b-65eb39e2c58c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:10.213769 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59198074-36cd-441b-8118-aa6e61a145d5 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:10.258360 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36829f0a-4bda-4ec4-b429-fef93bafe73e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:10.259852 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36829f0a-4bda-4ec4-b429-fef93bafe73e None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:10.260547 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36829f0a-4bda-4ec4-b429-fef93bafe73e None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:10.260963 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36829f0a-4bda-4ec4-b429-fef93bafe73e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:10.284904 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fb6268-2e9c-4965-a38b-65eb39e2c58c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:10.286908 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fb6268-2e9c-4965-a38b-65eb39e2c58c None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:10.291367 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:10.352000 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36829f0a-4bda-4ec4-b429-fef93bafe73e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:10.354414 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36829f0a-4bda-4ec4-b429-fef93bafe73e None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:10.424885 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 439/854] 10.222.0.15 () {58 vars in 1282 bytes} [Sun Oct 9 00:43:09 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 09 00:43:10.426415 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fb6268-2e9c-4965-a38b-65eb39e2c58c None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:10.458193 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:10.478724 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 416/855] 10.222.0.15 () {58 vars in 1282 bytes} [Sun Oct 9 00:43:10 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 09 00:43:10.479958 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8744028e-3b89-46db-a7a4-8cb91b297067 None None] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:10.480614 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8744028e-3b89-46db-a7a4-8cb91b297067 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:10.480614 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8744028e-3b89-46db-a7a4-8cb91b297067 None None] PATH_INFO: `/` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:10.483311 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 417/856] 10.222.0.15 () {54 vars in 927 bytes} [Sun Oct 9 00:43:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:43:10.488103 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a785078-99b4-4ad9-8961-cbda16ed1512 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:10.488372 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a785078-99b4-4ad9-8961-cbda16ed1512 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:10.488643 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a785078-99b4-4ad9-8961-cbda16ed1512 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:10.508702 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-6a785078-99b4-4ad9-8961-cbda16ed1512 None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:43:10.509945 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-6a785078-99b4-4ad9-8961-cbda16ed1512 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:43:10.543512 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fb6268-2e9c-4965-a38b-65eb39e2c58c None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:10.546036 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:10.580729 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fec59d-7f58-4571-ac79-cc236cfd43f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:10.581376 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fec59d-7f58-4571-ac79-cc236cfd43f5 None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:10.581649 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fec59d-7f58-4571-ac79-cc236cfd43f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:10.581946 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fec59d-7f58-4571-ac79-cc236cfd43f5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:10.584122 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 418/857] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Oct 9 00:43:10 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 09 00:43:10.585218 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a785078-99b4-4ad9-8961-cbda16ed1512 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:10.596788 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fec59d-7f58-4571-ac79-cc236cfd43f5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:10.598275 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fec59d-7f58-4571-ac79-cc236cfd43f5 None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:10.616276 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application [None req-e0fec59d-7f58-4571-ac79-cc236cfd43f5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:43:10.616276 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:43:10.616276 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:43:10.616276 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:43:10.616276 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:43:10.616276 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:43:10.616276 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:43:10.616276 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:43:10.616276 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:43:10.616276 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:43:10.616276 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:43:10.616276 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:43:10.616276 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 09 00:43:10.616276 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 09 00:43:10.616276 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 09 00:43:10.616276 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 09 00:43:10.617651 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:43:10.617651 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:43:10.617651 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:43:10.617651 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:43:10.617651 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:43:10.617651 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:43:10.617651 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:43:10.617651 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application with Lock( Oct 09 00:43:10.617651 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:43:10.617651 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:43:10.617651 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:43:10.617651 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:43:10.617651 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:43:10.617651 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:43:10.617651 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:43:10.617651 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:43:10.617651 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 09 00:43:10.618634 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 09 00:43:10.618634 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:43:10.618634 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Oct 09 00:43:10.622214 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 440/858] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Oct 9 00:43:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 09 00:43:10.623850 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fec59d-7f58-4571-ac79-cc236cfd43f5 None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:10.724163 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a785078-99b4-4ad9-8961-cbda16ed1512 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:10.729806 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fec59d-7f58-4571-ac79-cc236cfd43f5 None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:10.745256 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:10.766047 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf0cb8a-dfe0-46cc-bce3-fe7971d46440 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:10.766763 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf0cb8a-dfe0-46cc-bce3-fe7971d46440 None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:10.767095 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf0cb8a-dfe0-46cc-bce3-fe7971d46440 None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:10.767463 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf0cb8a-dfe0-46cc-bce3-fe7971d46440 None admin] PATH_INFO: `/v3/domains` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:10.768170 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf0cb8a-dfe0-46cc-bce3-fe7971d46440 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:43:10.768573 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf0cb8a-dfe0-46cc-bce3-fe7971d46440 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:10.769994 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf0cb8a-dfe0-46cc-bce3-fe7971d46440 None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:10.773793 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca9a4b3-2c79-49bb-b324-fa626cbb0b8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:10.774660 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca9a4b3-2c79-49bb-b324-fa626cbb0b8c None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:10.775082 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca9a4b3-2c79-49bb-b324-fa626cbb0b8c None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:10.775525 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca9a4b3-2c79-49bb-b324-fa626cbb0b8c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:10.787385 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 441/859] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Oct 9 00:43:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 09 00:43:10.788106 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca9a4b3-2c79-49bb-b324-fa626cbb0b8c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:10.788752 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf0cb8a-dfe0-46cc-bce3-fe7971d46440 None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:10.790119 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca9a4b3-2c79-49bb-b324-fa626cbb0b8c None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:10.808611 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application [None req-dca9a4b3-2c79-49bb-b324-fa626cbb0b8c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:43:10.808611 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:43:10.808611 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:43:10.808611 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:43:10.808611 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:43:10.808611 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:43:10.808611 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:43:10.808611 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:43:10.808611 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:43:10.808611 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:43:10.808611 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:43:10.808611 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:43:10.808611 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 09 00:43:10.808611 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 09 00:43:10.808611 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 09 00:43:10.808611 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 09 00:43:10.809693 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:43:10.809693 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:43:10.809693 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:43:10.809693 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:43:10.809693 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:43:10.809693 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:43:10.809693 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:43:10.809693 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application with Lock( Oct 09 00:43:10.809693 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:43:10.809693 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:43:10.809693 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:43:10.809693 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:43:10.809693 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:43:10.809693 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:43:10.809693 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:43:10.809693 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:43:10.809693 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 09 00:43:10.810671 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 09 00:43:10.810671 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:43:10.810671 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application Oct 09 00:43:10.810671 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 419/860] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Oct 9 00:43:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:43:10.813337 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:10.815824 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca9a4b3-2c79-49bb-b324-fa626cbb0b8c None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:10.904035 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf0cb8a-dfe0-46cc-bce3-fe7971d46440 None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:10.921420 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca9a4b3-2c79-49bb-b324-fa626cbb0b8c None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:10.939361 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8abead5-fe61-433a-8249-03c437367ac9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:10.940018 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8abead5-fe61-433a-8249-03c437367ac9 None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:10.940289 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8abead5-fe61-433a-8249-03c437367ac9 None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:10.940552 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8abead5-fe61-433a-8249-03c437367ac9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:10.949059 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8abead5-fe61-433a-8249-03c437367ac9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:10.950573 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8abead5-fe61-433a-8249-03c437367ac9 None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:10.958270 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fd6acf-10f2-4cc7-8abf-2e1f4e1620a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:10.958888 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fd6acf-10f2-4cc7-8abf-2e1f4e1620a8 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:10.959160 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fd6acf-10f2-4cc7-8abf-2e1f4e1620a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:10.959475 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fd6acf-10f2-4cc7-8abf-2e1f4e1620a8 None admin] PATH_INFO: `/v3/domains` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:10.960126 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fd6acf-10f2-4cc7-8abf-2e1f4e1620a8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:43:10.960461 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fd6acf-10f2-4cc7-8abf-2e1f4e1620a8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:10.961861 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fd6acf-10f2-4cc7-8abf-2e1f4e1620a8 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:10.963404 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application [None req-a8abead5-fe61-433a-8249-03c437367ac9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 09 00:43:10.963404 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:43:10.963404 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:43:10.963404 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:43:10.963404 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:43:10.963404 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:43:10.963404 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:43:10.963404 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:43:10.963404 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:43:10.963404 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:43:10.963404 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:43:10.963404 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:43:10.963404 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 09 00:43:10.963404 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 09 00:43:10.963404 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 09 00:43:10.964502 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 09 00:43:10.964502 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:43:10.964502 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:43:10.964502 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:43:10.964502 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:43:10.964502 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:43:10.964502 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:43:10.964502 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:43:10.964502 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application with Lock( Oct 09 00:43:10.964502 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:43:10.964502 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:43:10.964502 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:43:10.964502 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:43:10.964502 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:43:10.964502 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:43:10.964502 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:43:10.964502 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:43:10.965386 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 09 00:43:10.965386 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 09 00:43:10.965386 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 09 00:43:10.965386 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 09 00:43:10.965386 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 09 00:43:10.965386 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 09 00:43:10.965386 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 09 00:43:10.965386 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Oct 09 00:43:10.965386 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 442/861] 10.222.0.15 () {56 vars in 1111 bytes} [Sun Oct 9 00:43:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 09 00:43:10.965386 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8abead5-fe61-433a-8249-03c437367ac9 None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:10.982512 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 420/862] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Oct 9 00:43:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 09 00:43:10.983249 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fd6acf-10f2-4cc7-8abf-2e1f4e1620a8 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:11.013405 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:11.048859 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:11.076840 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8abead5-fe61-433a-8249-03c437367ac9 None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:11.104156 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fd6acf-10f2-4cc7-8abf-2e1f4e1620a8 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:11.114289 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c9f99e-d331-4a3e-8117-6a1870dea164 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:11.114937 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c9f99e-d331-4a3e-8117-6a1870dea164 None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:11.115542 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c9f99e-d331-4a3e-8117-6a1870dea164 None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:11.115816 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c9f99e-d331-4a3e-8117-6a1870dea164 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:11.116695 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c9f99e-d331-4a3e-8117-6a1870dea164 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:11.118697 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c9f99e-d331-4a3e-8117-6a1870dea164 None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:11.128333 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application [None req-a3c9f99e-d331-4a3e-8117-6a1870dea164 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 09 00:43:11.128333 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:43:11.128333 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 09 00:43:11.128333 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 09 00:43:11.128333 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 09 00:43:11.128333 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 09 00:43:11.128333 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 09 00:43:11.128333 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 09 00:43:11.128333 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 09 00:43:11.128333 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Oct 09 00:43:11.128333 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 09 00:43:11.128333 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Oct 09 00:43:11.128333 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:43:11.128333 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:43:11.128333 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:43:11.128333 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:43:11.129336 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:43:11.129336 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:43:11.129336 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:43:11.129336 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:43:11.129336 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:43:11.129336 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:43:11.129336 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:43:11.129336 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 09 00:43:11.129336 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 09 00:43:11.129336 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 09 00:43:11.129336 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 09 00:43:11.129336 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:43:11.129336 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:43:11.129336 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:43:11.129336 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:43:11.129336 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:43:11.129336 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:43:11.130227 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:43:11.130227 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application with Lock( Oct 09 00:43:11.130227 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:43:11.130227 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:43:11.130227 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:43:11.130227 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:43:11.130227 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:43:11.130227 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:43:11.130227 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:43:11.130227 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:43:11.130227 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 09 00:43:11.130227 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 09 00:43:11.130227 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 09 00:43:11.130227 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Oct 09 00:43:11.130227 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 443/863] 10.222.0.15 () {56 vars in 1132 bytes} [Sun Oct 9 00:43:10 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:43:11.131053 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c9f99e-d331-4a3e-8117-6a1870dea164 None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:11.145032 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f777ff-3388-412d-b672-08233cfffd7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:11.145646 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f777ff-3388-412d-b672-08233cfffd7c None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:11.145921 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f777ff-3388-412d-b672-08233cfffd7c None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:11.146189 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f777ff-3388-412d-b672-08233cfffd7c None admin] PATH_INFO: `/v3/projects` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:11.146882 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f777ff-3388-412d-b672-08233cfffd7c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:43:11.147179 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f777ff-3388-412d-b672-08233cfffd7c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:11.148699 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f777ff-3388-412d-b672-08233cfffd7c None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:11.165251 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 421/864] 10.222.0.15 () {56 vars in 1148 bytes} [Sun Oct 9 00:43:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:43:11.165251 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f777ff-3388-412d-b672-08233cfffd7c None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:11.234351 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c9f99e-d331-4a3e-8117-6a1870dea164 None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:11.254066 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:11.271676 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f777ff-3388-412d-b672-08233cfffd7c None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:11.276766 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce9640a-a834-4362-bfbb-d2d028cb9ce7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:11.277401 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce9640a-a834-4362-bfbb-d2d028cb9ce7 None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:11.277671 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce9640a-a834-4362-bfbb-d2d028cb9ce7 None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:11.277936 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce9640a-a834-4362-bfbb-d2d028cb9ce7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:11.285857 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce9640a-a834-4362-bfbb-d2d028cb9ce7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:11.287319 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce9640a-a834-4362-bfbb-d2d028cb9ce7 None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:11.289822 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:11.299996 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application [None req-dce9640a-a834-4362-bfbb-d2d028cb9ce7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 09 00:43:11.299996 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:43:11.299996 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:43:11.299996 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:43:11.299996 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:43:11.299996 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:43:11.299996 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:43:11.299996 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:43:11.299996 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:43:11.299996 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:43:11.299996 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:43:11.299996 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:43:11.299996 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 09 00:43:11.299996 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 09 00:43:11.299996 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 09 00:43:11.300919 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 09 00:43:11.300919 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:43:11.300919 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:43:11.300919 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:43:11.300919 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:43:11.300919 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:43:11.300919 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:43:11.300919 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:43:11.300919 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application with Lock( Oct 09 00:43:11.300919 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:43:11.300919 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:43:11.300919 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:43:11.300919 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:43:11.300919 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:43:11.300919 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:43:11.300919 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:43:11.300919 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:43:11.301832 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 09 00:43:11.301832 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 09 00:43:11.301832 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 09 00:43:11.301832 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 09 00:43:11.301832 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 09 00:43:11.301832 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 09 00:43:11.301832 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 09 00:43:11.301832 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Oct 09 00:43:11.301832 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 444/865] 10.222.0.15 () {56 vars in 1111 bytes} [Sun Oct 9 00:43:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:43:11.302312 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce9640a-a834-4362-bfbb-d2d028cb9ce7 None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:11.317732 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6821dea2-0087-43cf-98e8-a9e9f0fc231b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:11.318570 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6821dea2-0087-43cf-98e8-a9e9f0fc231b None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:11.318956 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6821dea2-0087-43cf-98e8-a9e9f0fc231b None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:11.319390 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6821dea2-0087-43cf-98e8-a9e9f0fc231b None admin] PATH_INFO: `/v3/services` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:11.320220 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6821dea2-0087-43cf-98e8-a9e9f0fc231b None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:43:11.320587 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6821dea2-0087-43cf-98e8-a9e9f0fc231b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:11.322674 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6821dea2-0087-43cf-98e8-a9e9f0fc231b None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:11.328618 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 422/866] 10.222.0.15 () {56 vars in 1126 bytes} [Sun Oct 9 00:43:11 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:43:11.333309 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6821dea2-0087-43cf-98e8-a9e9f0fc231b None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:11.409899 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce9640a-a834-4362-bfbb-d2d028cb9ce7 None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:11.448242 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400ac3db-19cf-4f57-98bb-afa637efb526 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:11.448686 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6821dea2-0087-43cf-98e8-a9e9f0fc231b None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:11.449017 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400ac3db-19cf-4f57-98bb-afa637efb526 None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:11.449357 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400ac3db-19cf-4f57-98bb-afa637efb526 None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:11.449693 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400ac3db-19cf-4f57-98bb-afa637efb526 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:11.450490 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400ac3db-19cf-4f57-98bb-afa637efb526 None admin] RBAC: Adding query filter params (role.id=6fe3faf520bd402f9bd78d3ed08eec34, scope.project.id=f148d39ced534860abfbe8fc3f98ace4, user.id=3a6cfef106c84f759ce0874be77f7380) {{(pid=81525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:43:11.450862 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400ac3db-19cf-4f57-98bb-afa637efb526 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:11.452446 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400ac3db-19cf-4f57-98bb-afa637efb526 None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:11.467310 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 445/867] 10.222.0.15 () {56 vars in 1374 bytes} [Sun Oct 9 00:43:11 2022] GET /identity/v3/role_assignments?user.id=3a6cfef106c84f759ce0874be77f7380&scope.project.id=f148d39ced534860abfbe8fc3f98ace4&role.id=6fe3faf520bd402f9bd78d3ed08eec34 => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:43:11.467310 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400ac3db-19cf-4f57-98bb-afa637efb526 None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:11.497663 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317ced0e-0927-465d-86ea-42ba24f3d7b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:11.498685 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317ced0e-0927-465d-86ea-42ba24f3d7b3 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:11.499054 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317ced0e-0927-465d-86ea-42ba24f3d7b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:11.499454 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317ced0e-0927-465d-86ea-42ba24f3d7b3 None admin] PATH_INFO: `/v3/projects` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:11.500246 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317ced0e-0927-465d-86ea-42ba24f3d7b3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:43:11.500652 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317ced0e-0927-465d-86ea-42ba24f3d7b3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:11.502456 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317ced0e-0927-465d-86ea-42ba24f3d7b3 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:11.516366 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 423/868] 10.222.0.15 () {56 vars in 1148 bytes} [Sun Oct 9 00:43:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:43:11.523424 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317ced0e-0927-465d-86ea-42ba24f3d7b3 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:11.535938 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:11.538498 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:11.589544 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400ac3db-19cf-4f57-98bb-afa637efb526 None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:11.636206 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77810ee3-6b2f-4e59-832e-3224f0568ff0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:11.636992 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77810ee3-6b2f-4e59-832e-3224f0568ff0 None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:11.637412 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77810ee3-6b2f-4e59-832e-3224f0568ff0 None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:11.637798 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77810ee3-6b2f-4e59-832e-3224f0568ff0 None admin] PATH_INFO: `/v3/services` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:11.638441 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77810ee3-6b2f-4e59-832e-3224f0568ff0 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:43:11.638740 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77810ee3-6b2f-4e59-832e-3224f0568ff0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:11.640986 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77810ee3-6b2f-4e59-832e-3224f0568ff0 None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:11.648082 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 446/869] 10.222.0.15 () {56 vars in 1126 bytes} [Sun Oct 9 00:43:11 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:43:11.654602 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317ced0e-0927-465d-86ea-42ba24f3d7b3 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:11.694545 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f56ae6-aa02-42f0-8df2-718786373fc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:11.695326 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f56ae6-aa02-42f0-8df2-718786373fc0 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:11.695552 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f56ae6-aa02-42f0-8df2-718786373fc0 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:11.695818 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f56ae6-aa02-42f0-8df2-718786373fc0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:11.696556 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f56ae6-aa02-42f0-8df2-718786373fc0 None admin] RBAC: Adding query filter params (role.id=f69dddf26daf4dd79d4c962beb877af5, scope.project.id=f148d39ced534860abfbe8fc3f98ace4, user.id=c4c467943b8f4d31a2f067ca6ed3b25c) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:43:11.696859 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f56ae6-aa02-42f0-8df2-718786373fc0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:11.698308 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f56ae6-aa02-42f0-8df2-718786373fc0 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:11.705363 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 424/870] 10.222.0.15 () {56 vars in 1374 bytes} [Sun Oct 9 00:43:11 2022] GET /identity/v3/role_assignments?user.id=c4c467943b8f4d31a2f067ca6ed3b25c&scope.project.id=f148d39ced534860abfbe8fc3f98ace4&role.id=f69dddf26daf4dd79d4c962beb877af5 => generated 608 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 09 00:43:12.232752 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1d5bd4-0629-4cbb-87cb-9ec54e616ef1 None None] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:12.233277 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1d5bd4-0629-4cbb-87cb-9ec54e616ef1 None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:12.233277 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1d5bd4-0629-4cbb-87cb-9ec54e616ef1 None None] PATH_INFO: `/` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:12.234867 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 447/871] 10.222.0.15 () {54 vars in 927 bytes} [Sun Oct 9 00:43:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:43:12.240191 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0beaaac-4e91-4700-92ff-966bbf81f94f None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:12.240614 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0beaaac-4e91-4700-92ff-966bbf81f94f None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:12.240791 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0beaaac-4e91-4700-92ff-966bbf81f94f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:12.259771 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-f0beaaac-4e91-4700-92ff-966bbf81f94f None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:43:12.260968 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-f0beaaac-4e91-4700-92ff-966bbf81f94f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:43:12.334942 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 425/872] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Oct 9 00:43:12 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 09 00:43:12.600979 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1d5bd4-0629-4cbb-87cb-9ec54e616ef1 None None] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:12.711650 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1d5bd4-0629-4cbb-87cb-9ec54e616ef1 None None] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:12.738416 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:12.747342 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec477d7-e4f0-4a30-8a6f-db62ef7dc4b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:12.748300 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec477d7-e4f0-4a30-8a6f-db62ef7dc4b0 None admin] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:12.748578 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec477d7-e4f0-4a30-8a6f-db62ef7dc4b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:12.748849 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec477d7-e4f0-4a30-8a6f-db62ef7dc4b0 None admin] PATH_INFO: `/v3/services` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:12.749515 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec477d7-e4f0-4a30-8a6f-db62ef7dc4b0 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:12.750893 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec477d7-e4f0-4a30-8a6f-db62ef7dc4b0 None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:12.767530 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 448/873] 10.222.0.15 () {60 vars in 1141 bytes} [Sun Oct 9 00:43:12 2022] POST /identity/v3/services => generated 251 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 09 00:43:13.820733 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bca3767-b7a5-4f44-bc25-5fa6b9bbae16 None None] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:13.821251 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bca3767-b7a5-4f44-bc25-5fa6b9bbae16 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:13.821251 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bca3767-b7a5-4f44-bc25-5fa6b9bbae16 None None] PATH_INFO: `/` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:13.822870 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 426/874] 10.222.0.15 () {54 vars in 927 bytes} [Sun Oct 9 00:43:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:43:13.825622 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966d4c6f-215f-4ee9-8410-8a960e67b0e8 None None] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:13.826114 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966d4c6f-215f-4ee9-8410-8a960e67b0e8 None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:13.826202 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966d4c6f-215f-4ee9-8410-8a960e67b0e8 None None] PATH_INFO: `/` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:13.828176 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 449/875] 10.222.0.15 () {54 vars in 927 bytes} [Sun Oct 9 00:43:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:43:13.828369 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a747a029-2f11-458d-af03-80c4592eedd1 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:13.828651 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a747a029-2f11-458d-af03-80c4592eedd1 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:13.828922 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a747a029-2f11-458d-af03-80c4592eedd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:13.833885 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec9e28e-27da-4c82-997c-38ac730d0423 None None] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:13.834206 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec9e28e-27da-4c82-997c-38ac730d0423 None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:13.834442 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec9e28e-27da-4c82-997c-38ac730d0423 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:13.838209 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:13.850536 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-a747a029-2f11-458d-af03-80c4592eedd1 None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:43:13.852191 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-a747a029-2f11-458d-af03-80c4592eedd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:43:13.854124 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.auth.core [None req-eec9e28e-27da-4c82-997c-38ac730d0423 None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:43:13.855365 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-eec9e28e-27da-4c82-997c-38ac730d0423 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:43:13.933585 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 427/876] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Oct 9 00:43:13 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 09 00:43:13.935035 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 450/877] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Oct 9 00:43:13 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 09 00:43:13.971977 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a2cc95-33f7-4449-a050-9ec92a81b6ea None None] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:13.972244 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a2cc95-33f7-4449-a050-9ec92a81b6ea None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:13.972513 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a2cc95-33f7-4449-a050-9ec92a81b6ea None None] PATH_INFO: `/` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:13.974097 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 428/878] 10.222.0.15 () {54 vars in 927 bytes} [Sun Oct 9 00:43:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:43:13.979619 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1d4015-d65d-4c9a-ac59-962c77f222da None None] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:13.980065 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1d4015-d65d-4c9a-ac59-962c77f222da None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:13.980478 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1d4015-d65d-4c9a-ac59-962c77f222da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:14.000194 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.auth.core [None req-eb1d4015-d65d-4c9a-ac59-962c77f222da None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:43:14.001628 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-eb1d4015-d65d-4c9a-ac59-962c77f222da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:43:14.074295 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 451/879] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Oct 9 00:43:13 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 09 00:43:14.198945 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a2cc95-33f7-4449-a050-9ec92a81b6ea None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:14.225498 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1d4015-d65d-4c9a-ac59-962c77f222da None None] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:14.278505 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:14.313165 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a2cc95-33f7-4449-a050-9ec92a81b6ea None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:14.339840 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1d4015-d65d-4c9a-ac59-962c77f222da None None] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:14.349155 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:14.357039 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feaf05ec-0442-4b99-91f4-0f763674f0ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:14.357805 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaf05ec-0442-4b99-91f4-0f763674f0ea None admin] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:14.358355 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaf05ec-0442-4b99-91f4-0f763674f0ea None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:14.358630 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaf05ec-0442-4b99-91f4-0f763674f0ea None admin] PATH_INFO: `/v3/services` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:14.359363 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feaf05ec-0442-4b99-91f4-0f763674f0ea None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:14.360739 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feaf05ec-0442-4b99-91f4-0f763674f0ea None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:14.379380 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 429/880] 10.222.0.15 () {60 vars in 1141 bytes} [Sun Oct 9 00:43:14 2022] POST /identity/v3/services => generated 269 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 09 00:43:14.379380 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feaf05ec-0442-4b99-91f4-0f763674f0ea None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:14.384841 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d52064-570c-4faa-b508-d065a258d9b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:14.385572 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d52064-570c-4faa-b508-d065a258d9b2 None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:14.385969 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d52064-570c-4faa-b508-d065a258d9b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:14.386305 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d52064-570c-4faa-b508-d065a258d9b2 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:14.414179 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d52064-570c-4faa-b508-d065a258d9b2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 09 00:43:14.420969 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application [None req-b6d52064-570c-4faa-b508-d065a258d9b2 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 09 00:43:14.420969 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:43:14.420969 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:43:14.420969 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:43:14.420969 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:43:14.420969 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:43:14.420969 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:43:14.420969 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:43:14.420969 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:43:14.420969 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:43:14.420969 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:43:14.420969 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:43:14.420969 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 09 00:43:14.420969 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 09 00:43:14.420969 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 09 00:43:14.420969 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 09 00:43:14.422031 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 09 00:43:14.422031 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 09 00:43:14.422031 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 09 00:43:14.422031 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 09 00:43:14.422031 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:43:14.422031 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:43:14.422031 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:43:14.422031 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:43:14.422031 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:43:14.422031 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:43:14.422031 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:43:14.422031 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application with Lock( Oct 09 00:43:14.422031 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:43:14.422031 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:43:14.422031 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:43:14.422031 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:43:14.428271 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:43:14.428271 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:43:14.428271 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:43:14.428271 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:43:14.428271 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 09 00:43:14.428271 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 09 00:43:14.428271 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 09 00:43:14.428271 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 09 00:43:14.428271 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 09 00:43:14.428271 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 09 00:43:14.428271 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 09 00:43:14.428271 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Oct 09 00:43:14.428271 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 452/881] 10.222.0.15 () {56 vars in 1120 bytes} [Sun Oct 9 00:43:14 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 09 00:43:14.428271 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d52064-570c-4faa-b508-d065a258d9b2 None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:14.523946 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feaf05ec-0442-4b99-91f4-0f763674f0ea None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:14.566891 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71ae81a-0de8-4a66-987a-1110fca8c4c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:14.568474 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71ae81a-0de8-4a66-987a-1110fca8c4c9 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:14.568960 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71ae81a-0de8-4a66-987a-1110fca8c4c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:14.569231 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71ae81a-0de8-4a66-987a-1110fca8c4c9 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:14.569908 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71ae81a-0de8-4a66-987a-1110fca8c4c9 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:14.570499 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:14.571306 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71ae81a-0de8-4a66-987a-1110fca8c4c9 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:14.573769 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d52064-570c-4faa-b508-d065a258d9b2 None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:14.583703 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application [None req-f71ae81a-0de8-4a66-987a-1110fca8c4c9 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 09 00:43:14.583703 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:43:14.583703 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 09 00:43:14.583703 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 09 00:43:14.583703 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 09 00:43:14.583703 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 09 00:43:14.583703 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 09 00:43:14.583703 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 09 00:43:14.583703 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 09 00:43:14.583703 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application Oct 09 00:43:14.583703 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 09 00:43:14.583703 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application Oct 09 00:43:14.583703 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:43:14.583703 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:43:14.583703 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:43:14.583703 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:43:14.583703 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:43:14.584742 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:43:14.584742 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:43:14.584742 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:43:14.584742 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:43:14.584742 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:43:14.584742 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:43:14.584742 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 09 00:43:14.584742 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 09 00:43:14.584742 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 09 00:43:14.584742 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 09 00:43:14.584742 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:43:14.584742 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:43:14.584742 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:43:14.584742 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:43:14.584742 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:43:14.584742 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:43:14.586164 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:43:14.586164 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application with Lock( Oct 09 00:43:14.586164 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:43:14.586164 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:43:14.586164 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:43:14.586164 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:43:14.586164 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:43:14.586164 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:43:14.586164 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:43:14.586164 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:43:14.586164 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 09 00:43:14.586164 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 09 00:43:14.586164 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 09 00:43:14.586164 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application Oct 09 00:43:14.586164 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 430/882] 10.222.0.15 () {56 vars in 1126 bytes} [Sun Oct 9 00:43:14 2022] GET /identity/v3/services/object-store => generated 93 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:43:14.590735 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71ae81a-0de8-4a66-987a-1110fca8c4c9 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:14.617739 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829675f6-ca51-4a99-8963-9aef39162901 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:14.618842 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829675f6-ca51-4a99-8963-9aef39162901 None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:14.619119 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829675f6-ca51-4a99-8963-9aef39162901 None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:14.619562 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829675f6-ca51-4a99-8963-9aef39162901 None admin] PATH_INFO: `/v3/roles` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:14.620232 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829675f6-ca51-4a99-8963-9aef39162901 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:43:14.620567 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829675f6-ca51-4a99-8963-9aef39162901 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:14.621952 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829675f6-ca51-4a99-8963-9aef39162901 None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:14.632832 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 453/883] 10.222.0.15 () {56 vars in 1115 bytes} [Sun Oct 9 00:43:14 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:43:14.638308 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829675f6-ca51-4a99-8963-9aef39162901 None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:14.657530 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:14.702195 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71ae81a-0de8-4a66-987a-1110fca8c4c9 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:14.738236 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf23eaa-c794-407a-a3a1-68bf04ba1d66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:14.738853 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf23eaa-c794-407a-a3a1-68bf04ba1d66 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:14.739186 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf23eaa-c794-407a-a3a1-68bf04ba1d66 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:14.739499 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf23eaa-c794-407a-a3a1-68bf04ba1d66 None admin] PATH_INFO: `/v3/services` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:14.740137 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf23eaa-c794-407a-a3a1-68bf04ba1d66 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:43:14.740434 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf23eaa-c794-407a-a3a1-68bf04ba1d66 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:14.741840 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf23eaa-c794-407a-a3a1-68bf04ba1d66 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:14.746803 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 431/884] 10.222.0.15 () {56 vars in 1122 bytes} [Sun Oct 9 00:43:14 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 09 00:43:14.747495 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829675f6-ca51-4a99-8963-9aef39162901 None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:14.753653 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf23eaa-c794-407a-a3a1-68bf04ba1d66 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:14.793338 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e26031d-9d8a-4ffa-89a2-365f0b79ded1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:14.794423 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e26031d-9d8a-4ffa-89a2-365f0b79ded1 None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:14.794953 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e26031d-9d8a-4ffa-89a2-365f0b79ded1 None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:14.795451 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e26031d-9d8a-4ffa-89a2-365f0b79ded1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:14.807472 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e26031d-9d8a-4ffa-89a2-365f0b79ded1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:14.809426 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e26031d-9d8a-4ffa-89a2-365f0b79ded1 None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:14.825540 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application [None req-0e26031d-9d8a-4ffa-89a2-365f0b79ded1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:43:14.825540 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:43:14.825540 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:43:14.825540 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:43:14.825540 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:43:14.825540 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:43:14.825540 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:43:14.825540 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:43:14.825540 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:43:14.825540 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:43:14.825540 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:43:14.825540 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:43:14.825540 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 09 00:43:14.825540 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 09 00:43:14.825540 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 09 00:43:14.825540 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 09 00:43:14.826991 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:43:14.826991 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:43:14.826991 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:43:14.826991 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:43:14.826991 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:43:14.826991 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:43:14.826991 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:43:14.826991 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application with Lock( Oct 09 00:43:14.826991 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:43:14.826991 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:43:14.826991 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:43:14.826991 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:43:14.826991 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:43:14.826991 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:43:14.826991 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:43:14.826991 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:43:14.826991 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 09 00:43:14.827906 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 09 00:43:14.827906 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:43:14.827906 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Oct 09 00:43:14.830304 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 454/885] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Oct 9 00:43:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 09 00:43:14.841803 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e26031d-9d8a-4ffa-89a2-365f0b79ded1 None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:14.861169 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf23eaa-c794-407a-a3a1-68bf04ba1d66 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:14.862073 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:14.885512 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:14.906846 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb24ed13-17f5-4350-8a6a-b383b61c1fb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:14.907750 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb24ed13-17f5-4350-8a6a-b383b61c1fb3 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:14.908027 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb24ed13-17f5-4350-8a6a-b383b61c1fb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:14.908295 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb24ed13-17f5-4350-8a6a-b383b61c1fb3 None admin] PATH_INFO: `/v3/services` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:14.908928 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb24ed13-17f5-4350-8a6a-b383b61c1fb3 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:43:14.909227 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb24ed13-17f5-4350-8a6a-b383b61c1fb3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:14.910599 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb24ed13-17f5-4350-8a6a-b383b61c1fb3 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:14.920283 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 432/886] 10.222.0.15 () {56 vars in 1122 bytes} [Sun Oct 9 00:43:14 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:43:14.980932 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e26031d-9d8a-4ffa-89a2-365f0b79ded1 None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:15.001280 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1106fb-2eeb-4b32-9d69-4de28f6d3b28 None None] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:15.001903 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1106fb-2eeb-4b32-9d69-4de28f6d3b28 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:15.002364 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1106fb-2eeb-4b32-9d69-4de28f6d3b28 None None] PATH_INFO: `/` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:15.008358 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 433/887] 10.222.0.15 () {54 vars in 927 bytes} [Sun Oct 9 00:43:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 09 00:43:15.010655 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9523dd-f88e-4f8e-bfc4-242f2066a439 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:15.011154 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9523dd-f88e-4f8e-bfc4-242f2066a439 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:15.011657 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9523dd-f88e-4f8e-bfc4-242f2066a439 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:15.021142 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45054535-17b3-40c4-8e1d-ac3a7cc7e801 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:15.021846 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45054535-17b3-40c4-8e1d-ac3a7cc7e801 None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:15.022129 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45054535-17b3-40c4-8e1d-ac3a7cc7e801 None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:15.022393 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45054535-17b3-40c4-8e1d-ac3a7cc7e801 None admin] PATH_INFO: `/v3/domains` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:15.023118 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45054535-17b3-40c4-8e1d-ac3a7cc7e801 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:43:15.023450 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45054535-17b3-40c4-8e1d-ac3a7cc7e801 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:15.024916 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45054535-17b3-40c4-8e1d-ac3a7cc7e801 None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:15.033546 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-8f9523dd-f88e-4f8e-bfc4-242f2066a439 None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:43:15.035065 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-8f9523dd-f88e-4f8e-bfc4-242f2066a439 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:43:15.041836 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 455/888] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Oct 9 00:43:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:43:15.047559 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45054535-17b3-40c4-8e1d-ac3a7cc7e801 None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:15.131583 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:15.135355 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 434/889] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Oct 9 00:43:15 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 09 00:43:15.160239 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45054535-17b3-40c4-8e1d-ac3a7cc7e801 None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:15.195677 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d511809-b19a-4844-8195-b7df169451eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:15.196695 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d511809-b19a-4844-8195-b7df169451eb None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:15.197183 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d511809-b19a-4844-8195-b7df169451eb None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:15.197640 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d511809-b19a-4844-8195-b7df169451eb None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:15.205308 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d511809-b19a-4844-8195-b7df169451eb None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:15.207005 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d511809-b19a-4844-8195-b7df169451eb None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:15.218984 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application [None req-7d511809-b19a-4844-8195-b7df169451eb None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 09 00:43:15.218984 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:43:15.218984 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:43:15.218984 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:43:15.218984 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:43:15.218984 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:43:15.218984 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:43:15.218984 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:43:15.218984 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:43:15.218984 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:43:15.218984 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:43:15.218984 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:43:15.218984 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 09 00:43:15.218984 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 09 00:43:15.218984 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 09 00:43:15.218984 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 09 00:43:15.219998 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:43:15.219998 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:43:15.219998 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 09 00:43:15.219998 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 09 00:43:15.219998 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 09 00:43:15.219998 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 09 00:43:15.219998 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:43:15.219998 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:43:15.219998 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:43:15.219998 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:43:15.219998 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:43:15.219998 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application with Lock( Oct 09 00:43:15.219998 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:43:15.219998 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:43:15.219998 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:43:15.219998 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:43:15.219998 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:43:15.219998 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:43:15.220939 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:43:15.220939 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:43:15.220939 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 09 00:43:15.220939 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 09 00:43:15.220939 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 09 00:43:15.220939 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 09 00:43:15.220939 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 09 00:43:15.220939 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 09 00:43:15.220939 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 09 00:43:15.220939 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Oct 09 00:43:15.223457 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 456/890] 10.222.0.15 () {56 vars in 1117 bytes} [Sun Oct 9 00:43:15 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 09 00:43:15.229437 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9523dd-f88e-4f8e-bfc4-242f2066a439 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:15.329237 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9523dd-f88e-4f8e-bfc4-242f2066a439 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:15.343902 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:15.369635 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dfc729-17aa-4104-90ca-d897cb824b9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:15.370637 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dfc729-17aa-4104-90ca-d897cb824b9a None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:15.371155 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dfc729-17aa-4104-90ca-d897cb824b9a None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:15.371638 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dfc729-17aa-4104-90ca-d897cb824b9a None admin] PATH_INFO: `/v3/users` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:15.373117 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0dfc729-17aa-4104-90ca-d897cb824b9a None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:43:15.373640 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0dfc729-17aa-4104-90ca-d897cb824b9a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:15.375252 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0dfc729-17aa-4104-90ca-d897cb824b9a None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:15.393578 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 435/891] 10.222.0.15 () {56 vars in 1149 bytes} [Sun Oct 9 00:43:15 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:43:15.399477 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d511809-b19a-4844-8195-b7df169451eb None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:15.405166 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dfc729-17aa-4104-90ca-d897cb824b9a None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:15.521806 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d511809-b19a-4844-8195-b7df169451eb None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:15.529019 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dfc729-17aa-4104-90ca-d897cb824b9a None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:15.558126 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43ee331-ead3-4762-88ed-3838c6e21796 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:15.559053 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43ee331-ead3-4762-88ed-3838c6e21796 None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:15.559629 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43ee331-ead3-4762-88ed-3838c6e21796 None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:15.559904 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43ee331-ead3-4762-88ed-3838c6e21796 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:15.563178 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:15.566813 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba8e867-79ed-4f32-a0ee-f202ef169e2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:15.567741 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba8e867-79ed-4f32-a0ee-f202ef169e2c None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:15.568123 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba8e867-79ed-4f32-a0ee-f202ef169e2c None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:15.568484 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba8e867-79ed-4f32-a0ee-f202ef169e2c None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:15.569168 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba8e867-79ed-4f32-a0ee-f202ef169e2c None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:15.570792 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba8e867-79ed-4f32-a0ee-f202ef169e2c None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:15.580745 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application [None req-5ba8e867-79ed-4f32-a0ee-f202ef169e2c None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 09 00:43:15.580745 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:43:15.580745 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 09 00:43:15.580745 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 09 00:43:15.580745 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 09 00:43:15.580745 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 09 00:43:15.580745 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 09 00:43:15.580745 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 09 00:43:15.580745 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 09 00:43:15.580745 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application Oct 09 00:43:15.580745 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 09 00:43:15.580745 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application Oct 09 00:43:15.580745 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:43:15.580745 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:43:15.580745 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:43:15.580745 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:43:15.580745 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:43:15.582003 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:43:15.582003 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:43:15.582003 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:43:15.582003 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:43:15.582003 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:43:15.582003 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:43:15.582003 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 09 00:43:15.582003 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 09 00:43:15.582003 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 09 00:43:15.582003 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 09 00:43:15.582003 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:43:15.582003 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:43:15.582003 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:43:15.582003 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:43:15.582003 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:43:15.582003 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:43:15.583072 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:43:15.583072 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application with Lock( Oct 09 00:43:15.583072 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:43:15.583072 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:43:15.583072 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:43:15.583072 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:43:15.583072 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:43:15.583072 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:43:15.583072 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:43:15.583072 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:43:15.583072 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 09 00:43:15.583072 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 09 00:43:15.583072 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 09 00:43:15.583072 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application Oct 09 00:43:15.590229 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 436/892] 10.222.0.15 () {56 vars in 1114 bytes} [Sun Oct 9 00:43:15 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 09 00:43:15.591227 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba8e867-79ed-4f32-a0ee-f202ef169e2c None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:15.633113 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:15.651307 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43ee331-ead3-4762-88ed-3838c6e21796 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:15.653460 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43ee331-ead3-4762-88ed-3838c6e21796 None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:15.712515 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba8e867-79ed-4f32-a0ee-f202ef169e2c None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:15.756551 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c95306f-2e28-4412-8a81-e972d886779a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:15.757706 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c95306f-2e28-4412-8a81-e972d886779a None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:15.758084 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c95306f-2e28-4412-8a81-e972d886779a None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:15.758451 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c95306f-2e28-4412-8a81-e972d886779a None admin] PATH_INFO: `/v3/services` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:15.759177 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c95306f-2e28-4412-8a81-e972d886779a None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:43:15.759588 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c95306f-2e28-4412-8a81-e972d886779a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:15.761956 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c95306f-2e28-4412-8a81-e972d886779a None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:15.771335 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 437/893] 10.222.0.15 () {56 vars in 1114 bytes} [Sun Oct 9 00:43:15 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:43:15.774674 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c95306f-2e28-4412-8a81-e972d886779a None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:15.782446 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 457/894] 10.222.0.15 () {58 vars in 1282 bytes} [Sun Oct 9 00:43:15 2022] GET /identity/v3/auth/tokens => generated 1372 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 09 00:43:15.787629 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43ee331-ead3-4762-88ed-3838c6e21796 None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:15.823874 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:15.881858 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:15.886003 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c95306f-2e28-4412-8a81-e972d886779a None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:15.897901 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43ee331-ead3-4762-88ed-3838c6e21796 None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:15.925315 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b50ac7f-06e8-470a-b4f2-ebfbe0a5c4e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:15.925848 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b50ac7f-06e8-470a-b4f2-ebfbe0a5c4e5 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:15.926120 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b50ac7f-06e8-470a-b4f2-ebfbe0a5c4e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:15.926444 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b50ac7f-06e8-470a-b4f2-ebfbe0a5c4e5 None admin] PATH_INFO: `/v3/services` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:15.927008 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b50ac7f-06e8-470a-b4f2-ebfbe0a5c4e5 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:43:15.927340 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b50ac7f-06e8-470a-b4f2-ebfbe0a5c4e5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:15.928916 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b50ac7f-06e8-470a-b4f2-ebfbe0a5c4e5 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:15.938911 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 438/895] 10.222.0.15 () {56 vars in 1114 bytes} [Sun Oct 9 00:43:15 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:43:15.940463 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b50ac7f-06e8-470a-b4f2-ebfbe0a5c4e5 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:15.942556 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0755b16-a3aa-48d0-a486-6657893af5a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:15.943192 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0755b16-a3aa-48d0-a486-6657893af5a9 None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:15.943504 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0755b16-a3aa-48d0-a486-6657893af5a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:15.943770 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0755b16-a3aa-48d0-a486-6657893af5a9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:15.957302 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0755b16-a3aa-48d0-a486-6657893af5a9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:15.959024 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0755b16-a3aa-48d0-a486-6657893af5a9 None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:15.978531 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application [None req-a0755b16-a3aa-48d0-a486-6657893af5a9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:43:15.978531 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:43:15.978531 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:43:15.978531 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:43:15.978531 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:43:15.978531 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:43:15.978531 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:43:15.978531 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:43:15.978531 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:43:15.978531 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:43:15.978531 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:43:15.978531 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:43:15.978531 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 09 00:43:15.978531 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 09 00:43:15.978531 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 09 00:43:15.978531 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 09 00:43:15.979511 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:43:15.979511 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:43:15.979511 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:43:15.979511 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:43:15.979511 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:43:15.979511 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:43:15.979511 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:43:15.979511 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application with Lock( Oct 09 00:43:15.979511 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:43:15.979511 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:43:15.979511 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:43:15.979511 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:43:15.979511 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:43:15.979511 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:43:15.979511 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:43:15.979511 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:43:15.979511 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 09 00:43:15.980398 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 09 00:43:15.980398 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:43:15.980398 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Oct 09 00:43:15.983326 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 458/896] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Oct 9 00:43:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 09 00:43:15.985399 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0755b16-a3aa-48d0-a486-6657893af5a9 None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:16.071157 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b50ac7f-06e8-470a-b4f2-ebfbe0a5c4e5 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:16.092052 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:16.108460 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0755b16-a3aa-48d0-a486-6657893af5a9 None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:16.110558 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa723eb-0687-4a67-bd77-f04fd977b082 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:16.111179 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa723eb-0687-4a67-bd77-f04fd977b082 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:16.111481 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa723eb-0687-4a67-bd77-f04fd977b082 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:16.111882 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa723eb-0687-4a67-bd77-f04fd977b082 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:16.113322 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa723eb-0687-4a67-bd77-f04fd977b082 None admin] RBAC: Adding query filter params (interface=public, service_id=9a6de2a06a2f4fb6878c1bd2417c956f, region_id=RegionOne) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:43:16.113322 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa723eb-0687-4a67-bd77-f04fd977b082 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:16.114649 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa723eb-0687-4a67-bd77-f04fd977b082 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:16.125498 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 439/897] 10.222.0.15 () {56 vars in 1251 bytes} [Sun Oct 9 00:43:15 2022] GET /identity/v3/endpoints?service_id=9a6de2a06a2f4fb6878c1bd2417c956f&interface=public®ion_id=RegionOne => generated 194 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 09 00:43:16.126387 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa723eb-0687-4a67-bd77-f04fd977b082 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:16.148955 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f0d4ce-8a96-49b2-bf0c-4db231a2d763 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:16.150015 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f0d4ce-8a96-49b2-bf0c-4db231a2d763 None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:16.150504 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f0d4ce-8a96-49b2-bf0c-4db231a2d763 None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:16.150973 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f0d4ce-8a96-49b2-bf0c-4db231a2d763 None admin] PATH_INFO: `/v3/domains` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:16.151867 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f0d4ce-8a96-49b2-bf0c-4db231a2d763 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:43:16.152369 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f0d4ce-8a96-49b2-bf0c-4db231a2d763 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:16.153988 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f0d4ce-8a96-49b2-bf0c-4db231a2d763 None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:16.155460 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:16.168143 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 459/898] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Oct 9 00:43:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:43:16.176724 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f0d4ce-8a96-49b2-bf0c-4db231a2d763 None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:16.248217 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa723eb-0687-4a67-bd77-f04fd977b082 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:16.282569 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f0d4ce-8a96-49b2-bf0c-4db231a2d763 None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:16.285303 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b93d061-91ac-4a03-b9e0-8f320ef42a0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:16.286163 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b93d061-91ac-4a03-b9e0-8f320ef42a0f None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:16.286667 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b93d061-91ac-4a03-b9e0-8f320ef42a0f None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:16.287125 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b93d061-91ac-4a03-b9e0-8f320ef42a0f None admin] PATH_INFO: `/v3/services` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:16.287961 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b93d061-91ac-4a03-b9e0-8f320ef42a0f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:16.289728 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b93d061-91ac-4a03-b9e0-8f320ef42a0f None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:16.301487 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 440/899] 10.222.0.15 () {56 vars in 1087 bytes} [Sun Oct 9 00:43:16 2022] GET /identity/v3/services => generated 1268 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 09 00:43:16.321661 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b23ecb-c40e-44cc-af6f-e837da5ce57b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:16.322329 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b23ecb-c40e-44cc-af6f-e837da5ce57b None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:16.322595 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b23ecb-c40e-44cc-af6f-e837da5ce57b None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:16.322855 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b23ecb-c40e-44cc-af6f-e837da5ce57b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:16.330841 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b23ecb-c40e-44cc-af6f-e837da5ce57b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:16.332357 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b23ecb-c40e-44cc-af6f-e837da5ce57b None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:16.344968 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application [None req-23b23ecb-c40e-44cc-af6f-e837da5ce57b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 09 00:43:16.344968 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:43:16.344968 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:43:16.344968 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:43:16.344968 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:43:16.344968 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:43:16.344968 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:43:16.344968 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:43:16.344968 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:43:16.344968 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:43:16.344968 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:43:16.344968 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:43:16.344968 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 09 00:43:16.344968 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 09 00:43:16.344968 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 09 00:43:16.345937 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 09 00:43:16.345937 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:43:16.345937 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:43:16.345937 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:43:16.345937 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:43:16.345937 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:43:16.345937 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:43:16.345937 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:43:16.345937 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application with Lock( Oct 09 00:43:16.345937 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:43:16.345937 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:43:16.345937 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:43:16.345937 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:43:16.345937 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:43:16.345937 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:43:16.345937 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:43:16.345937 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:43:16.346804 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 09 00:43:16.346804 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 09 00:43:16.346804 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 09 00:43:16.346804 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 09 00:43:16.346804 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 09 00:43:16.346804 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 09 00:43:16.346804 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 09 00:43:16.346804 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Oct 09 00:43:16.346804 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 460/900] 10.222.0.15 () {56 vars in 1111 bytes} [Sun Oct 9 00:43:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:43:16.354017 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b93d061-91ac-4a03-b9e0-8f320ef42a0f None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:16.461506 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:16.473889 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b93d061-91ac-4a03-b9e0-8f320ef42a0f None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:16.511131 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0152aaa6-1a17-4142-a812-8dc9f1c6a2f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:16.512179 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0152aaa6-1a17-4142-a812-8dc9f1c6a2f7 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:16.512656 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0152aaa6-1a17-4142-a812-8dc9f1c6a2f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:16.513153 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0152aaa6-1a17-4142-a812-8dc9f1c6a2f7 None admin] PATH_INFO: `/v3/projects` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:16.514084 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0152aaa6-1a17-4142-a812-8dc9f1c6a2f7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:43:16.514595 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0152aaa6-1a17-4142-a812-8dc9f1c6a2f7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:16.516314 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0152aaa6-1a17-4142-a812-8dc9f1c6a2f7 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:16.531108 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 441/901] 10.222.0.15 () {56 vars in 1148 bytes} [Sun Oct 9 00:43:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:43:16.537705 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b23ecb-c40e-44cc-af6f-e837da5ce57b None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:16.548008 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:16.629133 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fc99a4-13f9-4080-88b8-94fd0021d8a0 None None] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:16.629412 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fc99a4-13f9-4080-88b8-94fd0021d8a0 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:16.629910 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fc99a4-13f9-4080-88b8-94fd0021d8a0 None None] PATH_INFO: `/` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:16.635291 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 442/902] 10.222.0.15 () {54 vars in 927 bytes} [Sun Oct 9 00:43:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 09 00:43:16.636585 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f08618-c3dc-4214-8f87-d1f099dd2f1c None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:16.636865 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f08618-c3dc-4214-8f87-d1f099dd2f1c None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:16.637133 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f08618-c3dc-4214-8f87-d1f099dd2f1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:16.648576 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b23ecb-c40e-44cc-af6f-e837da5ce57b None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:16.655685 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-86f08618-c3dc-4214-8f87-d1f099dd2f1c None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:43:16.656873 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-86f08618-c3dc-4214-8f87-d1f099dd2f1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:43:16.692141 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d54535e-b758-4e1b-a442-411da6d8fd58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:16.693227 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d54535e-b758-4e1b-a442-411da6d8fd58 None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:16.694615 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d54535e-b758-4e1b-a442-411da6d8fd58 None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:16.695052 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d54535e-b758-4e1b-a442-411da6d8fd58 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:16.696086 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d54535e-b758-4e1b-a442-411da6d8fd58 None admin] RBAC: Adding query filter params (role.id=0a44a4718e6a4dd48874221bee2f6b20, scope.project.id=f148d39ced534860abfbe8fc3f98ace4, user.id=3a6cfef106c84f759ce0874be77f7380) {{(pid=81525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:43:16.696530 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d54535e-b758-4e1b-a442-411da6d8fd58 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:16.698132 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d54535e-b758-4e1b-a442-411da6d8fd58 None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:16.707157 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 461/903] 10.222.0.15 () {56 vars in 1374 bytes} [Sun Oct 9 00:43:16 2022] GET /identity/v3/role_assignments?user.id=3a6cfef106c84f759ce0874be77f7380&scope.project.id=f148d39ced534860abfbe8fc3f98ace4&role.id=0a44a4718e6a4dd48874221bee2f6b20 => generated 259 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:43:16.732807 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 443/904] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Oct 9 00:43:16 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 09 00:43:16.995596 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d54535e-b758-4e1b-a442-411da6d8fd58 None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:17.071736 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:17.109321 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d54535e-b758-4e1b-a442-411da6d8fd58 None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:17.146116 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ac57be-ead8-4c6f-8888-4892c1cfc207 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:17.147121 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ac57be-ead8-4c6f-8888-4892c1cfc207 None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:17.147752 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ac57be-ead8-4c6f-8888-4892c1cfc207 None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:17.148282 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ac57be-ead8-4c6f-8888-4892c1cfc207 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:17.149029 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ac57be-ead8-4c6f-8888-4892c1cfc207 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:17.150578 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ac57be-ead8-4c6f-8888-4892c1cfc207 None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:17.160280 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application [None req-f9ac57be-ead8-4c6f-8888-4892c1cfc207 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 09 00:43:17.160280 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:43:17.160280 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 09 00:43:17.160280 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 09 00:43:17.160280 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 09 00:43:17.160280 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 09 00:43:17.160280 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 09 00:43:17.160280 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 09 00:43:17.160280 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 09 00:43:17.160280 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Oct 09 00:43:17.160280 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 09 00:43:17.160280 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Oct 09 00:43:17.160280 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:43:17.160280 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:43:17.160280 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:43:17.160280 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:43:17.161430 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:43:17.161430 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:43:17.161430 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:43:17.161430 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:43:17.161430 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:43:17.161430 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:43:17.161430 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:43:17.161430 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 09 00:43:17.161430 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 09 00:43:17.161430 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 09 00:43:17.161430 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 09 00:43:17.161430 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:43:17.161430 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:43:17.161430 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:43:17.161430 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:43:17.161430 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:43:17.161430 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:43:17.162527 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:43:17.162527 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application with Lock( Oct 09 00:43:17.162527 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:43:17.162527 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:43:17.162527 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:43:17.162527 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:43:17.162527 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:43:17.162527 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:43:17.162527 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:43:17.162527 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:43:17.162527 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 09 00:43:17.162527 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 09 00:43:17.162527 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 09 00:43:17.162527 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Oct 09 00:43:17.164903 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 462/905] 10.222.0.15 () {56 vars in 1132 bytes} [Sun Oct 9 00:43:16 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:43:17.175304 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f08618-c3dc-4214-8f87-d1f099dd2f1c None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:17.177755 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddf62b5-2b39-4948-9f4f-83a28a752b92 None None] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:17.178036 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddf62b5-2b39-4948-9f4f-83a28a752b92 None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:17.178994 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddf62b5-2b39-4948-9f4f-83a28a752b92 None None] PATH_INFO: `/` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:17.180518 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 463/906] 10.222.0.15 () {54 vars in 927 bytes} [Sun Oct 9 00:43:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 09 00:43:17.185665 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0515882b-92a3-43b6-83d0-736e20e0f161 None None] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:17.185946 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0515882b-92a3-43b6-83d0-736e20e0f161 None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:17.186221 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0515882b-92a3-43b6-83d0-736e20e0f161 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:17.205302 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.auth.core [None req-0515882b-92a3-43b6-83d0-736e20e0f161 None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:43:17.206502 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-0515882b-92a3-43b6-83d0-736e20e0f161 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:43:17.259167 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:17.282259 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f08618-c3dc-4214-8f87-d1f099dd2f1c None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:17.285936 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 464/907] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Oct 9 00:43:17 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 09 00:43:17.329033 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8528d35d-c3be-42c0-b88a-b0baa2b10a4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:17.329651 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8528d35d-c3be-42c0-b88a-b0baa2b10a4d None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:17.329930 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8528d35d-c3be-42c0-b88a-b0baa2b10a4d None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:17.330299 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8528d35d-c3be-42c0-b88a-b0baa2b10a4d None admin] PATH_INFO: `/v3/services` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:17.330996 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8528d35d-c3be-42c0-b88a-b0baa2b10a4d None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:43:17.331367 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8528d35d-c3be-42c0-b88a-b0baa2b10a4d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:17.332811 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8528d35d-c3be-42c0-b88a-b0baa2b10a4d None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:17.338181 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 444/908] 10.222.0.15 () {56 vars in 1126 bytes} [Sun Oct 9 00:43:17 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:43:17.343994 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0515882b-92a3-43b6-83d0-736e20e0f161 None None] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:17.407337 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:17.445673 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0515882b-92a3-43b6-83d0-736e20e0f161 None None] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:17.479348 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb8a59d-0731-44f3-8bbf-9019788d88b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:17.479964 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb8a59d-0731-44f3-8bbf-9019788d88b8 None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:17.480240 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb8a59d-0731-44f3-8bbf-9019788d88b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:17.480510 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb8a59d-0731-44f3-8bbf-9019788d88b8 None admin] PATH_INFO: `/v3/services` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:17.481148 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb8a59d-0731-44f3-8bbf-9019788d88b8 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:43:17.481452 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb8a59d-0731-44f3-8bbf-9019788d88b8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:17.482845 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb8a59d-0731-44f3-8bbf-9019788d88b8 None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:17.487989 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 465/909] 10.222.0.15 () {56 vars in 1126 bytes} [Sun Oct 9 00:43:17 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:43:17.493845 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8528d35d-c3be-42c0-b88a-b0baa2b10a4d None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:17.564895 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb8a59d-0731-44f3-8bbf-9019788d88b8 None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:17.599296 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8528d35d-c3be-42c0-b88a-b0baa2b10a4d None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:17.643527 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d827c8-6959-4cc1-a6f6-1303acdf5742 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:17.644935 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d827c8-6959-4cc1-a6f6-1303acdf5742 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:17.645210 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d827c8-6959-4cc1-a6f6-1303acdf5742 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:17.645479 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d827c8-6959-4cc1-a6f6-1303acdf5742 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:17.646185 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d827c8-6959-4cc1-a6f6-1303acdf5742 None admin] RBAC: Adding query filter params (interface=public, service_id=cd4ba222c6a249db8f2905917b8291ba, region_id=RegionOne) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:43:17.646486 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d827c8-6959-4cc1-a6f6-1303acdf5742 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:17.647911 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d827c8-6959-4cc1-a6f6-1303acdf5742 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:17.654301 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 445/910] 10.222.0.15 () {56 vars in 1251 bytes} [Sun Oct 9 00:43:17 2022] GET /identity/v3/endpoints?service_id=cd4ba222c6a249db8f2905917b8291ba&interface=public®ion_id=RegionOne => generated 194 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:43:17.660214 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d827c8-6959-4cc1-a6f6-1303acdf5742 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:17.672214 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:17.686671 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb8a59d-0731-44f3-8bbf-9019788d88b8 None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:17.761543 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:17.780469 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5dbf4c-c464-4f02-bc12-bd9a4679c09d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:17.781169 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5dbf4c-c464-4f02-bc12-bd9a4679c09d None admin] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:17.781494 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5dbf4c-c464-4f02-bc12-bd9a4679c09d None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:17.781760 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5dbf4c-c464-4f02-bc12-bd9a4679c09d None admin] PATH_INFO: `/v3/services` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:17.782414 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5dbf4c-c464-4f02-bc12-bd9a4679c09d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:17.790140 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5dbf4c-c464-4f02-bc12-bd9a4679c09d None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:17.806289 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d827c8-6959-4cc1-a6f6-1303acdf5742 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:17.843200 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d317c06-c5f2-45fe-aa89-d120ebf35a80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:17.844190 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d317c06-c5f2-45fe-aa89-d120ebf35a80 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:17.844683 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d317c06-c5f2-45fe-aa89-d120ebf35a80 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:17.845197 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d317c06-c5f2-45fe-aa89-d120ebf35a80 None admin] PATH_INFO: `/v3/services` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:17.846002 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d317c06-c5f2-45fe-aa89-d120ebf35a80 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:17.847758 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d317c06-c5f2-45fe-aa89-d120ebf35a80 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:17.854521 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 446/912] 10.222.0.15 () {56 vars in 1087 bytes} [Sun Oct 9 00:43:17 2022] GET /identity/v3/services => generated 1497 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 09 00:43:17.854659 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 466/912] 10.222.0.15 () {60 vars in 1141 bytes} [Sun Oct 9 00:43:17 2022] POST /identity/v3/services => generated 241 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 09 00:43:18.647964 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18657f9f-49ee-4ed6-85d2-7a8a72915ba4 None None] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:18.648646 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18657f9f-49ee-4ed6-85d2-7a8a72915ba4 None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:18.648646 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18657f9f-49ee-4ed6-85d2-7a8a72915ba4 None None] PATH_INFO: `/` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:18.650070 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 467/913] 10.222.0.15 () {54 vars in 927 bytes} [Sun Oct 9 00:43:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:43:18.655663 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324f7efd-a109-4482-bfb4-26743009ca59 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:18.656135 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324f7efd-a109-4482-bfb4-26743009ca59 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:18.656219 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324f7efd-a109-4482-bfb4-26743009ca59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:18.674339 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-324f7efd-a109-4482-bfb4-26743009ca59 None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:43:18.675575 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-324f7efd-a109-4482-bfb4-26743009ca59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:43:18.744825 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:18.751375 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 447/914] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Oct 9 00:43:18 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 09 00:43:19.007213 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4232c1d1-4ed5-4914-ab1b-225663082aa2 None None] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:19.007428 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4232c1d1-4ed5-4914-ab1b-225663082aa2 None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:19.007713 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4232c1d1-4ed5-4914-ab1b-225663082aa2 None None] PATH_INFO: `/` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:19.009269 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 468/915] 10.222.0.15 () {54 vars in 927 bytes} [Sun Oct 9 00:43:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:43:19.014876 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a75a366-f786-4b1d-b353-64bb4de547ae None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:19.015157 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a75a366-f786-4b1d-b353-64bb4de547ae None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:19.015286 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4232c1d1-4ed5-4914-ab1b-225663082aa2 None None] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:19.015485 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a75a366-f786-4b1d-b353-64bb4de547ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:19.033373 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-2a75a366-f786-4b1d-b353-64bb4de547ae None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:43:19.034574 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-2a75a366-f786-4b1d-b353-64bb4de547ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:43:19.107313 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 448/916] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Oct 9 00:43:19 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 09 00:43:19.135821 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4232c1d1-4ed5-4914-ab1b-225663082aa2 None None] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:19.170017 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f89c70d-5f5e-424c-b951-06b57d8fe587 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:19.170946 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f89c70d-5f5e-424c-b951-06b57d8fe587 None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:19.171442 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f89c70d-5f5e-424c-b951-06b57d8fe587 None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:19.171940 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f89c70d-5f5e-424c-b951-06b57d8fe587 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:19.172691 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f89c70d-5f5e-424c-b951-06b57d8fe587 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:19.174228 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f89c70d-5f5e-424c-b951-06b57d8fe587 None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:19.183394 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application [None req-6f89c70d-5f5e-424c-b951-06b57d8fe587 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 09 00:43:19.183394 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:43:19.183394 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 09 00:43:19.183394 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 09 00:43:19.183394 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 09 00:43:19.183394 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 09 00:43:19.183394 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 09 00:43:19.183394 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 09 00:43:19.183394 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 09 00:43:19.183394 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Oct 09 00:43:19.183394 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 09 00:43:19.183394 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Oct 09 00:43:19.183394 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:43:19.183394 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:43:19.183394 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:43:19.183394 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:43:19.183394 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:43:19.184432 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:43:19.184432 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:43:19.184432 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:43:19.184432 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:43:19.184432 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:43:19.184432 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:43:19.184432 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 09 00:43:19.184432 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 09 00:43:19.184432 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 09 00:43:19.184432 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 09 00:43:19.184432 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:43:19.184432 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:43:19.184432 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:43:19.184432 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:43:19.184432 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:43:19.184432 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:43:19.185312 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:43:19.185312 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application with Lock( Oct 09 00:43:19.185312 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:43:19.185312 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:43:19.185312 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:43:19.185312 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:43:19.185312 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:43:19.185312 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:43:19.185312 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:43:19.185312 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:43:19.185312 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 09 00:43:19.185312 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 09 00:43:19.185312 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 09 00:43:19.185312 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Oct 09 00:43:19.187605 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 469/917] 10.222.0.15 () {56 vars in 1114 bytes} [Sun Oct 9 00:43:19 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 09 00:43:19.193717 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a75a366-f786-4b1d-b353-64bb4de547ae None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:19.299990 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a75a366-f786-4b1d-b353-64bb4de547ae None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:19.327183 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:19.335475 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d105326-22bd-426e-b080-118f9bb21f5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:19.336103 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d105326-22bd-426e-b080-118f9bb21f5e None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:19.336412 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d105326-22bd-426e-b080-118f9bb21f5e None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:19.336691 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d105326-22bd-426e-b080-118f9bb21f5e None admin] PATH_INFO: `/v3/services` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:19.337328 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d105326-22bd-426e-b080-118f9bb21f5e None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:43:19.337628 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d105326-22bd-426e-b080-118f9bb21f5e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:19.339002 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d105326-22bd-426e-b080-118f9bb21f5e None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:19.343971 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 449/918] 10.222.0.15 () {56 vars in 1114 bytes} [Sun Oct 9 00:43:19 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:43:19.352641 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f89c70d-5f5e-424c-b951-06b57d8fe587 None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:19.407036 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:19.408364 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d105326-22bd-426e-b080-118f9bb21f5e None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:19.465898 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f89c70d-5f5e-424c-b951-06b57d8fe587 None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:19.501365 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2bda29-e373-4d67-a000-337c7c417877 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:19.502513 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2bda29-e373-4d67-a000-337c7c417877 None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:19.503007 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2bda29-e373-4d67-a000-337c7c417877 None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:19.503508 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2bda29-e373-4d67-a000-337c7c417877 None admin] PATH_INFO: `/v3/services` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:19.504343 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2bda29-e373-4d67-a000-337c7c417877 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:43:19.504889 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2bda29-e373-4d67-a000-337c7c417877 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:19.506456 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2bda29-e373-4d67-a000-337c7c417877 None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:19.512061 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 470/919] 10.222.0.15 () {56 vars in 1114 bytes} [Sun Oct 9 00:43:19 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:43:19.516853 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d105326-22bd-426e-b080-118f9bb21f5e None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:19.517916 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2bda29-e373-4d67-a000-337c7c417877 None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:19.555703 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50738451-06d6-410d-b0c0-0710b2a848c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:19.556260 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50738451-06d6-410d-b0c0-0710b2a848c4 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:19.556530 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50738451-06d6-410d-b0c0-0710b2a848c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:19.556802 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50738451-06d6-410d-b0c0-0710b2a848c4 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:19.568903 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50738451-06d6-410d-b0c0-0710b2a848c4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 09 00:43:19.574930 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application [None req-50738451-06d6-410d-b0c0-0710b2a848c4 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 09 00:43:19.574930 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:43:19.574930 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:43:19.574930 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:43:19.574930 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:43:19.574930 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:43:19.574930 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:43:19.574930 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:43:19.574930 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:43:19.574930 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:43:19.574930 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:43:19.574930 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:43:19.574930 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 09 00:43:19.574930 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 09 00:43:19.574930 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 09 00:43:19.574930 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 09 00:43:19.575908 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 09 00:43:19.575908 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 09 00:43:19.575908 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 09 00:43:19.575908 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 09 00:43:19.575908 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:43:19.575908 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:43:19.575908 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:43:19.575908 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:43:19.575908 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:43:19.575908 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:43:19.575908 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:43:19.575908 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application with Lock( Oct 09 00:43:19.575908 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:43:19.575908 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:43:19.575908 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:43:19.575908 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:43:19.576737 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:43:19.576737 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:43:19.576737 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:43:19.576737 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:43:19.576737 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 09 00:43:19.576737 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 09 00:43:19.576737 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 09 00:43:19.576737 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 09 00:43:19.576737 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 09 00:43:19.576737 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 09 00:43:19.576737 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 09 00:43:19.576737 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application Oct 09 00:43:19.581111 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 450/920] 10.222.0.15 () {56 vars in 1120 bytes} [Sun Oct 9 00:43:19 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 09 00:43:19.582145 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50738451-06d6-410d-b0c0-0710b2a848c4 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:19.637904 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2bda29-e373-4d67-a000-337c7c417877 None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:19.647761 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:19.655970 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:19.675300 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8364545f-6bd9-450a-b98a-591c96da45b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:19.676022 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8364545f-6bd9-450a-b98a-591c96da45b4 None admin] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:19.676360 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8364545f-6bd9-450a-b98a-591c96da45b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:19.676711 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8364545f-6bd9-450a-b98a-591c96da45b4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:19.677582 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8364545f-6bd9-450a-b98a-591c96da45b4 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:19.679098 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8364545f-6bd9-450a-b98a-591c96da45b4 None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:19.702365 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50738451-06d6-410d-b0c0-0710b2a848c4 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:19.711403 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 471/921] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Oct 9 00:43:19 2022] POST /identity/v3/endpoints => generated 346 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 09 00:43:19.754506 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f32a92-97ee-48a6-9c5f-56458af61251 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:19.755127 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f32a92-97ee-48a6-9c5f-56458af61251 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:19.755434 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f32a92-97ee-48a6-9c5f-56458af61251 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:19.755701 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f32a92-97ee-48a6-9c5f-56458af61251 None admin] PATH_INFO: `/v3/roles` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:19.756372 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f32a92-97ee-48a6-9c5f-56458af61251 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:43:19.756666 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f32a92-97ee-48a6-9c5f-56458af61251 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:19.758328 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f32a92-97ee-48a6-9c5f-56458af61251 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:19.768442 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 451/922] 10.222.0.15 () {56 vars in 1115 bytes} [Sun Oct 9 00:43:19 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:43:19.774401 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8364545f-6bd9-450a-b98a-591c96da45b4 None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:19.886295 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8364545f-6bd9-450a-b98a-591c96da45b4 None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:19.924366 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72594dab-ce15-43ea-aafe-52bd9d1e1c4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:19.925081 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72594dab-ce15-43ea-aafe-52bd9d1e1c4d None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:19.925360 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72594dab-ce15-43ea-aafe-52bd9d1e1c4d None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:19.925623 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72594dab-ce15-43ea-aafe-52bd9d1e1c4d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:19.937532 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72594dab-ce15-43ea-aafe-52bd9d1e1c4d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:19.939015 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72594dab-ce15-43ea-aafe-52bd9d1e1c4d None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:19.955287 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application [None req-72594dab-ce15-43ea-aafe-52bd9d1e1c4d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:43:19.955287 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:43:19.955287 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:43:19.955287 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:43:19.955287 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:43:19.955287 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:43:19.955287 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:43:19.955287 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:43:19.955287 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:43:19.955287 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:43:19.955287 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:43:19.955287 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:43:19.955287 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 09 00:43:19.955287 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 09 00:43:19.955287 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 09 00:43:19.955287 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 09 00:43:19.956385 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:43:19.956385 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:43:19.956385 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:43:19.956385 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:43:19.956385 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:43:19.956385 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:43:19.956385 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:43:19.956385 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application with Lock( Oct 09 00:43:19.956385 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:43:19.956385 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:43:19.956385 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:43:19.956385 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:43:19.956385 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:43:19.956385 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:43:19.956385 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:43:19.956385 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:43:19.956385 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 09 00:43:19.957279 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 09 00:43:19.957279 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:43:19.957279 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Oct 09 00:43:19.957279 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 472/923] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Oct 9 00:43:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:43:19.962635 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f32a92-97ee-48a6-9c5f-56458af61251 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:20.070902 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f32a92-97ee-48a6-9c5f-56458af61251 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:20.087281 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:20.117875 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9216ce4d-483f-434b-a943-4e9e9f5574bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:20.118558 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9216ce4d-483f-434b-a943-4e9e9f5574bd None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:20.118892 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9216ce4d-483f-434b-a943-4e9e9f5574bd None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:20.119224 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9216ce4d-483f-434b-a943-4e9e9f5574bd None admin] PATH_INFO: `/v3/domains` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:20.120056 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9216ce4d-483f-434b-a943-4e9e9f5574bd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:43:20.120358 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9216ce4d-483f-434b-a943-4e9e9f5574bd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:20.121748 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9216ce4d-483f-434b-a943-4e9e9f5574bd None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:20.134972 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 452/924] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Oct 9 00:43:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:43:20.140729 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72594dab-ce15-43ea-aafe-52bd9d1e1c4d None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:20.166874 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:20.196799 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6957c2d-ab95-4418-ab95-08081d8afe48 None None] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:20.197139 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6957c2d-ab95-4418-ab95-08081d8afe48 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:20.197346 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6957c2d-ab95-4418-ab95-08081d8afe48 None None] PATH_INFO: `/` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:20.199247 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 453/925] 10.222.0.15 () {54 vars in 927 bytes} [Sun Oct 9 00:43:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 09 00:43:20.205237 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfcf543-c2e4-4c1b-9e99-24ab66aa5d14 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:20.205751 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfcf543-c2e4-4c1b-9e99-24ab66aa5d14 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:20.206086 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfcf543-c2e4-4c1b-9e99-24ab66aa5d14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:20.225540 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-0cfcf543-c2e4-4c1b-9e99-24ab66aa5d14 None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:43:20.226866 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-0cfcf543-c2e4-4c1b-9e99-24ab66aa5d14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:43:20.251793 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72594dab-ce15-43ea-aafe-52bd9d1e1c4d None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:20.291951 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63a8197-977e-45ee-8bc5-05c6ce6dbd30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:20.292641 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63a8197-977e-45ee-8bc5-05c6ce6dbd30 None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:20.292978 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63a8197-977e-45ee-8bc5-05c6ce6dbd30 None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:20.293278 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63a8197-977e-45ee-8bc5-05c6ce6dbd30 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:20.301495 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63a8197-977e-45ee-8bc5-05c6ce6dbd30 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:20.302227 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 454/926] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Oct 9 00:43:20 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 09 00:43:20.303050 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63a8197-977e-45ee-8bc5-05c6ce6dbd30 None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:20.317134 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169ea4be-5bde-4a6c-87d5-ba018937b425 None None] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:20.317134 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169ea4be-5bde-4a6c-87d5-ba018937b425 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:20.317134 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169ea4be-5bde-4a6c-87d5-ba018937b425 None None] PATH_INFO: `/` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:20.317134 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 455/927] 10.222.0.15 () {54 vars in 927 bytes} [Sun Oct 9 00:43:20 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:43:20.317569 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application [None req-c63a8197-977e-45ee-8bc5-05c6ce6dbd30 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 09 00:43:20.317569 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:43:20.317569 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:43:20.317569 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:43:20.317569 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:43:20.317569 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:43:20.317569 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:43:20.317569 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:43:20.317569 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:43:20.317569 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:43:20.317569 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:43:20.317569 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:43:20.317569 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 09 00:43:20.317569 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 09 00:43:20.317569 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 09 00:43:20.317569 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 09 00:43:20.318699 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:43:20.318699 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:43:20.318699 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 09 00:43:20.318699 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 09 00:43:20.318699 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 09 00:43:20.318699 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 09 00:43:20.318699 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:43:20.318699 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:43:20.318699 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:43:20.318699 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:43:20.318699 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:43:20.318699 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application with Lock( Oct 09 00:43:20.318699 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:43:20.318699 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:43:20.318699 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:43:20.318699 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:43:20.318699 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:43:20.318699 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:43:20.320021 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:43:20.320021 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:43:20.320021 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 09 00:43:20.320021 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 09 00:43:20.320021 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 09 00:43:20.320021 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 09 00:43:20.320021 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 09 00:43:20.320021 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 09 00:43:20.320021 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 09 00:43:20.320021 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Oct 09 00:43:20.320021 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 473/928] 10.222.0.15 () {56 vars in 1117 bytes} [Sun Oct 9 00:43:20 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:43:20.320658 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a6156d-9648-45b9-9964-decc469d6c96 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:20.320658 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a6156d-9648-45b9-9964-decc469d6c96 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:20.320658 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a6156d-9648-45b9-9964-decc469d6c96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:20.327413 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63a8197-977e-45ee-8bc5-05c6ce6dbd30 None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:20.339123 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-e9a6156d-9648-45b9-9964-decc469d6c96 None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:43:20.340557 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-e9a6156d-9648-45b9-9964-decc469d6c96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:43:20.421983 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 456/929] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Oct 9 00:43:20 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 09 00:43:20.422876 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:20.445724 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63a8197-977e-45ee-8bc5-05c6ce6dbd30 None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:20.482909 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f91a597-1f14-49d0-b4cf-f36413797880 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:20.483770 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f91a597-1f14-49d0-b4cf-f36413797880 None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:20.484134 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f91a597-1f14-49d0-b4cf-f36413797880 None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:20.484477 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f91a597-1f14-49d0-b4cf-f36413797880 None admin] PATH_INFO: `/v3/users` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:20.485496 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f91a597-1f14-49d0-b4cf-f36413797880 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:43:20.485887 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f91a597-1f14-49d0-b4cf-f36413797880 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:20.487900 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f91a597-1f14-49d0-b4cf-f36413797880 None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:20.508932 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 474/930] 10.222.0.15 () {56 vars in 1149 bytes} [Sun Oct 9 00:43:20 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 09 00:43:20.515159 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a6156d-9648-45b9-9964-decc469d6c96 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:20.546986 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:20.588820 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f91a597-1f14-49d0-b4cf-f36413797880 None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:20.619173 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a6156d-9648-45b9-9964-decc469d6c96 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:20.657228 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d550c990-ddff-4e89-ab3e-07aecd8c65ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:20.657866 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d550c990-ddff-4e89-ab3e-07aecd8c65ed None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:20.658143 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d550c990-ddff-4e89-ab3e-07aecd8c65ed None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:20.658411 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d550c990-ddff-4e89-ab3e-07aecd8c65ed None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:20.671383 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d550c990-ddff-4e89-ab3e-07aecd8c65ed None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:20.674000 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d550c990-ddff-4e89-ab3e-07aecd8c65ed None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:20.695756 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application [None req-d550c990-ddff-4e89-ab3e-07aecd8c65ed None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:43:20.695756 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:43:20.695756 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:43:20.695756 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:43:20.695756 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:43:20.695756 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:43:20.695756 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:43:20.695756 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:43:20.695756 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:43:20.695756 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:43:20.695756 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:43:20.695756 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:43:20.695756 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 09 00:43:20.695756 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 09 00:43:20.695756 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 09 00:43:20.695756 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 09 00:43:20.696767 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:43:20.696767 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:43:20.696767 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:43:20.696767 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:43:20.696767 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:43:20.696767 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:43:20.696767 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:43:20.696767 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application with Lock( Oct 09 00:43:20.696767 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:43:20.696767 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:43:20.696767 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:43:20.696767 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:43:20.696767 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:43:20.696767 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:43:20.696767 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:43:20.696767 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:43:20.696767 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 09 00:43:20.698094 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 09 00:43:20.698094 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:43:20.698094 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application Oct 09 00:43:20.698094 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 457/931] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Oct 9 00:43:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:43:20.702770 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d550c990-ddff-4e89-ab3e-07aecd8c65ed None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:20.705201 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f91a597-1f14-49d0-b4cf-f36413797880 None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:20.739985 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a38ea04-2cd5-4908-9257-1cf493fad9ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:20.740613 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a38ea04-2cd5-4908-9257-1cf493fad9ff None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:20.740883 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a38ea04-2cd5-4908-9257-1cf493fad9ff None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:20.741153 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a38ea04-2cd5-4908-9257-1cf493fad9ff None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:20.741766 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a38ea04-2cd5-4908-9257-1cf493fad9ff None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:20.743152 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a38ea04-2cd5-4908-9257-1cf493fad9ff None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:20.752200 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application [None req-5a38ea04-2cd5-4908-9257-1cf493fad9ff None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 09 00:43:20.752200 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:43:20.752200 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 09 00:43:20.752200 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 09 00:43:20.752200 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 09 00:43:20.752200 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 09 00:43:20.752200 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 09 00:43:20.752200 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 09 00:43:20.752200 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 09 00:43:20.752200 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Oct 09 00:43:20.752200 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 09 00:43:20.752200 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Oct 09 00:43:20.752200 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:43:20.752200 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:43:20.752200 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:43:20.752200 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:43:20.753333 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:43:20.753333 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:43:20.753333 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:43:20.753333 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:43:20.753333 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:43:20.753333 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:43:20.753333 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:43:20.753333 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 09 00:43:20.753333 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 09 00:43:20.753333 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 09 00:43:20.753333 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 09 00:43:20.753333 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:43:20.753333 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:43:20.753333 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:43:20.753333 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:43:20.753333 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:43:20.753333 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:43:20.754225 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:43:20.754225 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application with Lock( Oct 09 00:43:20.754225 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:43:20.754225 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:43:20.754225 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:43:20.754225 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:43:20.754225 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:43:20.754225 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:43:20.754225 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:43:20.754225 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:43:20.754225 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 09 00:43:20.754225 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 09 00:43:20.754225 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 09 00:43:20.754225 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Oct 09 00:43:20.754225 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 475/932] 10.222.0.15 () {56 vars in 1132 bytes} [Sun Oct 9 00:43:20 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 09 00:43:20.755062 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a38ea04-2cd5-4908-9257-1cf493fad9ff None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:20.767643 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:20.808014 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:20.826969 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d550c990-ddff-4e89-ab3e-07aecd8c65ed None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:20.861274 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eaa0b60-7164-4c7d-9f60-029e76ea007e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:20.861883 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaa0b60-7164-4c7d-9f60-029e76ea007e None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:20.862101 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a38ea04-2cd5-4908-9257-1cf493fad9ff None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:20.862211 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaa0b60-7164-4c7d-9f60-029e76ea007e None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:20.862414 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaa0b60-7164-4c7d-9f60-029e76ea007e None admin] PATH_INFO: `/v3/domains` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:20.863052 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eaa0b60-7164-4c7d-9f60-029e76ea007e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:43:20.863387 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eaa0b60-7164-4c7d-9f60-029e76ea007e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:20.864787 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eaa0b60-7164-4c7d-9f60-029e76ea007e None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:20.882862 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 458/933] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Oct 9 00:43:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 09 00:43:20.882862 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eaa0b60-7164-4c7d-9f60-029e76ea007e None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:20.908476 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3f97a8-6929-4ba7-9cd0-6639d7630020 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:20.909455 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3f97a8-6929-4ba7-9cd0-6639d7630020 None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:20.909920 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3f97a8-6929-4ba7-9cd0-6639d7630020 None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:20.910378 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3f97a8-6929-4ba7-9cd0-6639d7630020 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:20.911068 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3f97a8-6929-4ba7-9cd0-6639d7630020 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:20.912848 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3f97a8-6929-4ba7-9cd0-6639d7630020 None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:20.921768 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application [None req-5c3f97a8-6929-4ba7-9cd0-6639d7630020 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 09 00:43:20.921768 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:43:20.921768 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 09 00:43:20.921768 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 09 00:43:20.921768 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 09 00:43:20.921768 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 09 00:43:20.921768 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 09 00:43:20.921768 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 09 00:43:20.921768 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 09 00:43:20.921768 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Oct 09 00:43:20.921768 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 09 00:43:20.921768 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Oct 09 00:43:20.921768 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:43:20.921768 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:43:20.921768 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:43:20.921768 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:43:20.921768 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:43:20.927694 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:43:20.927694 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:43:20.927694 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:43:20.927694 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:43:20.927694 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:43:20.927694 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:43:20.927694 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 09 00:43:20.927694 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 09 00:43:20.927694 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 09 00:43:20.927694 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 09 00:43:20.927694 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:43:20.927694 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:43:20.927694 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:43:20.927694 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:43:20.927694 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:43:20.927694 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:43:20.928703 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:43:20.928703 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application with Lock( Oct 09 00:43:20.928703 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:43:20.928703 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:43:20.928703 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:43:20.928703 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:43:20.928703 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:43:20.928703 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:43:20.928703 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:43:20.928703 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:43:20.928703 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 09 00:43:20.928703 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 09 00:43:20.928703 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 09 00:43:20.928703 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Oct 09 00:43:20.928703 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 476/934] 10.222.0.15 () {56 vars in 1126 bytes} [Sun Oct 9 00:43:20 2022] GET /identity/v3/services/object-store => generated 93 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:43:20.929808 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3f97a8-6929-4ba7-9cd0-6639d7630020 None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:20.990319 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eaa0b60-7164-4c7d-9f60-029e76ea007e None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:21.003168 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:21.028213 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a0ff9c-ea30-47a1-a893-57d221b8f95d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:21.028931 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a0ff9c-ea30-47a1-a893-57d221b8f95d None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:21.029269 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a0ff9c-ea30-47a1-a893-57d221b8f95d None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:21.029602 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a0ff9c-ea30-47a1-a893-57d221b8f95d None admin] PATH_INFO: `/v3/services` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:21.030301 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a0ff9c-ea30-47a1-a893-57d221b8f95d None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:43:21.030655 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a0ff9c-ea30-47a1-a893-57d221b8f95d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:21.032139 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a0ff9c-ea30-47a1-a893-57d221b8f95d None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:21.037170 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3f97a8-6929-4ba7-9cd0-6639d7630020 None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:21.042174 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 459/935] 10.222.0.15 () {56 vars in 1126 bytes} [Sun Oct 9 00:43:20 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:43:21.043074 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a0ff9c-ea30-47a1-a893-57d221b8f95d None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:21.052254 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:21.073638 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ee7801-7f48-4067-9503-9ae7bb003aec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:21.074290 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ee7801-7f48-4067-9503-9ae7bb003aec None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:21.074538 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ee7801-7f48-4067-9503-9ae7bb003aec None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:21.074802 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ee7801-7f48-4067-9503-9ae7bb003aec None admin] PATH_INFO: `/v3/projects/service` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:21.082422 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ee7801-7f48-4067-9503-9ae7bb003aec None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:21.083932 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ee7801-7f48-4067-9503-9ae7bb003aec None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:21.096340 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application [None req-c2ee7801-7f48-4067-9503-9ae7bb003aec None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 09 00:43:21.096340 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:43:21.096340 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:43:21.096340 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:43:21.096340 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:43:21.096340 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:43:21.096340 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:43:21.096340 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:43:21.096340 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:43:21.096340 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:43:21.096340 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:43:21.096340 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:43:21.096340 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 09 00:43:21.096340 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 09 00:43:21.096340 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 09 00:43:21.097451 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 09 00:43:21.097451 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:43:21.097451 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:43:21.097451 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:43:21.097451 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:43:21.097451 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:43:21.097451 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:43:21.097451 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:43:21.097451 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application with Lock( Oct 09 00:43:21.097451 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:43:21.097451 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:43:21.097451 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:43:21.097451 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:43:21.097451 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:43:21.097451 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:43:21.097451 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:43:21.097451 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:43:21.098361 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 09 00:43:21.098361 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 09 00:43:21.098361 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 09 00:43:21.098361 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 09 00:43:21.098361 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 09 00:43:21.098361 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 09 00:43:21.098361 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 09 00:43:21.098361 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Oct 09 00:43:21.098361 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 477/936] 10.222.0.15 () {56 vars in 1111 bytes} [Sun Oct 9 00:43:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:43:21.098861 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ee7801-7f48-4067-9503-9ae7bb003aec None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:21.155041 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a0ff9c-ea30-47a1-a893-57d221b8f95d None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:21.189719 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312b4084-574a-4eea-92e8-ad71530076aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:21.190275 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312b4084-574a-4eea-92e8-ad71530076aa None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:21.190519 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312b4084-574a-4eea-92e8-ad71530076aa None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:21.190914 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312b4084-574a-4eea-92e8-ad71530076aa None admin] PATH_INFO: `/v3/services` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:21.191648 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312b4084-574a-4eea-92e8-ad71530076aa None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:43:21.191860 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312b4084-574a-4eea-92e8-ad71530076aa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:21.193171 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312b4084-574a-4eea-92e8-ad71530076aa None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:21.198236 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 460/937] 10.222.0.15 () {56 vars in 1122 bytes} [Sun Oct 9 00:43:21 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:43:21.198845 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312b4084-574a-4eea-92e8-ad71530076aa None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:21.213254 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ee7801-7f48-4067-9503-9ae7bb003aec None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:21.243094 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:21.247915 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9474e9ac-c073-40de-b457-a42ed5e6636d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:21.248707 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9474e9ac-c073-40de-b457-a42ed5e6636d None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:21.249191 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9474e9ac-c073-40de-b457-a42ed5e6636d None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:21.249474 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9474e9ac-c073-40de-b457-a42ed5e6636d None admin] PATH_INFO: `/v3/services` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:21.250411 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9474e9ac-c073-40de-b457-a42ed5e6636d None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:43:21.250710 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9474e9ac-c073-40de-b457-a42ed5e6636d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:21.252131 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9474e9ac-c073-40de-b457-a42ed5e6636d None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:21.257279 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 478/938] 10.222.0.15 () {56 vars in 1126 bytes} [Sun Oct 9 00:43:21 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:43:21.260397 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9474e9ac-c073-40de-b457-a42ed5e6636d None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:21.272229 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:21.306047 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312b4084-574a-4eea-92e8-ad71530076aa None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:21.344646 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf8dad2-38ea-411b-a6c8-ad7d91f0e5af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:21.345248 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf8dad2-38ea-411b-a6c8-ad7d91f0e5af None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:21.345523 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf8dad2-38ea-411b-a6c8-ad7d91f0e5af None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:21.345794 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf8dad2-38ea-411b-a6c8-ad7d91f0e5af None admin] PATH_INFO: `/v3/projects` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:21.346627 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf8dad2-38ea-411b-a6c8-ad7d91f0e5af None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:43:21.347220 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf8dad2-38ea-411b-a6c8-ad7d91f0e5af None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:21.348678 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf8dad2-38ea-411b-a6c8-ad7d91f0e5af None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:21.362013 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9474e9ac-c073-40de-b457-a42ed5e6636d None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:21.367115 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 461/939] 10.222.0.15 () {56 vars in 1148 bytes} [Sun Oct 9 00:43:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:43:21.367115 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf8dad2-38ea-411b-a6c8-ad7d91f0e5af None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:21.400346 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2a66c6-fdf4-4735-a0bc-be70c9ea9def None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:21.400965 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2a66c6-fdf4-4735-a0bc-be70c9ea9def None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:21.401238 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2a66c6-fdf4-4735-a0bc-be70c9ea9def None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:21.401506 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2a66c6-fdf4-4735-a0bc-be70c9ea9def None admin] PATH_INFO: `/v3/services` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:21.402156 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2a66c6-fdf4-4735-a0bc-be70c9ea9def None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:43:21.402430 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2a66c6-fdf4-4735-a0bc-be70c9ea9def None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:21.403955 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2a66c6-fdf4-4735-a0bc-be70c9ea9def None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:21.409058 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 479/940] 10.222.0.15 () {56 vars in 1122 bytes} [Sun Oct 9 00:43:21 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:43:21.409626 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2a66c6-fdf4-4735-a0bc-be70c9ea9def None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:21.474463 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:21.484500 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf8dad2-38ea-411b-a6c8-ad7d91f0e5af None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:21.517517 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:21.521685 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2a66c6-fdf4-4735-a0bc-be70c9ea9def None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:21.524655 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f72ed1-6ce2-48f8-a889-9f6e8647cd12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:21.525274 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f72ed1-6ce2-48f8-a889-9f6e8647cd12 None admin] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:21.525549 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f72ed1-6ce2-48f8-a889-9f6e8647cd12 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:21.525821 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f72ed1-6ce2-48f8-a889-9f6e8647cd12 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:21.526489 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f72ed1-6ce2-48f8-a889-9f6e8647cd12 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:21.527890 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f72ed1-6ce2-48f8-a889-9f6e8647cd12 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:21.551067 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 462/941] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Oct 9 00:43:21 2022] POST /identity/v3/endpoints => generated 347 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 09 00:43:21.552236 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f72ed1-6ce2-48f8-a889-9f6e8647cd12 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:21.577369 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356c3cf9-0eb1-40c4-b1a7-cf46af8e7b83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:21.578629 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356c3cf9-0eb1-40c4-b1a7-cf46af8e7b83 None admin] REQUEST_METHOD: `PUT` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:21.579197 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356c3cf9-0eb1-40c4-b1a7-cf46af8e7b83 None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:21.580065 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356c3cf9-0eb1-40c4-b1a7-cf46af8e7b83 None admin] PATH_INFO: `/v3/projects/f148d39ced534860abfbe8fc3f98ace4/users/3a6cfef106c84f759ce0874be77f7380/roles/0a44a4718e6a4dd48874221bee2f6b20` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:21.582705 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356c3cf9-0eb1-40c4-b1a7-cf46af8e7b83 None admin] RBAC: Authorizing `identity:create_grant(project_id=f148d39ced534860abfbe8fc3f98ace4, user_id=3a6cfef106c84f759ce0874be77f7380, role_id=0a44a4718e6a4dd48874221bee2f6b20)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:21.584774 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356c3cf9-0eb1-40c4-b1a7-cf46af8e7b83 None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:21.613004 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 480/942] 10.222.0.15 () {58 vars in 1439 bytes} [Sun Oct 9 00:43:21 2022] PUT /identity/v3/projects/f148d39ced534860abfbe8fc3f98ace4/users/3a6cfef106c84f759ce0874be77f7380/roles/0a44a4718e6a4dd48874221bee2f6b20 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 00:43:21.704044 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f72ed1-6ce2-48f8-a889-9f6e8647cd12 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:21.747432 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b6bbbe-ae20-4d9b-bc92-33988ebb60f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:21.748725 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b6bbbe-ae20-4d9b-bc92-33988ebb60f9 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:21.749148 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b6bbbe-ae20-4d9b-bc92-33988ebb60f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:21.749572 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b6bbbe-ae20-4d9b-bc92-33988ebb60f9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:21.750454 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b6bbbe-ae20-4d9b-bc92-33988ebb60f9 None admin] RBAC: Adding query filter params (interface=public, service_id=184e712aa7a741a3a7fcb93710d1f6bb, region_id=RegionOne) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:43:21.750905 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b6bbbe-ae20-4d9b-bc92-33988ebb60f9 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:21.752500 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b6bbbe-ae20-4d9b-bc92-33988ebb60f9 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:21.759162 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 463/943] 10.222.0.15 () {56 vars in 1251 bytes} [Sun Oct 9 00:43:21 2022] GET /identity/v3/endpoints?service_id=184e712aa7a741a3a7fcb93710d1f6bb&interface=public®ion_id=RegionOne => generated 194 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:43:21.764977 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356c3cf9-0eb1-40c4-b1a7-cf46af8e7b83 None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:21.873412 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356c3cf9-0eb1-40c4-b1a7-cf46af8e7b83 None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:21.888664 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:21.919562 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742eb16d-06f9-4de4-853f-67aee25d4cf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:21.920205 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742eb16d-06f9-4de4-853f-67aee25d4cf7 None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:21.920480 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742eb16d-06f9-4de4-853f-67aee25d4cf7 None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:21.920746 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742eb16d-06f9-4de4-853f-67aee25d4cf7 None admin] PATH_INFO: `/v3/services` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:21.921383 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742eb16d-06f9-4de4-853f-67aee25d4cf7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:21.922806 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742eb16d-06f9-4de4-853f-67aee25d4cf7 None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:21.930590 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 481/944] 10.222.0.15 () {56 vars in 1087 bytes} [Sun Oct 9 00:43:21 2022] GET /identity/v3/services => generated 1497 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 09 00:43:22.031452 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174958c1-a8eb-49d3-9999-eae510573b57 None None] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:22.031641 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174958c1-a8eb-49d3-9999-eae510573b57 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:22.031901 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174958c1-a8eb-49d3-9999-eae510573b57 None None] PATH_INFO: `/` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:22.033540 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 464/945] 10.222.0.15 () {54 vars in 927 bytes} [Sun Oct 9 00:43:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:43:22.039453 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1523a14-5a8e-406f-afc0-c65a7395fe50 None None] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:22.039729 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1523a14-5a8e-406f-afc0-c65a7395fe50 None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:22.040000 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1523a14-5a8e-406f-afc0-c65a7395fe50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:22.060594 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.auth.core [None req-b1523a14-5a8e-406f-afc0-c65a7395fe50 None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:43:22.062209 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-b1523a14-5a8e-406f-afc0-c65a7395fe50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:43:22.169536 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 482/946] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Oct 9 00:43:22 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 09 00:43:22.460244 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174958c1-a8eb-49d3-9999-eae510573b57 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:22.535584 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:22.596825 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174958c1-a8eb-49d3-9999-eae510573b57 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:22.635997 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3865e6-d084-4874-9655-b2686edd101d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:22.636799 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3865e6-d084-4874-9655-b2686edd101d None admin] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:22.637070 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3865e6-d084-4874-9655-b2686edd101d None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:22.637374 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3865e6-d084-4874-9655-b2686edd101d None admin] PATH_INFO: `/v3/projects` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:22.638045 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3865e6-d084-4874-9655-b2686edd101d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:22.639615 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3865e6-d084-4874-9655-b2686edd101d None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:22.642520 dv-cinder-master-3-smb devstack@keystone.service[81524]: WARNING keystone.server.flask.common [None req-7c3865e6-d084-4874-9655-b2686edd101d None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Oct 09 00:43:22.663227 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.sql.core [None req-7c3865e6-d084-4874-9655-b2686edd101d None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Oct 09 00:43:22.663227 dv-cinder-master-3-smb devstack@keystone.service[81524]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 09 00:43:22.663227 dv-cinder-master-3-smb devstack@keystone.service[81524]: [parameters: {'id': 'e4002a5d24ef4022a3e6c0d26624b6eb', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Oct 09 00:43:22.663227 dv-cinder-master-3-smb devstack@keystone.service[81524]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81524) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 09 00:43:22.680687 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application [None req-7c3865e6-d084-4874-9655-b2686edd101d None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id e4002a5d24ef4022a3e6c0d26624b6eb.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id e4002a5d24ef4022a3e6c0d26624b6eb. Oct 09 00:43:22.680687 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:43:22.680687 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 09 00:43:22.680687 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 09 00:43:22.680687 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 09 00:43:22.680687 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 09 00:43:22.680687 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 09 00:43:22.680687 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application result = self._query(query) Oct 09 00:43:22.680687 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 09 00:43:22.680687 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application conn.query(q) Oct 09 00:43:22.680687 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 09 00:43:22.680687 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 09 00:43:22.680687 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 09 00:43:22.681578 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application result.read() Oct 09 00:43:22.681578 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 09 00:43:22.681578 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 09 00:43:22.681578 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 09 00:43:22.681578 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 09 00:43:22.681578 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 09 00:43:22.681578 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 09 00:43:22.681578 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 09 00:43:22.681578 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 09 00:43:22.681578 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Oct 09 00:43:22.681578 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application Oct 09 00:43:22.681578 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 09 00:43:22.681578 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application Oct 09 00:43:22.681578 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:43:22.681578 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 09 00:43:22.681578 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 09 00:43:22.681578 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Oct 09 00:43:22.681578 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return project_ref.to_dict() Oct 09 00:43:22.682847 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 09 00:43:22.682847 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application next(self.gen) Oct 09 00:43:22.682847 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Oct 09 00:43:22.682847 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application yield resource Oct 09 00:43:22.682847 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 09 00:43:22.682847 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application next(self.gen) Oct 09 00:43:22.682847 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Oct 09 00:43:22.682847 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application self.session.rollback() Oct 09 00:43:22.682847 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 09 00:43:22.682847 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application self.force_reraise() Oct 09 00:43:22.682847 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 09 00:43:22.682847 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application raise self.value Oct 09 00:43:22.682847 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Oct 09 00:43:22.682847 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 09 00:43:22.682847 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Oct 09 00:43:22.682847 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application session.commit() Oct 09 00:43:22.682847 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 09 00:43:22.684121 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 09 00:43:22.684121 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 09 00:43:22.684121 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application self._prepare_impl() Oct 09 00:43:22.684121 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 09 00:43:22.684121 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application self.session.flush() Oct 09 00:43:22.684121 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 09 00:43:22.684121 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application self._flush(objects) Oct 09 00:43:22.684121 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 09 00:43:22.684121 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 09 00:43:22.684121 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 09 00:43:22.684121 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application compat.raise_( Oct 09 00:43:22.684121 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 09 00:43:22.684121 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application raise exception Oct 09 00:43:22.684121 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 09 00:43:22.684121 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application flush_context.execute() Oct 09 00:43:22.684121 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 09 00:43:22.684121 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application rec.execute(self) Oct 09 00:43:22.685040 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 09 00:43:22.685040 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 09 00:43:22.685040 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 09 00:43:22.685040 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 09 00:43:22.685040 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 09 00:43:22.685040 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 09 00:43:22.685040 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 09 00:43:22.685040 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 09 00:43:22.685040 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 09 00:43:22.685040 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 09 00:43:22.685040 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 09 00:43:22.685040 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 09 00:43:22.685040 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 09 00:43:22.685040 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 09 00:43:22.685040 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 09 00:43:22.685849 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 09 00:43:22.685849 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 09 00:43:22.685849 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application raise exception Oct 09 00:43:22.685849 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 09 00:43:22.685849 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 09 00:43:22.685849 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 09 00:43:22.685849 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 09 00:43:22.685849 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 09 00:43:22.685849 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application result = self._query(query) Oct 09 00:43:22.685849 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 09 00:43:22.685849 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application conn.query(q) Oct 09 00:43:22.685849 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 09 00:43:22.685849 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 09 00:43:22.685849 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 09 00:43:22.685849 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application result.read() Oct 09 00:43:22.685849 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 09 00:43:22.685849 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 09 00:43:22.686713 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 09 00:43:22.686713 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 09 00:43:22.686713 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 09 00:43:22.686713 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 09 00:43:22.686713 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 09 00:43:22.686713 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 09 00:43:22.686713 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Oct 09 00:43:22.686713 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 09 00:43:22.686713 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application [parameters: {'id': 'e4002a5d24ef4022a3e6c0d26624b6eb', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Oct 09 00:43:22.686713 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 09 00:43:22.686713 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application Oct 09 00:43:22.686713 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 09 00:43:22.686713 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application Oct 09 00:43:22.686713 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:43:22.686713 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Oct 09 00:43:22.688724 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Oct 09 00:43:22.688724 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 09 00:43:22.688724 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 09 00:43:22.688724 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Oct 09 00:43:22.688724 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application Oct 09 00:43:22.688724 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 09 00:43:22.688724 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application Oct 09 00:43:22.688724 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:43:22.688724 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:43:22.688724 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:43:22.688724 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:43:22.688724 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:43:22.688724 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:43:22.688724 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:43:22.688724 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:43:22.688724 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:43:22.688724 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:43:22.690823 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:43:22.690823 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Oct 09 00:43:22.690823 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Oct 09 00:43:22.690823 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:43:22.690823 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:43:22.690823 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Oct 09 00:43:22.690823 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application raise exception.Conflict( Oct 09 00:43:22.690823 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id e4002a5d24ef4022a3e6c0d26624b6eb. Oct 09 00:43:22.690823 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application Oct 09 00:43:22.690823 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 465/947] 10.222.0.15 () {60 vars in 1140 bytes} [Sun Oct 9 00:43:22 2022] POST /identity/v3/projects => generated 262 bytes in 223 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:43:22.691894 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1523a14-5a8e-406f-afc0-c65a7395fe50 None None] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:22.798226 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1523a14-5a8e-406f-afc0-c65a7395fe50 None None] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:22.808449 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:22.834804 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a73ff04-9407-41e1-afb8-cc38b316d1be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:22.835585 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a73ff04-9407-41e1-afb8-cc38b316d1be None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:22.835847 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a73ff04-9407-41e1-afb8-cc38b316d1be None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:22.836168 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a73ff04-9407-41e1-afb8-cc38b316d1be None admin] PATH_INFO: `/v3/projects/service` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:22.843521 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a73ff04-9407-41e1-afb8-cc38b316d1be None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:22.844989 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a73ff04-9407-41e1-afb8-cc38b316d1be None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:22.858411 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application [None req-6a73ff04-9407-41e1-afb8-cc38b316d1be None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 09 00:43:22.858411 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:43:22.858411 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:43:22.858411 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:43:22.858411 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:43:22.858411 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:43:22.858411 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:43:22.858411 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:43:22.858411 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:43:22.858411 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:43:22.858411 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:43:22.858411 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:43:22.858411 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 09 00:43:22.858411 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 09 00:43:22.858411 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 09 00:43:22.860635 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 09 00:43:22.860635 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:43:22.860635 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:43:22.860635 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:43:22.860635 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:43:22.860635 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:43:22.860635 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:43:22.860635 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:43:22.860635 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application with Lock( Oct 09 00:43:22.860635 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:43:22.860635 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:43:22.860635 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:43:22.860635 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:43:22.860635 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:43:22.860635 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:43:22.860635 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:43:22.860635 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:43:22.862839 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 09 00:43:22.862839 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 09 00:43:22.862839 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 09 00:43:22.862839 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 09 00:43:22.862839 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 09 00:43:22.862839 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 09 00:43:22.862839 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 09 00:43:22.862839 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Oct 09 00:43:22.862839 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 483/948] 10.222.0.15 () {56 vars in 1111 bytes} [Sun Oct 9 00:43:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:43:22.866792 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3865e6-d084-4874-9655-b2686edd101d None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:22.979009 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3865e6-d084-4874-9655-b2686edd101d None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:22.986532 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:23.022344 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340511c6-ebcb-4fdf-8bde-545b6f3e4d58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:23.022995 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340511c6-ebcb-4fdf-8bde-545b6f3e4d58 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:23.023289 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340511c6-ebcb-4fdf-8bde-545b6f3e4d58 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:23.023563 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340511c6-ebcb-4fdf-8bde-545b6f3e4d58 None admin] PATH_INFO: `/v3/projects` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:23.024229 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340511c6-ebcb-4fdf-8bde-545b6f3e4d58 None admin] RBAC: Adding query filter params (name=service) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:43:23.024525 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340511c6-ebcb-4fdf-8bde-545b6f3e4d58 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:23.026238 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340511c6-ebcb-4fdf-8bde-545b6f3e4d58 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:23.048326 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 466/949] 10.222.0.15 () {56 vars in 1112 bytes} [Sun Oct 9 00:43:22 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:43:23.882864 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4193a3e5-0ef2-4565-a359-baf144cebf75 None None] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:23.883609 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4193a3e5-0ef2-4565-a359-baf144cebf75 None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:23.883609 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4193a3e5-0ef2-4565-a359-baf144cebf75 None None] PATH_INFO: `/` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:23.885084 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 484/950] 10.222.0.15 () {54 vars in 927 bytes} [Sun Oct 9 00:43:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:43:23.890849 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cf7efd-f05a-4599-8bef-5929f16edd32 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:23.891367 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cf7efd-f05a-4599-8bef-5929f16edd32 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:23.891473 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cf7efd-f05a-4599-8bef-5929f16edd32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:23.914294 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-32cf7efd-f05a-4599-8bef-5929f16edd32 None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:43:23.915961 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-32cf7efd-f05a-4599-8bef-5929f16edd32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:43:23.963327 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af024d76-2bf4-421f-b264-a5e9c43833dc None None] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:23.963645 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af024d76-2bf4-421f-b264-a5e9c43833dc None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:23.963869 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af024d76-2bf4-421f-b264-a5e9c43833dc None None] PATH_INFO: `/` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:23.965466 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 485/951] 10.222.0.15 () {54 vars in 927 bytes} [Sun Oct 9 00:43:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:43:23.970363 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12de7bce-b8a2-4d67-9f9c-75d6b3e73e3e None None] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:23.970642 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12de7bce-b8a2-4d67-9f9c-75d6b3e73e3e None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:23.970918 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12de7bce-b8a2-4d67-9f9c-75d6b3e73e3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:23.991361 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 467/952] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Oct 9 00:43:23 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 09 00:43:23.992344 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.auth.core [None req-12de7bce-b8a2-4d67-9f9c-75d6b3e73e3e None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:43:23.993555 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-12de7bce-b8a2-4d67-9f9c-75d6b3e73e3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:43:24.083269 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 486/953] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Oct 9 00:43:23 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 09 00:43:24.252620 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cf7efd-f05a-4599-8bef-5929f16edd32 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:24.291184 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f076056-bec5-40df-8dc9-ae315a7f418e None None] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:24.291569 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f076056-bec5-40df-8dc9-ae315a7f418e None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:24.291773 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f076056-bec5-40df-8dc9-ae315a7f418e None None] PATH_INFO: `/` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:24.293124 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 487/954] 10.222.0.15 () {54 vars in 927 bytes} [Sun Oct 9 00:43:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 09 00:43:24.298605 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eeca286-1204-4c61-a48b-48a0b993f832 None None] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:24.298880 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eeca286-1204-4c61-a48b-48a0b993f832 None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:24.299152 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eeca286-1204-4c61-a48b-48a0b993f832 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:24.318001 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.auth.core [None req-1eeca286-1204-4c61-a48b-48a0b993f832 None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:43:24.319330 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-1eeca286-1204-4c61-a48b-48a0b993f832 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:43:24.351301 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:24.358286 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cf7efd-f05a-4599-8bef-5929f16edd32 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:24.397140 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11eb1846-086b-494c-b92f-ca9d5d8ac0d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:24.397824 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11eb1846-086b-494c-b92f-ca9d5d8ac0d7 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:24.398124 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11eb1846-086b-494c-b92f-ca9d5d8ac0d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:24.398483 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11eb1846-086b-494c-b92f-ca9d5d8ac0d7 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:24.399079 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11eb1846-086b-494c-b92f-ca9d5d8ac0d7 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:24.400514 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11eb1846-086b-494c-b92f-ca9d5d8ac0d7 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:24.416921 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application [None req-11eb1846-086b-494c-b92f-ca9d5d8ac0d7 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 09 00:43:24.416921 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:43:24.416921 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 09 00:43:24.416921 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 09 00:43:24.416921 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 09 00:43:24.416921 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 09 00:43:24.416921 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 09 00:43:24.416921 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 09 00:43:24.416921 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 09 00:43:24.416921 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application Oct 09 00:43:24.416921 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 09 00:43:24.416921 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application Oct 09 00:43:24.416921 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:43:24.416921 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:43:24.416921 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:43:24.416921 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:43:24.416921 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:43:24.418304 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:43:24.418304 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:43:24.418304 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:43:24.418304 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:43:24.418304 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:43:24.418304 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:43:24.418304 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 09 00:43:24.418304 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 09 00:43:24.418304 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 09 00:43:24.418304 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 09 00:43:24.418304 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:43:24.418304 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:43:24.418304 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:43:24.418304 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:43:24.418304 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:43:24.418304 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:43:24.419444 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:43:24.419444 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application with Lock( Oct 09 00:43:24.419444 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:43:24.419444 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:43:24.419444 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:43:24.419444 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:43:24.419444 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:43:24.419444 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:43:24.419444 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:43:24.419444 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:43:24.419444 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 09 00:43:24.419444 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 09 00:43:24.419444 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 09 00:43:24.419444 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application Oct 09 00:43:24.419444 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 468/955] 10.222.0.15 () {56 vars in 1111 bytes} [Sun Oct 9 00:43:24 2022] GET /identity/v3/services/compute => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:43:24.420436 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 488/956] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Oct 9 00:43:24 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 09 00:43:24.424636 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11eb1846-086b-494c-b92f-ca9d5d8ac0d7 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:24.534529 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11eb1846-086b-494c-b92f-ca9d5d8ac0d7 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:24.568603 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a63db4-f032-4bac-869f-c824d6bd1c27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:24.569268 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a63db4-f032-4bac-869f-c824d6bd1c27 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:24.569546 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a63db4-f032-4bac-869f-c824d6bd1c27 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:24.569660 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eeca286-1204-4c61-a48b-48a0b993f832 None None] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:24.569840 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a63db4-f032-4bac-869f-c824d6bd1c27 None admin] PATH_INFO: `/v3/services` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:24.570451 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a63db4-f032-4bac-869f-c824d6bd1c27 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:43:24.570754 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a63db4-f032-4bac-869f-c824d6bd1c27 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:24.572161 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a63db4-f032-4bac-869f-c824d6bd1c27 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:24.582760 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 469/957] 10.222.0.15 () {56 vars in 1112 bytes} [Sun Oct 9 00:43:24 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:43:24.588268 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a63db4-f032-4bac-869f-c824d6bd1c27 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:24.608436 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:24.622188 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:24.696951 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eeca286-1204-4c61-a48b-48a0b993f832 None None] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:24.705131 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a63db4-f032-4bac-869f-c824d6bd1c27 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:24.736984 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e1ce7e-4a64-478b-b0ef-09b328479bac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:24.737735 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e1ce7e-4a64-478b-b0ef-09b328479bac None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:24.738087 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e1ce7e-4a64-478b-b0ef-09b328479bac None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:24.738435 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e1ce7e-4a64-478b-b0ef-09b328479bac None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:24.741578 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd422b0-dc9c-41fe-b638-6fd5d69a1984 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:24.742198 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd422b0-dc9c-41fe-b638-6fd5d69a1984 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:24.742484 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd422b0-dc9c-41fe-b638-6fd5d69a1984 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:24.742758 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd422b0-dc9c-41fe-b638-6fd5d69a1984 None admin] PATH_INFO: `/v3/services` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:24.743437 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd422b0-dc9c-41fe-b638-6fd5d69a1984 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:43:24.743781 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd422b0-dc9c-41fe-b638-6fd5d69a1984 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:24.745110 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd422b0-dc9c-41fe-b638-6fd5d69a1984 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:24.749862 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e1ce7e-4a64-478b-b0ef-09b328479bac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 09 00:43:24.750377 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 470/958] 10.222.0.15 () {56 vars in 1112 bytes} [Sun Oct 9 00:43:24 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:43:24.751020 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd422b0-dc9c-41fe-b638-6fd5d69a1984 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:24.760375 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application [None req-91e1ce7e-4a64-478b-b0ef-09b328479bac None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 09 00:43:24.760375 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:43:24.760375 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:43:24.760375 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:43:24.760375 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:43:24.760375 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:43:24.760375 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:43:24.760375 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:43:24.760375 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:43:24.760375 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:43:24.760375 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:43:24.760375 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:43:24.760375 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 09 00:43:24.760375 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 09 00:43:24.760375 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 09 00:43:24.760375 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 09 00:43:24.761422 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 09 00:43:24.761422 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 09 00:43:24.761422 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 09 00:43:24.761422 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 09 00:43:24.761422 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:43:24.761422 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:43:24.761422 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:43:24.761422 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:43:24.761422 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:43:24.761422 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:43:24.761422 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:43:24.761422 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application with Lock( Oct 09 00:43:24.761422 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:43:24.761422 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:43:24.761422 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:43:24.761422 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:43:24.767514 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:43:24.767514 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:43:24.767514 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:43:24.767514 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:43:24.767514 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 09 00:43:24.767514 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 09 00:43:24.767514 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 09 00:43:24.767514 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 09 00:43:24.767514 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 09 00:43:24.767514 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 09 00:43:24.767514 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 09 00:43:24.767514 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Oct 09 00:43:24.767514 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 489/959] 10.222.0.15 () {56 vars in 1120 bytes} [Sun Oct 9 00:43:24 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 09 00:43:24.768245 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e1ce7e-4a64-478b-b0ef-09b328479bac None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:24.865319 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:24.875591 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:24.879006 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd422b0-dc9c-41fe-b638-6fd5d69a1984 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:24.891735 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e1ce7e-4a64-478b-b0ef-09b328479bac None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:24.918219 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62459ff7-bb45-4b2c-bb81-5d32a87d21c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:24.919050 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62459ff7-bb45-4b2c-bb81-5d32a87d21c7 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:24.919370 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62459ff7-bb45-4b2c-bb81-5d32a87d21c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:24.919693 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62459ff7-bb45-4b2c-bb81-5d32a87d21c7 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:24.920300 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62459ff7-bb45-4b2c-bb81-5d32a87d21c7 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:24.921791 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62459ff7-bb45-4b2c-bb81-5d32a87d21c7 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:24.932129 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application [None req-62459ff7-bb45-4b2c-bb81-5d32a87d21c7 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 09 00:43:24.932129 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:43:24.932129 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 09 00:43:24.932129 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 09 00:43:24.932129 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 09 00:43:24.932129 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 09 00:43:24.932129 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 09 00:43:24.932129 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 09 00:43:24.932129 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 09 00:43:24.932129 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application Oct 09 00:43:24.932129 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 09 00:43:24.932129 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application Oct 09 00:43:24.932129 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:43:24.932129 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:43:24.932129 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:43:24.932129 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:43:24.932129 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:43:24.933237 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:43:24.933237 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:43:24.933237 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:43:24.933237 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:43:24.933237 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:43:24.933237 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:43:24.933237 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 09 00:43:24.933237 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 09 00:43:24.933237 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 09 00:43:24.933237 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 09 00:43:24.933237 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:43:24.933237 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:43:24.933237 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:43:24.933237 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:43:24.933237 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:43:24.933237 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:43:24.934074 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:43:24.934074 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application with Lock( Oct 09 00:43:24.934074 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:43:24.934074 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:43:24.934074 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:43:24.934074 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:43:24.934074 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:43:24.934074 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:43:24.934074 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:43:24.934074 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:43:24.934074 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 09 00:43:24.934074 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 09 00:43:24.934074 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 09 00:43:24.934074 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application Oct 09 00:43:24.934074 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 471/960] 10.222.0.15 () {56 vars in 1126 bytes} [Sun Oct 9 00:43:24 2022] GET /identity/v3/services/object-store => generated 93 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:43:24.939515 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62459ff7-bb45-4b2c-bb81-5d32a87d21c7 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:24.942580 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3b2e65-81fb-4f19-b773-5201b5f274cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:24.942956 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3b2e65-81fb-4f19-b773-5201b5f274cc None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:24.943172 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3b2e65-81fb-4f19-b773-5201b5f274cc None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:24.945478 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3b2e65-81fb-4f19-b773-5201b5f274cc None admin] PATH_INFO: `/v3/roles` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:24.945478 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3b2e65-81fb-4f19-b773-5201b5f274cc None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:43:24.945478 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3b2e65-81fb-4f19-b773-5201b5f274cc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:24.946614 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3b2e65-81fb-4f19-b773-5201b5f274cc None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:24.956658 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 490/961] 10.222.0.15 () {56 vars in 1115 bytes} [Sun Oct 9 00:43:24 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:43:24.962432 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3b2e65-81fb-4f19-b773-5201b5f274cc None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:25.053387 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62459ff7-bb45-4b2c-bb81-5d32a87d21c7 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:25.093407 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc0aea8-7b1f-4e56-a3ac-57880d8aaede None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:25.094051 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc0aea8-7b1f-4e56-a3ac-57880d8aaede None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:25.094338 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc0aea8-7b1f-4e56-a3ac-57880d8aaede None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:25.094790 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc0aea8-7b1f-4e56-a3ac-57880d8aaede None admin] PATH_INFO: `/v3/services` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:25.095224 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc0aea8-7b1f-4e56-a3ac-57880d8aaede None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:43:25.095563 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc0aea8-7b1f-4e56-a3ac-57880d8aaede None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:25.096945 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc0aea8-7b1f-4e56-a3ac-57880d8aaede None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:25.099050 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3b2e65-81fb-4f19-b773-5201b5f274cc None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:25.108124 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 472/962] 10.222.0.15 () {56 vars in 1122 bytes} [Sun Oct 9 00:43:24 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 09 00:43:25.109818 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc0aea8-7b1f-4e56-a3ac-57880d8aaede None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:25.133103 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:25.150401 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b918a1cc-59b8-45c7-82bd-92e49204168d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:25.151436 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b918a1cc-59b8-45c7-82bd-92e49204168d None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:25.151858 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b918a1cc-59b8-45c7-82bd-92e49204168d None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:25.152300 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b918a1cc-59b8-45c7-82bd-92e49204168d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:25.166679 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b918a1cc-59b8-45c7-82bd-92e49204168d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:25.169137 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b918a1cc-59b8-45c7-82bd-92e49204168d None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:25.189770 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application [None req-b918a1cc-59b8-45c7-82bd-92e49204168d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:43:25.189770 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:43:25.189770 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:43:25.189770 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:43:25.189770 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:43:25.189770 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:43:25.189770 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:43:25.189770 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:43:25.189770 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:43:25.189770 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:43:25.189770 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:43:25.189770 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:43:25.189770 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 09 00:43:25.189770 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 09 00:43:25.189770 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 09 00:43:25.189770 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 09 00:43:25.191004 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:43:25.191004 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:43:25.191004 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:43:25.191004 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:43:25.191004 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:43:25.191004 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:43:25.191004 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:43:25.191004 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application with Lock( Oct 09 00:43:25.191004 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:43:25.191004 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:43:25.191004 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:43:25.191004 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:43:25.191004 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:43:25.191004 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:43:25.191004 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:43:25.191004 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:43:25.191004 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 09 00:43:25.192154 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 09 00:43:25.192154 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:43:25.192154 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Oct 09 00:43:25.194313 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 491/963] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Oct 9 00:43:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 09 00:43:25.201297 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b918a1cc-59b8-45c7-82bd-92e49204168d None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:25.204511 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:25.236820 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc0aea8-7b1f-4e56-a3ac-57880d8aaede None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:25.287764 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018e6c0e-d04b-41ae-a6ae-fd3f20b823da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:25.288538 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018e6c0e-d04b-41ae-a6ae-fd3f20b823da None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:25.288876 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018e6c0e-d04b-41ae-a6ae-fd3f20b823da None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:25.289595 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018e6c0e-d04b-41ae-a6ae-fd3f20b823da None admin] PATH_INFO: `/v3/services` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:25.290570 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018e6c0e-d04b-41ae-a6ae-fd3f20b823da None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:43:25.290942 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018e6c0e-d04b-41ae-a6ae-fd3f20b823da None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:25.292603 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018e6c0e-d04b-41ae-a6ae-fd3f20b823da None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:25.305605 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 473/964] 10.222.0.15 () {56 vars in 1122 bytes} [Sun Oct 9 00:43:25 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 09 00:43:25.307090 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018e6c0e-d04b-41ae-a6ae-fd3f20b823da None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:25.335764 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b918a1cc-59b8-45c7-82bd-92e49204168d None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:25.377652 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e922bc4c-f293-4dae-9d21-cf1505ff954d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:25.378261 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e922bc4c-f293-4dae-9d21-cf1505ff954d None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:25.378533 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e922bc4c-f293-4dae-9d21-cf1505ff954d None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:25.378797 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e922bc4c-f293-4dae-9d21-cf1505ff954d None admin] PATH_INFO: `/v3/domains` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:25.379465 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e922bc4c-f293-4dae-9d21-cf1505ff954d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:43:25.379762 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e922bc4c-f293-4dae-9d21-cf1505ff954d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:25.381136 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e922bc4c-f293-4dae-9d21-cf1505ff954d None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:25.395417 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 492/965] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Oct 9 00:43:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:43:25.396698 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706504bd-ca5f-46cc-a63b-bef31d817ea9 None None] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:25.396984 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706504bd-ca5f-46cc-a63b-bef31d817ea9 None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:25.397316 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706504bd-ca5f-46cc-a63b-bef31d817ea9 None None] PATH_INFO: `/` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:25.398667 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 493/966] 10.222.0.15 () {54 vars in 927 bytes} [Sun Oct 9 00:43:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:43:25.403523 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706504bd-ca5f-46cc-a63b-bef31d817ea9 None None] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:25.410383 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:25.431175 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018e6c0e-d04b-41ae-a6ae-fd3f20b823da None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:25.467854 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99161859-2c6a-4124-ad29-c8458d577e20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:25.468466 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99161859-2c6a-4124-ad29-c8458d577e20 None admin] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:25.468739 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99161859-2c6a-4124-ad29-c8458d577e20 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:25.469006 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99161859-2c6a-4124-ad29-c8458d577e20 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:25.469670 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99161859-2c6a-4124-ad29-c8458d577e20 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:25.471046 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99161859-2c6a-4124-ad29-c8458d577e20 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:25.478978 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:25.503287 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 474/967] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Oct 9 00:43:25 2022] POST /identity/v3/endpoints => generated 349 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 09 00:43:25.503287 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904cb02a-b39a-43e8-b9ed-c06e4be5b0d1 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:25.503287 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904cb02a-b39a-43e8-b9ed-c06e4be5b0d1 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:25.503287 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904cb02a-b39a-43e8-b9ed-c06e4be5b0d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:25.523677 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-904cb02a-b39a-43e8-b9ed-c06e4be5b0d1 None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:43:25.525944 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-904cb02a-b39a-43e8-b9ed-c06e4be5b0d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:43:25.542142 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706504bd-ca5f-46cc-a63b-bef31d817ea9 None None] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:25.582280 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b1e343-120d-4d64-b36e-ca769d6ccb1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:25.583488 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b1e343-120d-4d64-b36e-ca769d6ccb1f None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:25.583488 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b1e343-120d-4d64-b36e-ca769d6ccb1f None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:25.583488 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b1e343-120d-4d64-b36e-ca769d6ccb1f None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:25.592203 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b1e343-120d-4d64-b36e-ca769d6ccb1f None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:25.593702 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b1e343-120d-4d64-b36e-ca769d6ccb1f None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:25.607717 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application [None req-00b1e343-120d-4d64-b36e-ca769d6ccb1f None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 09 00:43:25.607717 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:43:25.607717 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:43:25.607717 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:43:25.607717 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:43:25.607717 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:43:25.607717 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:43:25.607717 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:43:25.607717 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:43:25.607717 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:43:25.607717 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:43:25.607717 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:43:25.607717 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 09 00:43:25.607717 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 09 00:43:25.607717 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 09 00:43:25.607717 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 09 00:43:25.608798 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:43:25.608798 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:43:25.608798 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 09 00:43:25.608798 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 09 00:43:25.608798 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 09 00:43:25.608798 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 09 00:43:25.608798 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:43:25.608798 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:43:25.608798 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:43:25.608798 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:43:25.608798 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:43:25.608798 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application with Lock( Oct 09 00:43:25.608798 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:43:25.608798 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:43:25.608798 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:43:25.608798 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:43:25.608798 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:43:25.608798 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:43:25.609833 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:43:25.609833 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:43:25.609833 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 09 00:43:25.609833 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 09 00:43:25.609833 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 09 00:43:25.609833 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 09 00:43:25.609833 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 09 00:43:25.609833 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 09 00:43:25.609833 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 09 00:43:25.609833 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Oct 09 00:43:25.609833 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 494/968] 10.222.0.15 () {56 vars in 1117 bytes} [Sun Oct 9 00:43:25 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:43:25.615323 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b1e343-120d-4d64-b36e-ca769d6ccb1f None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:25.625979 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 475/969] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Oct 9 00:43:25 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 09 00:43:25.733641 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b1e343-120d-4d64-b36e-ca769d6ccb1f None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:25.751626 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:25.769545 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea879bb9-e1a4-4936-85f1-5f875d4426a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:25.770216 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea879bb9-e1a4-4936-85f1-5f875d4426a4 None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:25.770492 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea879bb9-e1a4-4936-85f1-5f875d4426a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:25.770859 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea879bb9-e1a4-4936-85f1-5f875d4426a4 None admin] PATH_INFO: `/v3/users` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:25.771624 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea879bb9-e1a4-4936-85f1-5f875d4426a4 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:43:25.771926 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea879bb9-e1a4-4936-85f1-5f875d4426a4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:25.773393 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea879bb9-e1a4-4936-85f1-5f875d4426a4 None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:25.792178 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 495/970] 10.222.0.15 () {56 vars in 1149 bytes} [Sun Oct 9 00:43:25 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:43:25.797964 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904cb02a-b39a-43e8-b9ed-c06e4be5b0d1 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:25.864930 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:25.907010 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904cb02a-b39a-43e8-b9ed-c06e4be5b0d1 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:25.908224 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea879bb9-e1a4-4936-85f1-5f875d4426a4 None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:25.944928 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a2fb22-df9b-4740-bccc-4d77bb2e1985 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:25.946298 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a2fb22-df9b-4740-bccc-4d77bb2e1985 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:25.946861 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a2fb22-df9b-4740-bccc-4d77bb2e1985 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:25.947395 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a2fb22-df9b-4740-bccc-4d77bb2e1985 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:26.019298 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a2fb22-df9b-4740-bccc-4d77bb2e1985 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:26.021111 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a2fb22-df9b-4740-bccc-4d77bb2e1985 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:26.038326 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea879bb9-e1a4-4936-85f1-5f875d4426a4 None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:26.076172 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db48a81-4683-4d3f-ba34-e86bb7759166 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:26.077242 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db48a81-4683-4d3f-ba34-e86bb7759166 None admin] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:26.077720 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db48a81-4683-4d3f-ba34-e86bb7759166 None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:26.078200 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db48a81-4683-4d3f-ba34-e86bb7759166 None admin] PATH_INFO: `/v3/users` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:26.079071 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db48a81-4683-4d3f-ba34-e86bb7759166 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:26.081098 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db48a81-4683-4d3f-ba34-e86bb7759166 None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:26.084495 dv-cinder-master-3-smb devstack@keystone.service[81525]: WARNING keystone.server.flask.common [None req-2db48a81-4683-4d3f-ba34-e86bb7759166 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Oct 09 00:43:26.097161 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:26.101023 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.sql.core [None req-2db48a81-4683-4d3f-ba34-e86bb7759166 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Oct 09 00:43:26.101023 dv-cinder-master-3-smb devstack@keystone.service[81525]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Oct 09 00:43:26.101023 dv-cinder-master-3-smb devstack@keystone.service[81525]: [parameters: {'user_id': 'cd423e349dcb4ac48a105886e9c76d41', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Oct 09 00:43:26.101023 dv-cinder-master-3-smb devstack@keystone.service[81525]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81525) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 09 00:43:26.110899 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application [None req-2db48a81-4683-4d3f-ba34-e86bb7759166 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Oct 09 00:43:26.110899 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:43:26.110899 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 09 00:43:26.110899 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 09 00:43:26.110899 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 09 00:43:26.110899 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 09 00:43:26.110899 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 09 00:43:26.110899 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application result = self._query(query) Oct 09 00:43:26.110899 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 09 00:43:26.110899 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application conn.query(q) Oct 09 00:43:26.110899 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 09 00:43:26.110899 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 09 00:43:26.110899 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 09 00:43:26.110899 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application result.read() Oct 09 00:43:26.110899 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 09 00:43:26.112319 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 09 00:43:26.112319 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 09 00:43:26.112319 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 09 00:43:26.112319 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 09 00:43:26.112319 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 09 00:43:26.112319 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 09 00:43:26.112319 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 09 00:43:26.112319 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Oct 09 00:43:26.112319 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Oct 09 00:43:26.112319 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 09 00:43:26.112319 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Oct 09 00:43:26.112319 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:43:26.112319 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 09 00:43:26.112319 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 09 00:43:26.112319 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Oct 09 00:43:26.112319 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Oct 09 00:43:26.112319 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 09 00:43:26.112319 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application next(self.gen) Oct 09 00:43:26.113695 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Oct 09 00:43:26.113695 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application yield resource Oct 09 00:43:26.113695 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 09 00:43:26.113695 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application next(self.gen) Oct 09 00:43:26.113695 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Oct 09 00:43:26.113695 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application self.session.rollback() Oct 09 00:43:26.113695 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 09 00:43:26.113695 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application self.force_reraise() Oct 09 00:43:26.113695 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 09 00:43:26.113695 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application raise self.value Oct 09 00:43:26.113695 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Oct 09 00:43:26.113695 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 09 00:43:26.113695 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Oct 09 00:43:26.113695 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application session.commit() Oct 09 00:43:26.113695 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 09 00:43:26.113695 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 09 00:43:26.113695 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 09 00:43:26.114645 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application self._prepare_impl() Oct 09 00:43:26.114645 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 09 00:43:26.114645 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application self.session.flush() Oct 09 00:43:26.114645 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 09 00:43:26.114645 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application self._flush(objects) Oct 09 00:43:26.114645 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 09 00:43:26.114645 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 09 00:43:26.114645 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 09 00:43:26.114645 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application compat.raise_( Oct 09 00:43:26.114645 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 09 00:43:26.114645 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application raise exception Oct 09 00:43:26.114645 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 09 00:43:26.114645 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application flush_context.execute() Oct 09 00:43:26.114645 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 09 00:43:26.114645 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application rec.execute(self) Oct 09 00:43:26.114645 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 09 00:43:26.114645 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 09 00:43:26.116649 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 09 00:43:26.116649 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 09 00:43:26.116649 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Oct 09 00:43:26.116649 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application result = connection._execute_20( Oct 09 00:43:26.116649 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 09 00:43:26.116649 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 09 00:43:26.116649 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 09 00:43:26.116649 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 09 00:43:26.116649 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 09 00:43:26.116649 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 09 00:43:26.116649 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 09 00:43:26.116649 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 09 00:43:26.116649 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 09 00:43:26.116649 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 09 00:43:26.116649 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 09 00:43:26.116649 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application raise exception Oct 09 00:43:26.118736 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 09 00:43:26.118736 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 09 00:43:26.118736 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 09 00:43:26.118736 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 09 00:43:26.118736 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 09 00:43:26.118736 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application result = self._query(query) Oct 09 00:43:26.118736 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 09 00:43:26.118736 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application conn.query(q) Oct 09 00:43:26.118736 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 09 00:43:26.118736 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 09 00:43:26.118736 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 09 00:43:26.118736 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application result.read() Oct 09 00:43:26.118736 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 09 00:43:26.118736 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 09 00:43:26.118736 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 09 00:43:26.118736 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 09 00:43:26.120888 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 09 00:43:26.120888 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 09 00:43:26.120888 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 09 00:43:26.120888 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 09 00:43:26.120888 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Oct 09 00:43:26.120888 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Oct 09 00:43:26.120888 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application [parameters: {'user_id': 'cd423e349dcb4ac48a105886e9c76d41', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Oct 09 00:43:26.120888 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 09 00:43:26.120888 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Oct 09 00:43:26.120888 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 09 00:43:26.120888 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Oct 09 00:43:26.120888 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:43:26.120888 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:43:26.120888 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:43:26.120888 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:43:26.123357 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:43:26.123357 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:43:26.123357 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:43:26.123357 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:43:26.123357 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:43:26.123357 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:43:26.123357 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:43:26.123357 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Oct 09 00:43:26.123357 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Oct 09 00:43:26.123357 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:43:26.123357 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:43:26.123357 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 09 00:43:26.123357 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 09 00:43:26.123357 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 09 00:43:26.123357 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 09 00:43:26.123357 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Oct 09 00:43:26.123357 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Oct 09 00:43:26.125611 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Oct 09 00:43:26.125611 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Oct 09 00:43:26.125611 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 09 00:43:26.125611 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 09 00:43:26.125611 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Oct 09 00:43:26.125611 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Oct 09 00:43:26.134189 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 496/971] 10.222.0.15 () {60 vars in 1131 bytes} [Sun Oct 9 00:43:25 2022] POST /identity/v3/users => generated 160 bytes in 226 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:43:26.135060 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db48a81-4683-4d3f-ba34-e86bb7759166 None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:26.135613 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 476/972] 10.222.0.15 () {58 vars in 1282 bytes} [Sun Oct 9 00:43:25 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 09 00:43:26.141321 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a2fb22-df9b-4740-bccc-4d77bb2e1985 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:26.180562 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:26.249667 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db48a81-4683-4d3f-ba34-e86bb7759166 None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:26.256895 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a2fb22-df9b-4740-bccc-4d77bb2e1985 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:26.287353 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b81daa2-fd4c-482a-8c02-263a393ea77f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:26.288527 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b81daa2-fd4c-482a-8c02-263a393ea77f None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:26.289076 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b81daa2-fd4c-482a-8c02-263a393ea77f None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:26.289642 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b81daa2-fd4c-482a-8c02-263a393ea77f None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:26.294703 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d670a7-3d7b-4659-936a-9e9e0bfefefb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:26.295371 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d670a7-3d7b-4659-936a-9e9e0bfefefb None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:26.295646 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d670a7-3d7b-4659-936a-9e9e0bfefefb None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:26.295912 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d670a7-3d7b-4659-936a-9e9e0bfefefb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:26.298921 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b81daa2-fd4c-482a-8c02-263a393ea77f None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:26.300846 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b81daa2-fd4c-482a-8c02-263a393ea77f None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:26.307152 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d670a7-3d7b-4659-936a-9e9e0bfefefb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:26.308623 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d670a7-3d7b-4659-936a-9e9e0bfefefb None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:26.315834 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application [None req-7b81daa2-fd4c-482a-8c02-263a393ea77f None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 09 00:43:26.315834 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:43:26.315834 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:43:26.315834 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:43:26.315834 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:43:26.315834 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:43:26.315834 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:43:26.315834 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:43:26.315834 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:43:26.315834 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:43:26.315834 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:43:26.315834 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:43:26.315834 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 09 00:43:26.315834 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 09 00:43:26.315834 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 09 00:43:26.315834 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 09 00:43:26.316856 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:43:26.316856 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:43:26.316856 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 09 00:43:26.316856 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 09 00:43:26.316856 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 09 00:43:26.316856 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 09 00:43:26.316856 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:43:26.316856 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:43:26.316856 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:43:26.316856 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:43:26.316856 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:43:26.316856 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application with Lock( Oct 09 00:43:26.316856 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:43:26.316856 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:43:26.316856 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:43:26.316856 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:43:26.316856 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:43:26.316856 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:43:26.317839 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:43:26.317839 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:43:26.317839 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 09 00:43:26.317839 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 09 00:43:26.317839 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 09 00:43:26.317839 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 09 00:43:26.317839 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 09 00:43:26.317839 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 09 00:43:26.317839 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 09 00:43:26.317839 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Oct 09 00:43:26.324838 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application [None req-e1d670a7-3d7b-4659-936a-9e9e0bfefefb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:43:26.324838 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:43:26.324838 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:43:26.324838 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:43:26.324838 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:43:26.324838 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:43:26.324838 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:43:26.324838 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:43:26.324838 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:43:26.324838 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:43:26.324838 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:43:26.324838 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:43:26.324838 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 09 00:43:26.324838 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 09 00:43:26.324838 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 09 00:43:26.324838 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 09 00:43:26.325832 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:43:26.325832 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:43:26.325832 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:43:26.325832 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:43:26.325832 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:43:26.325832 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:43:26.325832 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:43:26.325832 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application with Lock( Oct 09 00:43:26.325832 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:43:26.325832 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:43:26.325832 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:43:26.325832 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:43:26.325832 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:43:26.325832 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:43:26.325832 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:43:26.325832 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:43:26.325832 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 09 00:43:26.326743 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 09 00:43:26.326743 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:43:26.326743 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application Oct 09 00:43:26.326743 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 477/973] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Oct 9 00:43:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:43:26.326743 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d670a7-3d7b-4659-936a-9e9e0bfefefb None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:26.327657 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 497/974] 10.222.0.15 () {56 vars in 1099 bytes} [Sun Oct 9 00:43:26 2022] GET /identity/v3/users/cinder => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:43:26.331125 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b81daa2-fd4c-482a-8c02-263a393ea77f None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:26.347718 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:26.445567 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:26.447216 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d670a7-3d7b-4659-936a-9e9e0bfefefb None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:26.451435 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b81daa2-fd4c-482a-8c02-263a393ea77f None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:26.488567 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f50c0b-833a-4768-bac3-122d592c5257 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:26.489288 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f50c0b-833a-4768-bac3-122d592c5257 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:26.489568 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f50c0b-833a-4768-bac3-122d592c5257 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:26.489838 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f50c0b-833a-4768-bac3-122d592c5257 None admin] PATH_INFO: `/v3/users` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:26.490546 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f50c0b-833a-4768-bac3-122d592c5257 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:43:26.490845 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f50c0b-833a-4768-bac3-122d592c5257 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:26.492018 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a926a60-274f-41bf-8fd6-1a2cb9f73d04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:26.492417 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f50c0b-833a-4768-bac3-122d592c5257 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:26.493112 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a926a60-274f-41bf-8fd6-1a2cb9f73d04 None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:26.493601 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a926a60-274f-41bf-8fd6-1a2cb9f73d04 None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:26.494173 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a926a60-274f-41bf-8fd6-1a2cb9f73d04 None admin] PATH_INFO: `/v3/domains` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:26.495043 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a926a60-274f-41bf-8fd6-1a2cb9f73d04 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:43:26.495594 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a926a60-274f-41bf-8fd6-1a2cb9f73d04 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:26.497230 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a926a60-274f-41bf-8fd6-1a2cb9f73d04 None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:26.515662 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 498/975] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Oct 9 00:43:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:43:26.525130 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a926a60-274f-41bf-8fd6-1a2cb9f73d04 None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:26.538112 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 478/976] 10.222.0.15 () {56 vars in 1101 bytes} [Sun Oct 9 00:43:26 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:43:26.648427 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a926a60-274f-41bf-8fd6-1a2cb9f73d04 None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:26.688157 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43949af5-8fa9-4351-96b8-68cc5982f3a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:26.689253 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43949af5-8fa9-4351-96b8-68cc5982f3a2 None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:26.689732 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43949af5-8fa9-4351-96b8-68cc5982f3a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:26.690221 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43949af5-8fa9-4351-96b8-68cc5982f3a2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:26.698841 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43949af5-8fa9-4351-96b8-68cc5982f3a2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:26.700747 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43949af5-8fa9-4351-96b8-68cc5982f3a2 None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:26.714726 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application [None req-43949af5-8fa9-4351-96b8-68cc5982f3a2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 09 00:43:26.714726 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:43:26.714726 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:43:26.714726 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:43:26.714726 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:43:26.714726 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:43:26.714726 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:43:26.714726 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:43:26.714726 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:43:26.714726 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:43:26.714726 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:43:26.714726 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:43:26.714726 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 09 00:43:26.714726 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 09 00:43:26.714726 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 09 00:43:26.715771 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 09 00:43:26.715771 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:43:26.715771 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:43:26.715771 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:43:26.715771 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:43:26.715771 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:43:26.715771 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:43:26.715771 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:43:26.715771 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application with Lock( Oct 09 00:43:26.715771 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:43:26.715771 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:43:26.715771 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:43:26.715771 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:43:26.715771 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:43:26.715771 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:43:26.715771 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:43:26.715771 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:43:26.716667 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 09 00:43:26.716667 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 09 00:43:26.716667 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 09 00:43:26.716667 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 09 00:43:26.716667 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 09 00:43:26.716667 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 09 00:43:26.716667 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 09 00:43:26.716667 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Oct 09 00:43:26.719334 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 499/977] 10.222.0.15 () {56 vars in 1111 bytes} [Sun Oct 9 00:43:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 09 00:43:26.727714 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f50c0b-833a-4768-bac3-122d592c5257 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:26.812937 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:26.844181 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f50c0b-833a-4768-bac3-122d592c5257 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:26.887636 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf39d951-4a5e-45e3-83e1-2f02241bd9cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:26.888665 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf39d951-4a5e-45e3-83e1-2f02241bd9cc None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:26.889138 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf39d951-4a5e-45e3-83e1-2f02241bd9cc None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:26.889642 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf39d951-4a5e-45e3-83e1-2f02241bd9cc None admin] PATH_INFO: `/v3/projects` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:26.890637 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf39d951-4a5e-45e3-83e1-2f02241bd9cc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:43:26.890944 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf39d951-4a5e-45e3-83e1-2f02241bd9cc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:26.892425 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf39d951-4a5e-45e3-83e1-2f02241bd9cc None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:26.906959 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 479/978] 10.222.0.15 () {56 vars in 1148 bytes} [Sun Oct 9 00:43:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:43:26.913374 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43949af5-8fa9-4351-96b8-68cc5982f3a2 None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:26.933556 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:26.969713 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b05c868-a509-4e2c-8d24-25e6b03a6345 None None] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:26.970260 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b05c868-a509-4e2c-8d24-25e6b03a6345 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:26.970260 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b05c868-a509-4e2c-8d24-25e6b03a6345 None None] PATH_INFO: `/` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:26.971827 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 480/979] 10.222.0.15 () {54 vars in 927 bytes} [Sun Oct 9 00:43:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 09 00:43:26.976979 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf79c63-b9ad-4350-aa07-d650acab3b5c None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:26.977234 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf79c63-b9ad-4350-aa07-d650acab3b5c None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:26.977502 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf79c63-b9ad-4350-aa07-d650acab3b5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:26.995890 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-aaf79c63-b9ad-4350-aa07-d650acab3b5c None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:43:26.997085 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-aaf79c63-b9ad-4350-aa07-d650acab3b5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:43:27.019763 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43949af5-8fa9-4351-96b8-68cc5982f3a2 None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:27.055449 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981a7e46-6873-4f41-98f9-9bf3e9bb5f37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:27.056063 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981a7e46-6873-4f41-98f9-9bf3e9bb5f37 None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:27.056330 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981a7e46-6873-4f41-98f9-9bf3e9bb5f37 None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:27.056603 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981a7e46-6873-4f41-98f9-9bf3e9bb5f37 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:27.057366 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981a7e46-6873-4f41-98f9-9bf3e9bb5f37 None admin] RBAC: Adding query filter params (role.id=0a44a4718e6a4dd48874221bee2f6b20, scope.project.id=f148d39ced534860abfbe8fc3f98ace4, user.id=3a6cfef106c84f759ce0874be77f7380) {{(pid=81525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:43:27.057667 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981a7e46-6873-4f41-98f9-9bf3e9bb5f37 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:27.059229 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981a7e46-6873-4f41-98f9-9bf3e9bb5f37 None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:27.075389 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 500/980] 10.222.0.15 () {56 vars in 1374 bytes} [Sun Oct 9 00:43:26 2022] GET /identity/v3/role_assignments?user.id=3a6cfef106c84f759ce0874be77f7380&scope.project.id=f148d39ced534860abfbe8fc3f98ace4&role.id=0a44a4718e6a4dd48874221bee2f6b20 => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 09 00:43:27.075594 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 481/981] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Oct 9 00:43:26 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 09 00:43:27.327375 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981a7e46-6873-4f41-98f9-9bf3e9bb5f37 None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:27.412165 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:27.433124 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981a7e46-6873-4f41-98f9-9bf3e9bb5f37 None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:27.476673 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3c3f59-0438-4c0d-8b4c-12c1bc8570a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:27.477287 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3c3f59-0438-4c0d-8b4c-12c1bc8570a0 None admin] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:27.477559 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3c3f59-0438-4c0d-8b4c-12c1bc8570a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:27.477829 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3c3f59-0438-4c0d-8b4c-12c1bc8570a0 None admin] PATH_INFO: `/v3/services` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:27.478489 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3c3f59-0438-4c0d-8b4c-12c1bc8570a0 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:27.479905 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3c3f59-0438-4c0d-8b4c-12c1bc8570a0 None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:27.496559 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 501/982] 10.222.0.15 () {60 vars in 1141 bytes} [Sun Oct 9 00:43:27 2022] POST /identity/v3/services => generated 242 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 09 00:43:27.786012 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9301e928-cdbf-47dd-983f-d089c4bd046e None None] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:27.786289 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9301e928-cdbf-47dd-983f-d089c4bd046e None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:27.786563 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9301e928-cdbf-47dd-983f-d089c4bd046e None None] PATH_INFO: `/` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:27.787995 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 482/983] 10.222.0.15 () {54 vars in 927 bytes} [Sun Oct 9 00:43:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:43:27.794163 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c80dba8-5338-4c64-b223-7a1765c5186f None None] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:27.794447 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c80dba8-5338-4c64-b223-7a1765c5186f None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:27.794715 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c80dba8-5338-4c64-b223-7a1765c5186f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:27.814162 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.auth.core [None req-1c80dba8-5338-4c64-b223-7a1765c5186f None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:43:27.815744 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-1c80dba8-5338-4c64-b223-7a1765c5186f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:43:27.896485 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 502/984] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Oct 9 00:43:27 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 09 00:43:28.161807 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9301e928-cdbf-47dd-983f-d089c4bd046e None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:28.230474 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:28.269575 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9301e928-cdbf-47dd-983f-d089c4bd046e None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:28.304843 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cd53ed-e387-4d0d-a140-153129a89a2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:28.305485 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cd53ed-e387-4d0d-a140-153129a89a2e None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:28.305754 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cd53ed-e387-4d0d-a140-153129a89a2e None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:28.306021 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cd53ed-e387-4d0d-a140-153129a89a2e None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:28.306606 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cd53ed-e387-4d0d-a140-153129a89a2e None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:28.308014 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cd53ed-e387-4d0d-a140-153129a89a2e None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:28.317261 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application [None req-85cd53ed-e387-4d0d-a140-153129a89a2e None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 09 00:43:28.317261 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:43:28.317261 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 09 00:43:28.317261 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 09 00:43:28.317261 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 09 00:43:28.317261 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 09 00:43:28.317261 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 09 00:43:28.317261 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 09 00:43:28.317261 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 09 00:43:28.317261 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application Oct 09 00:43:28.317261 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 09 00:43:28.317261 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application Oct 09 00:43:28.317261 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:43:28.317261 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:43:28.317261 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:43:28.317261 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:43:28.317261 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:43:28.318307 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:43:28.318307 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:43:28.318307 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:43:28.318307 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:43:28.318307 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:43:28.318307 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:43:28.318307 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 09 00:43:28.318307 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 09 00:43:28.318307 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 09 00:43:28.318307 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 09 00:43:28.318307 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:43:28.318307 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:43:28.318307 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:43:28.318307 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:43:28.318307 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:43:28.318307 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:43:28.319139 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:43:28.319139 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application with Lock( Oct 09 00:43:28.319139 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:43:28.319139 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:43:28.319139 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:43:28.319139 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:43:28.319139 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:43:28.319139 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:43:28.319139 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:43:28.319139 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:43:28.319139 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 09 00:43:28.319139 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 09 00:43:28.319139 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 09 00:43:28.319139 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application Oct 09 00:43:28.323608 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 483/985] 10.222.0.15 () {56 vars in 1126 bytes} [Sun Oct 9 00:43:28 2022] GET /identity/v3/services/object-store => generated 93 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:43:28.324954 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c80dba8-5338-4c64-b223-7a1765c5186f None None] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:28.397342 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:28.444749 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c80dba8-5338-4c64-b223-7a1765c5186f None None] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:28.481322 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5901fff-f855-475c-91fd-3176ef511346 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:28.481933 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5901fff-f855-475c-91fd-3176ef511346 None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:28.482207 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5901fff-f855-475c-91fd-3176ef511346 None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:28.482478 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5901fff-f855-475c-91fd-3176ef511346 None admin] PATH_INFO: `/v3/services` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:28.483112 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5901fff-f855-475c-91fd-3176ef511346 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:43:28.483452 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5901fff-f855-475c-91fd-3176ef511346 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:28.484833 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5901fff-f855-475c-91fd-3176ef511346 None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:28.490074 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 503/986] 10.222.0.15 () {56 vars in 1122 bytes} [Sun Oct 9 00:43:28 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:43:28.495950 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cd53ed-e387-4d0d-a140-153129a89a2e None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:28.600644 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cd53ed-e387-4d0d-a140-153129a89a2e None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:28.630473 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:28.637518 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f560ea-5482-4ccb-9214-e9b7d8f364aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:28.638141 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f560ea-5482-4ccb-9214-e9b7d8f364aa None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:28.638419 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f560ea-5482-4ccb-9214-e9b7d8f364aa None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:28.638695 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f560ea-5482-4ccb-9214-e9b7d8f364aa None admin] PATH_INFO: `/v3/services` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:28.639356 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f560ea-5482-4ccb-9214-e9b7d8f364aa None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:43:28.639657 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f560ea-5482-4ccb-9214-e9b7d8f364aa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:28.641034 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f560ea-5482-4ccb-9214-e9b7d8f364aa None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:28.646627 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 484/987] 10.222.0.15 () {56 vars in 1122 bytes} [Sun Oct 9 00:43:28 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:43:28.652563 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5901fff-f855-475c-91fd-3176ef511346 None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:28.758691 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5901fff-f855-475c-91fd-3176ef511346 None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:28.789984 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:28.796128 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f79d5a5-9a9b-42c8-85cd-715dbf7c723e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:28.796742 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f79d5a5-9a9b-42c8-85cd-715dbf7c723e None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:28.797037 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f79d5a5-9a9b-42c8-85cd-715dbf7c723e None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:28.797305 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f79d5a5-9a9b-42c8-85cd-715dbf7c723e None admin] PATH_INFO: `/v3/endpoints` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:28.798024 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f79d5a5-9a9b-42c8-85cd-715dbf7c723e None admin] RBAC: Adding query filter params (interface=admin, service_id=184e712aa7a741a3a7fcb93710d1f6bb, region_id=RegionOne) {{(pid=81525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:43:28.798331 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f79d5a5-9a9b-42c8-85cd-715dbf7c723e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:28.799760 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f79d5a5-9a9b-42c8-85cd-715dbf7c723e None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:28.805738 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 504/988] 10.222.0.15 () {56 vars in 1249 bytes} [Sun Oct 9 00:43:28 2022] GET /identity/v3/endpoints?service_id=184e712aa7a741a3a7fcb93710d1f6bb&interface=admin®ion_id=RegionOne => generated 193 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:43:28.811474 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f560ea-5482-4ccb-9214-e9b7d8f364aa None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:28.913760 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f560ea-5482-4ccb-9214-e9b7d8f364aa None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:28.947153 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7531da5-32c4-4e94-9d36-e8a9359a785b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:28.947800 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7531da5-32c4-4e94-9d36-e8a9359a785b None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:28.948078 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7531da5-32c4-4e94-9d36-e8a9359a785b None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:28.948350 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7531da5-32c4-4e94-9d36-e8a9359a785b None admin] PATH_INFO: `/v3/services` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:28.948957 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7531da5-32c4-4e94-9d36-e8a9359a785b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:28.950351 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7531da5-32c4-4e94-9d36-e8a9359a785b None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:28.956597 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 485/989] 10.222.0.15 () {56 vars in 1087 bytes} [Sun Oct 9 00:43:28 2022] GET /identity/v3/services => generated 1727 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 09 00:43:29.238450 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf12c81b-dbd7-423e-8857-3bae467935ac None None] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:29.238704 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf12c81b-dbd7-423e-8857-3bae467935ac None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:29.239009 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf12c81b-dbd7-423e-8857-3bae467935ac None None] PATH_INFO: `/` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:29.240320 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 505/990] 10.222.0.15 () {54 vars in 927 bytes} [Sun Oct 9 00:43:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:43:29.246109 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e013a5-cffc-4d10-afc2-2601130e4139 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:29.246592 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e013a5-cffc-4d10-afc2-2601130e4139 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:29.246592 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e013a5-cffc-4d10-afc2-2601130e4139 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:29.266057 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-97e013a5-cffc-4d10-afc2-2601130e4139 None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:43:29.267246 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-97e013a5-cffc-4d10-afc2-2601130e4139 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:43:29.324423 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:29.340524 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 486/991] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Oct 9 00:43:29 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 09 00:43:29.601946 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf12c81b-dbd7-423e-8857-3bae467935ac None None] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:29.701876 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d226c870-a422-4022-82bb-b2ed8d647298 None None] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:29.702113 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d226c870-a422-4022-82bb-b2ed8d647298 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:29.702402 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d226c870-a422-4022-82bb-b2ed8d647298 None None] PATH_INFO: `/` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:29.707516 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 487/992] 10.222.0.15 () {54 vars in 927 bytes} [Sun Oct 9 00:43:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 09 00:43:29.708996 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e17731-a06a-441a-941d-77335cb3fc7a None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:29.709255 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e17731-a06a-441a-941d-77335cb3fc7a None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:29.709535 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e17731-a06a-441a-941d-77335cb3fc7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:29.712636 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf12c81b-dbd7-423e-8857-3bae467935ac None None] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:29.729195 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-57e17731-a06a-441a-941d-77335cb3fc7a None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:43:29.730430 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-57e17731-a06a-441a-941d-77335cb3fc7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:43:29.756936 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137ab864-3075-4fc5-a75e-641782919bfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:29.757881 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137ab864-3075-4fc5-a75e-641782919bfb None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:29.758312 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137ab864-3075-4fc5-a75e-641782919bfb None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:29.758758 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137ab864-3075-4fc5-a75e-641782919bfb None admin] PATH_INFO: `/v3/services/image` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:29.759722 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137ab864-3075-4fc5-a75e-641782919bfb None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:29.762004 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137ab864-3075-4fc5-a75e-641782919bfb None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:29.773811 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application [None req-137ab864-3075-4fc5-a75e-641782919bfb None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 09 00:43:29.773811 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:43:29.773811 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 09 00:43:29.773811 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 09 00:43:29.773811 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 09 00:43:29.773811 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 09 00:43:29.773811 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 09 00:43:29.773811 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 09 00:43:29.773811 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 09 00:43:29.773811 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Oct 09 00:43:29.773811 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 09 00:43:29.773811 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Oct 09 00:43:29.773811 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:43:29.773811 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:43:29.773811 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:43:29.773811 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:43:29.773811 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:43:29.774869 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:43:29.774869 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:43:29.774869 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:43:29.774869 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:43:29.774869 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:43:29.774869 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:43:29.774869 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 09 00:43:29.774869 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 09 00:43:29.774869 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 09 00:43:29.774869 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 09 00:43:29.774869 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:43:29.774869 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:43:29.774869 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:43:29.774869 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:43:29.774869 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:43:29.774869 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:43:29.776130 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:43:29.776130 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application with Lock( Oct 09 00:43:29.776130 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:43:29.776130 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:43:29.776130 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:43:29.776130 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:43:29.776130 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:43:29.776130 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:43:29.776130 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:43:29.776130 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:43:29.776130 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 09 00:43:29.776130 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 09 00:43:29.776130 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 09 00:43:29.776130 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Oct 09 00:43:29.779595 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 506/993] 10.222.0.15 () {56 vars in 1105 bytes} [Sun Oct 9 00:43:29 2022] GET /identity/v3/services/image => generated 86 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:43:29.781055 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137ab864-3075-4fc5-a75e-641782919bfb None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:29.804551 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 488/994] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Oct 9 00:43:29 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 09 00:43:29.841518 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:29.885485 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137ab864-3075-4fc5-a75e-641782919bfb None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:29.918745 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93bd3b9-691b-45ff-a32b-824e166d01b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:29.919376 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93bd3b9-691b-45ff-a32b-824e166d01b0 None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:29.919645 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93bd3b9-691b-45ff-a32b-824e166d01b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:29.919911 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93bd3b9-691b-45ff-a32b-824e166d01b0 None admin] PATH_INFO: `/v3/services` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:29.920529 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93bd3b9-691b-45ff-a32b-824e166d01b0 None admin] RBAC: Adding query filter params (name=image) {{(pid=81525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:43:29.920829 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93bd3b9-691b-45ff-a32b-824e166d01b0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:29.922193 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93bd3b9-691b-45ff-a32b-824e166d01b0 None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:29.927195 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 507/995] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Oct 9 00:43:29 2022] GET /identity/v3/services?name=image => generated 122 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 09 00:43:29.932893 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e17731-a06a-441a-941d-77335cb3fc7a None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:30.031036 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e17731-a06a-441a-941d-77335cb3fc7a None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:30.048693 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:30.065718 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93bd3b9-691b-45ff-a32b-824e166d01b0 None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:30.066704 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea473deb-0e55-4bc1-b104-3b3cb250e5a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:30.067350 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea473deb-0e55-4bc1-b104-3b3cb250e5a1 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:30.067611 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea473deb-0e55-4bc1-b104-3b3cb250e5a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:30.067874 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea473deb-0e55-4bc1-b104-3b3cb250e5a1 None admin] PATH_INFO: `/v3/services` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:30.068508 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea473deb-0e55-4bc1-b104-3b3cb250e5a1 None admin] RBAC: Adding query filter params (type=image) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:43:30.068803 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea473deb-0e55-4bc1-b104-3b3cb250e5a1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:30.070241 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea473deb-0e55-4bc1-b104-3b3cb250e5a1 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:30.075175 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 489/996] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Oct 9 00:43:29 2022] GET /identity/v3/services?type=image => generated 122 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:43:30.186923 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93bd3b9-691b-45ff-a32b-824e166d01b0 None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:30.213026 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:30.226701 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d81241-7d17-4669-a836-8cf54bb92db2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:30.227384 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d81241-7d17-4669-a836-8cf54bb92db2 None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:30.227640 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d81241-7d17-4669-a836-8cf54bb92db2 None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:30.227928 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d81241-7d17-4669-a836-8cf54bb92db2 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:30.228509 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d81241-7d17-4669-a836-8cf54bb92db2 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:30.229926 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d81241-7d17-4669-a836-8cf54bb92db2 None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:30.239947 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application [None req-c0d81241-7d17-4669-a836-8cf54bb92db2 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 09 00:43:30.239947 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:43:30.239947 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 09 00:43:30.239947 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 09 00:43:30.239947 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 09 00:43:30.239947 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 09 00:43:30.239947 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 09 00:43:30.239947 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 09 00:43:30.239947 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 09 00:43:30.239947 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Oct 09 00:43:30.239947 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 09 00:43:30.239947 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Oct 09 00:43:30.239947 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:43:30.239947 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:43:30.239947 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:43:30.239947 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:43:30.239947 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:43:30.241148 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:43:30.241148 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:43:30.241148 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:43:30.241148 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:43:30.241148 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:43:30.241148 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:43:30.241148 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 09 00:43:30.241148 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 09 00:43:30.241148 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 09 00:43:30.241148 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 09 00:43:30.241148 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:43:30.241148 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:43:30.241148 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:43:30.241148 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:43:30.241148 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:43:30.241148 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:43:30.247804 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:43:30.247804 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application with Lock( Oct 09 00:43:30.247804 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:43:30.247804 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:43:30.247804 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:43:30.247804 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:43:30.247804 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:43:30.247804 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:43:30.247804 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:43:30.247804 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:43:30.247804 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 09 00:43:30.247804 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 09 00:43:30.247804 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 09 00:43:30.247804 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Oct 09 00:43:30.247804 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 508/997] 10.222.0.15 () {56 vars in 1111 bytes} [Sun Oct 9 00:43:30 2022] GET /identity/v3/services/compute => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 09 00:43:30.249171 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea473deb-0e55-4bc1-b104-3b3cb250e5a1 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:30.347238 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea473deb-0e55-4bc1-b104-3b3cb250e5a1 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:30.381741 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcc520e-ebe7-4dcd-9e3e-549b55e4b879 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:30.382363 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcc520e-ebe7-4dcd-9e3e-549b55e4b879 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:30.382641 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcc520e-ebe7-4dcd-9e3e-549b55e4b879 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:30.382914 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcc520e-ebe7-4dcd-9e3e-549b55e4b879 None admin] PATH_INFO: `/v3/services` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:30.383557 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcc520e-ebe7-4dcd-9e3e-549b55e4b879 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:43:30.383861 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcc520e-ebe7-4dcd-9e3e-549b55e4b879 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:30.385228 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcc520e-ebe7-4dcd-9e3e-549b55e4b879 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:30.390127 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 490/998] 10.222.0.15 () {56 vars in 1112 bytes} [Sun Oct 9 00:43:30 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:43:30.396178 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d81241-7d17-4669-a836-8cf54bb92db2 None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:30.510993 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d81241-7d17-4669-a836-8cf54bb92db2 None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:30.544536 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbce864-46b4-4cef-b4da-a513dcbafaeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:30.545152 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbce864-46b4-4cef-b4da-a513dcbafaeb None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:30.545429 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbce864-46b4-4cef-b4da-a513dcbafaeb None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:30.545698 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbce864-46b4-4cef-b4da-a513dcbafaeb None admin] PATH_INFO: `/v3/services` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:30.546332 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbce864-46b4-4cef-b4da-a513dcbafaeb None admin] RBAC: Adding query filter params (type=compute) {{(pid=81525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:43:30.546631 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbce864-46b4-4cef-b4da-a513dcbafaeb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:30.548071 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbce864-46b4-4cef-b4da-a513dcbafaeb None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:30.558241 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 509/999] 10.222.0.15 () {56 vars in 1112 bytes} [Sun Oct 9 00:43:30 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 09 00:43:30.559307 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcc520e-ebe7-4dcd-9e3e-549b55e4b879 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:30.607301 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:30.661760 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcc520e-ebe7-4dcd-9e3e-549b55e4b879 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:30.695928 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7533ad74-d930-4b3d-a2ca-8d90a23c9b49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:30.696544 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7533ad74-d930-4b3d-a2ca-8d90a23c9b49 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:30.696885 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7533ad74-d930-4b3d-a2ca-8d90a23c9b49 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:30.697223 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7533ad74-d930-4b3d-a2ca-8d90a23c9b49 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:30.697988 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7533ad74-d930-4b3d-a2ca-8d90a23c9b49 None admin] RBAC: Adding query filter params (interface=public, service_id=7c4a5f374d454e89b4ec56da76c878e4, region_id=RegionOne) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:43:30.698366 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7533ad74-d930-4b3d-a2ca-8d90a23c9b49 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:30.699836 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7533ad74-d930-4b3d-a2ca-8d90a23c9b49 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:30.705269 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 491/1000] 10.222.0.15 () {56 vars in 1251 bytes} [Sun Oct 9 00:43:30 2022] GET /identity/v3/endpoints?service_id=7c4a5f374d454e89b4ec56da76c878e4&interface=public®ion_id=RegionOne => generated 194 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 09 00:43:30.711037 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbce864-46b4-4cef-b4da-a513dcbafaeb None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:30.765597 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:30.816739 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbce864-46b4-4cef-b4da-a513dcbafaeb None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:30.860847 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff4424d-b123-478c-b67d-32c58aee384e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:30.861979 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff4424d-b123-478c-b67d-32c58aee384e None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:30.862520 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff4424d-b123-478c-b67d-32c58aee384e None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:30.863035 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff4424d-b123-478c-b67d-32c58aee384e None admin] PATH_INFO: `/v3/services` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:30.864223 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff4424d-b123-478c-b67d-32c58aee384e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:30.866796 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff4424d-b123-478c-b67d-32c58aee384e None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:30.887302 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 510/1001] 10.222.0.15 () {56 vars in 1087 bytes} [Sun Oct 9 00:43:30 2022] GET /identity/v3/services => generated 1727 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 09 00:43:31.117920 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d16343-7326-4863-827e-cfa51f5d37d2 None None] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:31.118109 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d16343-7326-4863-827e-cfa51f5d37d2 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:31.118379 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d16343-7326-4863-827e-cfa51f5d37d2 None None] PATH_INFO: `/` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:31.119900 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 492/1002] 10.222.0.15 () {54 vars in 927 bytes} [Sun Oct 9 00:43:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:43:31.125697 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5395fa-c3f5-4b7c-90cd-a90fcd95a3a7 None None] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:31.125980 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5395fa-c3f5-4b7c-90cd-a90fcd95a3a7 None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:31.126242 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5395fa-c3f5-4b7c-90cd-a90fcd95a3a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:31.144843 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.auth.core [None req-7e5395fa-c3f5-4b7c-90cd-a90fcd95a3a7 None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:43:31.146027 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-7e5395fa-c3f5-4b7c-90cd-a90fcd95a3a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:43:31.214542 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 511/1003] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Oct 9 00:43:31 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 09 00:43:31.478434 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d16343-7326-4863-827e-cfa51f5d37d2 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:31.579803 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d16343-7326-4863-827e-cfa51f5d37d2 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:31.591879 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:31.619210 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0061c49-dd5d-4fc1-aa36-00235a751cf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:31.619863 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0061c49-dd5d-4fc1-aa36-00235a751cf6 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:31.620132 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0061c49-dd5d-4fc1-aa36-00235a751cf6 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:31.620403 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0061c49-dd5d-4fc1-aa36-00235a751cf6 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:31.621099 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0061c49-dd5d-4fc1-aa36-00235a751cf6 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:31.622919 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0061c49-dd5d-4fc1-aa36-00235a751cf6 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:31.632338 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application [None req-f0061c49-dd5d-4fc1-aa36-00235a751cf6 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 09 00:43:31.632338 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:43:31.632338 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 09 00:43:31.632338 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 09 00:43:31.632338 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 09 00:43:31.632338 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 09 00:43:31.632338 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 09 00:43:31.632338 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 09 00:43:31.632338 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 09 00:43:31.632338 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application Oct 09 00:43:31.632338 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 09 00:43:31.632338 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application Oct 09 00:43:31.632338 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:43:31.632338 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:43:31.632338 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:43:31.632338 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:43:31.632338 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:43:31.633334 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:43:31.633334 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:43:31.633334 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:43:31.633334 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:43:31.633334 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:43:31.633334 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:43:31.633334 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 09 00:43:31.633334 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 09 00:43:31.633334 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 09 00:43:31.633334 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 09 00:43:31.633334 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:43:31.633334 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:43:31.633334 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:43:31.633334 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:43:31.633334 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:43:31.633334 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:43:31.634219 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:43:31.634219 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application with Lock( Oct 09 00:43:31.634219 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:43:31.634219 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:43:31.634219 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:43:31.634219 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:43:31.634219 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:43:31.634219 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:43:31.634219 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:43:31.634219 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:43:31.634219 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 09 00:43:31.634219 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 09 00:43:31.634219 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 09 00:43:31.634219 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application Oct 09 00:43:31.638540 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 493/1004] 10.222.0.15 () {56 vars in 1126 bytes} [Sun Oct 9 00:43:31 2022] GET /identity/v3/services/object-store => generated 93 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:43:31.640036 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5395fa-c3f5-4b7c-90cd-a90fcd95a3a7 None None] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:31.692175 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:31.744774 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5395fa-c3f5-4b7c-90cd-a90fcd95a3a7 None None] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:31.782962 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247622cc-b785-4833-8f16-b85a7d9d5086 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:31.783629 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247622cc-b785-4833-8f16-b85a7d9d5086 None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:31.783900 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247622cc-b785-4833-8f16-b85a7d9d5086 None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:31.784162 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247622cc-b785-4833-8f16-b85a7d9d5086 None admin] PATH_INFO: `/v3/services` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:31.784791 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247622cc-b785-4833-8f16-b85a7d9d5086 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:43:31.785094 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247622cc-b785-4833-8f16-b85a7d9d5086 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:31.786466 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247622cc-b785-4833-8f16-b85a7d9d5086 None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:31.795381 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 512/1005] 10.222.0.15 () {56 vars in 1122 bytes} [Sun Oct 9 00:43:31 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:43:31.798401 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0061c49-dd5d-4fc1-aa36-00235a751cf6 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:31.907048 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0061c49-dd5d-4fc1-aa36-00235a751cf6 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:31.940390 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e04943-6bb3-4945-93a0-f9ef1a53510c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:31.940997 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e04943-6bb3-4945-93a0-f9ef1a53510c None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:31.941267 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e04943-6bb3-4945-93a0-f9ef1a53510c None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:31.941532 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e04943-6bb3-4945-93a0-f9ef1a53510c None admin] PATH_INFO: `/v3/services` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:31.942155 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e04943-6bb3-4945-93a0-f9ef1a53510c None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:43:31.942452 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e04943-6bb3-4945-93a0-f9ef1a53510c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:31.943921 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e04943-6bb3-4945-93a0-f9ef1a53510c None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:31.948852 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 494/1006] 10.222.0.15 () {56 vars in 1122 bytes} [Sun Oct 9 00:43:31 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:43:31.954529 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247622cc-b785-4833-8f16-b85a7d9d5086 None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:32.056587 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247622cc-b785-4833-8f16-b85a7d9d5086 None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:32.067916 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:32.095012 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3def51-0e87-4a38-a4b8-9d97c8ed77cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:32.095662 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3def51-0e87-4a38-a4b8-9d97c8ed77cb None admin] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:32.095936 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3def51-0e87-4a38-a4b8-9d97c8ed77cb None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:32.096203 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3def51-0e87-4a38-a4b8-9d97c8ed77cb None admin] PATH_INFO: `/v3/endpoints` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:32.096887 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3def51-0e87-4a38-a4b8-9d97c8ed77cb None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:32.098260 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3def51-0e87-4a38-a4b8-9d97c8ed77cb None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:32.123370 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 513/1007] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Oct 9 00:43:31 2022] POST /identity/v3/endpoints => generated 325 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 09 00:43:32.263009 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a1491b-4f9c-4c0c-817c-d7ccf73d0569 None None] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:32.263381 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a1491b-4f9c-4c0c-817c-d7ccf73d0569 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:32.263586 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a1491b-4f9c-4c0c-817c-d7ccf73d0569 None None] PATH_INFO: `/` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:32.264964 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 495/1008] 10.222.0.15 () {54 vars in 927 bytes} [Sun Oct 9 00:43:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:43:32.271193 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed927856-ec22-41cc-83c2-d9c3f3165e49 None None] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:32.271543 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed927856-ec22-41cc-83c2-d9c3f3165e49 None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:32.271773 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed927856-ec22-41cc-83c2-d9c3f3165e49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:32.292595 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.auth.core [None req-ed927856-ec22-41cc-83c2-d9c3f3165e49 None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:43:32.293831 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-ed927856-ec22-41cc-83c2-d9c3f3165e49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:43:32.369524 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 514/1009] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Oct 9 00:43:32 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 09 00:43:32.634011 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a1491b-4f9c-4c0c-817c-d7ccf73d0569 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:32.677273 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:32.740939 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a1491b-4f9c-4c0c-817c-d7ccf73d0569 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:32.774600 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665ecbca-8496-43f5-9083-42158ff17169 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:32.775216 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665ecbca-8496-43f5-9083-42158ff17169 None admin] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:32.775519 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665ecbca-8496-43f5-9083-42158ff17169 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:32.775792 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665ecbca-8496-43f5-9083-42158ff17169 None admin] PATH_INFO: `/v3/services` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:32.776458 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665ecbca-8496-43f5-9083-42158ff17169 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:32.777823 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665ecbca-8496-43f5-9083-42158ff17169 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:32.799303 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 496/1010] 10.222.0.15 () {60 vars in 1141 bytes} [Sun Oct 9 00:43:32 2022] POST /identity/v3/services => generated 242 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 09 00:43:33.048543 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7285a1b-7fa8-459f-b017-e06b6e3c27e5 None None] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:33.049111 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7285a1b-7fa8-459f-b017-e06b6e3c27e5 None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:33.049111 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7285a1b-7fa8-459f-b017-e06b6e3c27e5 None None] PATH_INFO: `/` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:33.050592 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 515/1011] 10.222.0.15 () {54 vars in 927 bytes} [Sun Oct 9 00:43:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:43:33.056407 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8d18f6-203c-4a1a-b2f8-09d77990132d None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:33.056746 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8d18f6-203c-4a1a-b2f8-09d77990132d None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:33.056953 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8d18f6-203c-4a1a-b2f8-09d77990132d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:33.076260 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-ba8d18f6-203c-4a1a-b2f8-09d77990132d None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:43:33.077477 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-ba8d18f6-203c-4a1a-b2f8-09d77990132d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:43:33.153725 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 497/1012] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Oct 9 00:43:33 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 09 00:43:33.412215 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7285a1b-7fa8-459f-b017-e06b6e3c27e5 None None] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:33.517070 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:33.525421 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7285a1b-7fa8-459f-b017-e06b6e3c27e5 None None] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:33.560470 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e018f8b0-e288-4476-8bca-92980321b649 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:33.561102 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e018f8b0-e288-4476-8bca-92980321b649 None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:33.561376 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e018f8b0-e288-4476-8bca-92980321b649 None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:33.561696 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e018f8b0-e288-4476-8bca-92980321b649 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:33.562286 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e018f8b0-e288-4476-8bca-92980321b649 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:33.563700 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e018f8b0-e288-4476-8bca-92980321b649 None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:33.572522 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application [None req-e018f8b0-e288-4476-8bca-92980321b649 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 09 00:43:33.572522 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:43:33.572522 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 09 00:43:33.572522 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 09 00:43:33.572522 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 09 00:43:33.572522 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 09 00:43:33.572522 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 09 00:43:33.572522 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 09 00:43:33.572522 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 09 00:43:33.572522 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Oct 09 00:43:33.572522 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 09 00:43:33.572522 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Oct 09 00:43:33.572522 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:43:33.572522 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:43:33.572522 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:43:33.572522 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:43:33.572522 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:43:33.573498 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:43:33.573498 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:43:33.573498 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:43:33.573498 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:43:33.573498 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:43:33.573498 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:43:33.573498 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 09 00:43:33.573498 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 09 00:43:33.573498 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 09 00:43:33.573498 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 09 00:43:33.573498 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:43:33.573498 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:43:33.573498 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:43:33.573498 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:43:33.573498 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:43:33.573498 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:43:33.576105 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:43:33.576105 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application with Lock( Oct 09 00:43:33.576105 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:43:33.576105 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:43:33.576105 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:43:33.576105 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:43:33.576105 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:43:33.576105 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:43:33.576105 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:43:33.576105 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:43:33.576105 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 09 00:43:33.576105 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 09 00:43:33.576105 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 09 00:43:33.576105 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Oct 09 00:43:33.576105 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 516/1013] 10.222.0.15 () {56 vars in 1111 bytes} [Sun Oct 9 00:43:33 2022] GET /identity/v3/services/compute => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:43:33.580201 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8d18f6-203c-4a1a-b2f8-09d77990132d None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:33.605867 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:33.683285 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8d18f6-203c-4a1a-b2f8-09d77990132d None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:33.721395 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9980293f-e0ec-44c3-87f4-8a97566e6216 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:33.722011 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9980293f-e0ec-44c3-87f4-8a97566e6216 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:33.722283 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9980293f-e0ec-44c3-87f4-8a97566e6216 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:33.722551 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9980293f-e0ec-44c3-87f4-8a97566e6216 None admin] PATH_INFO: `/v3/services` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:33.723184 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9980293f-e0ec-44c3-87f4-8a97566e6216 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:43:33.723509 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9980293f-e0ec-44c3-87f4-8a97566e6216 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:33.724879 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9980293f-e0ec-44c3-87f4-8a97566e6216 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:33.730283 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 498/1014] 10.222.0.15 () {56 vars in 1112 bytes} [Sun Oct 9 00:43:33 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 09 00:43:33.735903 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e018f8b0-e288-4476-8bca-92980321b649 None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:33.835398 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e018f8b0-e288-4476-8bca-92980321b649 None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:33.869721 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61111890-1c4c-4ba1-82a3-406c09a8f49f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:33.870331 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61111890-1c4c-4ba1-82a3-406c09a8f49f None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:33.870604 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61111890-1c4c-4ba1-82a3-406c09a8f49f None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:33.870867 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61111890-1c4c-4ba1-82a3-406c09a8f49f None admin] PATH_INFO: `/v3/services` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:33.871517 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61111890-1c4c-4ba1-82a3-406c09a8f49f None admin] RBAC: Adding query filter params (type=compute) {{(pid=81525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:43:33.871815 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61111890-1c4c-4ba1-82a3-406c09a8f49f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:33.873526 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61111890-1c4c-4ba1-82a3-406c09a8f49f None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:33.878588 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 517/1015] 10.222.0.15 () {56 vars in 1112 bytes} [Sun Oct 9 00:43:33 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:43:33.884179 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9980293f-e0ec-44c3-87f4-8a97566e6216 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:33.971559 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:33.984714 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9980293f-e0ec-44c3-87f4-8a97566e6216 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:34.018864 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beba5ec8-2ae4-40d3-a0db-f7efa8906d12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:34.019529 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beba5ec8-2ae4-40d3-a0db-f7efa8906d12 None admin] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:34.019802 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beba5ec8-2ae4-40d3-a0db-f7efa8906d12 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:34.020072 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beba5ec8-2ae4-40d3-a0db-f7efa8906d12 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:34.020757 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beba5ec8-2ae4-40d3-a0db-f7efa8906d12 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:34.022155 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beba5ec8-2ae4-40d3-a0db-f7efa8906d12 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:34.047056 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 499/1016] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Oct 9 00:43:33 2022] POST /identity/v3/endpoints => generated 334 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 09 00:43:34.292468 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea8e3c6-4e02-43ac-8d7b-61c4a2c06f85 None None] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:34.293006 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea8e3c6-4e02-43ac-8d7b-61c4a2c06f85 None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:34.293006 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea8e3c6-4e02-43ac-8d7b-61c4a2c06f85 None None] PATH_INFO: `/` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:34.294621 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 518/1017] 10.222.0.15 () {54 vars in 927 bytes} [Sun Oct 9 00:43:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:43:34.300464 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66dcd3b-9845-4675-9f94-c702e1388618 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:34.300752 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66dcd3b-9845-4675-9f94-c702e1388618 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:34.301023 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66dcd3b-9845-4675-9f94-c702e1388618 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:34.321514 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-b66dcd3b-9845-4675-9f94-c702e1388618 None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:43:34.322878 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-b66dcd3b-9845-4675-9f94-c702e1388618 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:43:34.403307 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 500/1018] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Oct 9 00:43:34 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 09 00:43:34.664105 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea8e3c6-4e02-43ac-8d7b-61c4a2c06f85 None None] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:34.691634 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:34.774835 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea8e3c6-4e02-43ac-8d7b-61c4a2c06f85 None None] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:34.813670 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a218b1e-9f7d-42a8-a1c6-864e7e59e1b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:34.814316 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a218b1e-9f7d-42a8-a1c6-864e7e59e1b1 None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:34.814592 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a218b1e-9f7d-42a8-a1c6-864e7e59e1b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:34.814863 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a218b1e-9f7d-42a8-a1c6-864e7e59e1b1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:34.816020 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a218b1e-9f7d-42a8-a1c6-864e7e59e1b1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:34.817465 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a218b1e-9f7d-42a8-a1c6-864e7e59e1b1 None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:34.819370 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 519/1019] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Oct 9 00:43:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:43:34.825089 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66dcd3b-9845-4675-9f94-c702e1388618 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:34.904943 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:34.937951 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66dcd3b-9845-4675-9f94-c702e1388618 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:34.974983 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff99b4f-c8d2-450f-9a3b-5104fc7467f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:34.975696 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff99b4f-c8d2-450f-9a3b-5104fc7467f6 None admin] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:34.975972 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff99b4f-c8d2-450f-9a3b-5104fc7467f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:34.976239 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff99b4f-c8d2-450f-9a3b-5104fc7467f6 None admin] PATH_INFO: `/v3/projects` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:34.976899 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff99b4f-c8d2-450f-9a3b-5104fc7467f6 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:34.978347 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff99b4f-c8d2-450f-9a3b-5104fc7467f6 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:34.986399 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0714eac-43c4-4cfc-a318-c24ffe4b3ff8 None None] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:34.986653 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0714eac-43c4-4cfc-a318-c24ffe4b3ff8 None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:34.986936 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0714eac-43c4-4cfc-a318-c24ffe4b3ff8 None None] PATH_INFO: `/` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:34.988430 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 520/1020] 10.222.0.15 () {54 vars in 927 bytes} [Sun Oct 9 00:43:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 09 00:43:34.993540 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99278db2-7179-41f1-a033-8b28d184df5b None None] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:34.993798 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99278db2-7179-41f1-a033-8b28d184df5b None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:34.994077 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99278db2-7179-41f1-a033-8b28d184df5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:35.011309 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 501/1021] 10.222.0.15 () {60 vars in 1141 bytes} [Sun Oct 9 00:43:34 2022] POST /identity/v3/projects => generated 311 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 09 00:43:35.022183 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.auth.core [None req-99278db2-7179-41f1-a033-8b28d184df5b None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:43:35.023625 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-99278db2-7179-41f1-a033-8b28d184df5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:43:35.097690 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 521/1022] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Oct 9 00:43:34 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 09 00:43:35.362604 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff99b4f-c8d2-450f-9a3b-5104fc7467f6 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:35.473515 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff99b4f-c8d2-450f-9a3b-5104fc7467f6 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:35.496208 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:35.509671 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8282b02f-eb65-4c37-9b04-c7c8b98332cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:35.510314 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8282b02f-eb65-4c37-9b04-c7c8b98332cd None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:35.510589 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8282b02f-eb65-4c37-9b04-c7c8b98332cd None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:35.510859 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8282b02f-eb65-4c37-9b04-c7c8b98332cd None admin] PATH_INFO: `/v3/services/image` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:35.511514 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8282b02f-eb65-4c37-9b04-c7c8b98332cd None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:35.512880 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8282b02f-eb65-4c37-9b04-c7c8b98332cd None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:35.522220 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application [None req-8282b02f-eb65-4c37-9b04-c7c8b98332cd None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 09 00:43:35.522220 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:43:35.522220 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 09 00:43:35.522220 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 09 00:43:35.522220 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 09 00:43:35.522220 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 09 00:43:35.522220 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 09 00:43:35.522220 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 09 00:43:35.522220 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 09 00:43:35.522220 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application Oct 09 00:43:35.522220 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 09 00:43:35.522220 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application Oct 09 00:43:35.522220 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:43:35.522220 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:43:35.522220 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:43:35.522220 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:43:35.522220 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:43:35.523282 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:43:35.523282 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:43:35.523282 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:43:35.523282 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:43:35.523282 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:43:35.523282 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:43:35.523282 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 09 00:43:35.523282 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 09 00:43:35.523282 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 09 00:43:35.523282 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 09 00:43:35.523282 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:43:35.523282 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:43:35.523282 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:43:35.523282 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:43:35.523282 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:43:35.523282 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:43:35.528183 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:43:35.528183 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application with Lock( Oct 09 00:43:35.528183 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:43:35.528183 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:43:35.528183 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:43:35.528183 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:43:35.528183 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:43:35.528183 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:43:35.528183 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:43:35.528183 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:43:35.528183 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 09 00:43:35.528183 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 09 00:43:35.528183 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 09 00:43:35.528183 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application Oct 09 00:43:35.528183 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 502/1023] 10.222.0.15 () {56 vars in 1105 bytes} [Sun Oct 9 00:43:35 2022] GET /identity/v3/services/image => generated 86 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:43:35.530231 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99278db2-7179-41f1-a033-8b28d184df5b None None] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:35.556306 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:35.635359 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99278db2-7179-41f1-a033-8b28d184df5b None None] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:35.670512 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd029acb-c7d4-4756-9ca7-ade2db5dbb7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:35.671118 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd029acb-c7d4-4756-9ca7-ade2db5dbb7c None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:35.671419 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd029acb-c7d4-4756-9ca7-ade2db5dbb7c None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:35.671687 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd029acb-c7d4-4756-9ca7-ade2db5dbb7c None admin] PATH_INFO: `/v3/services` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:35.672317 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd029acb-c7d4-4756-9ca7-ade2db5dbb7c None admin] RBAC: Adding query filter params (name=image) {{(pid=81525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:43:35.672613 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd029acb-c7d4-4756-9ca7-ade2db5dbb7c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:35.673987 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd029acb-c7d4-4756-9ca7-ade2db5dbb7c None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:35.679173 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 522/1024] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Oct 9 00:43:35 2022] GET /identity/v3/services?name=image => generated 122 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:43:35.684815 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8282b02f-eb65-4c37-9b04-c7c8b98332cd None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:35.786718 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8282b02f-eb65-4c37-9b04-c7c8b98332cd None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:35.821168 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cb4f49-58e9-496e-b422-a07caf21bb8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:35.821782 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cb4f49-58e9-496e-b422-a07caf21bb8f None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:35.822052 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cb4f49-58e9-496e-b422-a07caf21bb8f None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:35.822322 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cb4f49-58e9-496e-b422-a07caf21bb8f None admin] PATH_INFO: `/v3/services` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:35.822935 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99cb4f49-58e9-496e-b422-a07caf21bb8f None admin] RBAC: Adding query filter params (type=image) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:43:35.823232 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99cb4f49-58e9-496e-b422-a07caf21bb8f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:35.824671 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99cb4f49-58e9-496e-b422-a07caf21bb8f None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:35.829806 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 503/1025] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Oct 9 00:43:35 2022] GET /identity/v3/services?type=image => generated 350 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:43:35.835742 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd029acb-c7d4-4756-9ca7-ade2db5dbb7c None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:35.925573 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:35.945271 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd029acb-c7d4-4756-9ca7-ade2db5dbb7c None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:35.980865 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f499f3d-ca51-458a-a141-4b34281a20a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:35.981479 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f499f3d-ca51-458a-a141-4b34281a20a9 None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:35.981751 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f499f3d-ca51-458a-a141-4b34281a20a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:35.982066 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f499f3d-ca51-458a-a141-4b34281a20a9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:35.982763 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f499f3d-ca51-458a-a141-4b34281a20a9 None admin] RBAC: Adding query filter params (interface=public, service_id=56714181e0424d478ae6dd56c5fe541a, region_id=RegionOne) {{(pid=81525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:43:35.983063 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f499f3d-ca51-458a-a141-4b34281a20a9 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:35.984474 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f499f3d-ca51-458a-a141-4b34281a20a9 None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:35.989986 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 523/1026] 10.222.0.15 () {56 vars in 1251 bytes} [Sun Oct 9 00:43:35 2022] GET /identity/v3/endpoints?service_id=56714181e0424d478ae6dd56c5fe541a&interface=public®ion_id=RegionOne => generated 194 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:43:35.995971 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cb4f49-58e9-496e-b422-a07caf21bb8f None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:36.048494 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:36.103067 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cb4f49-58e9-496e-b422-a07caf21bb8f None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:36.138375 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3fdba3-2ac1-4e9a-928f-e4246d448bab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:36.138972 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3fdba3-2ac1-4e9a-928f-e4246d448bab None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:36.139244 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3fdba3-2ac1-4e9a-928f-e4246d448bab None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:36.139533 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3fdba3-2ac1-4e9a-928f-e4246d448bab None admin] PATH_INFO: `/v3/services` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:36.140141 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3fdba3-2ac1-4e9a-928f-e4246d448bab None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:36.141499 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3fdba3-2ac1-4e9a-928f-e4246d448bab None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:36.148415 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 504/1027] 10.222.0.15 () {56 vars in 1087 bytes} [Sun Oct 9 00:43:35 2022] GET /identity/v3/services => generated 1957 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 09 00:43:36.302027 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d09fe7-2eba-4e82-92d2-001612950bda None None] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:36.302213 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d09fe7-2eba-4e82-92d2-001612950bda None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:36.302462 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d09fe7-2eba-4e82-92d2-001612950bda None None] PATH_INFO: `/` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:36.303951 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 524/1028] 10.222.0.15 () {54 vars in 927 bytes} [Sun Oct 9 00:43:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:43:36.310083 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb894b9-eacc-40e0-a631-854edf0f623c None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:36.310436 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb894b9-eacc-40e0-a631-854edf0f623c None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:36.310595 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb894b9-eacc-40e0-a631-854edf0f623c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:36.330127 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-2eb894b9-eacc-40e0-a631-854edf0f623c None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:43:36.331386 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-2eb894b9-eacc-40e0-a631-854edf0f623c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:43:36.417646 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 505/1029] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Oct 9 00:43:36 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 09 00:43:36.682538 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d09fe7-2eba-4e82-92d2-001612950bda None None] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:36.795085 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d09fe7-2eba-4e82-92d2-001612950bda None None] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:36.833980 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f75d07-b25e-4248-9c45-04f87550e58b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:36.834696 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f75d07-b25e-4248-9c45-04f87550e58b None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:36.834969 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f75d07-b25e-4248-9c45-04f87550e58b None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:36.835225 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f75d07-b25e-4248-9c45-04f87550e58b None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:36.847720 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f75d07-b25e-4248-9c45-04f87550e58b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 09 00:43:36.852897 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application [None req-67f75d07-b25e-4248-9c45-04f87550e58b None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 09 00:43:36.852897 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:43:36.852897 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:43:36.852897 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:43:36.852897 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:43:36.852897 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:43:36.852897 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:43:36.852897 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:43:36.852897 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:43:36.852897 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:43:36.852897 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:43:36.852897 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:43:36.852897 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 09 00:43:36.852897 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 09 00:43:36.852897 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 09 00:43:36.852897 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 09 00:43:36.853888 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 09 00:43:36.853888 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 09 00:43:36.853888 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 09 00:43:36.853888 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 09 00:43:36.853888 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:43:36.853888 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:43:36.853888 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:43:36.853888 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:43:36.853888 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:43:36.853888 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:43:36.853888 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:43:36.853888 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application with Lock( Oct 09 00:43:36.853888 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:43:36.853888 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:43:36.853888 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:43:36.853888 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:43:36.854739 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:43:36.854739 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:43:36.854739 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:43:36.854739 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:43:36.854739 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 09 00:43:36.854739 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 09 00:43:36.854739 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 09 00:43:36.854739 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 09 00:43:36.854739 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 09 00:43:36.854739 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 09 00:43:36.854739 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 09 00:43:36.854739 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Oct 09 00:43:36.856154 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 525/1030] 10.222.0.15 () {56 vars in 1120 bytes} [Sun Oct 9 00:43:36 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:43:36.860408 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb894b9-eacc-40e0-a631-854edf0f623c None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:36.912060 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:36.972376 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb894b9-eacc-40e0-a631-854edf0f623c None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:37.016128 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb7cdb2-bde8-4969-8133-03a51f625bca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:37.016738 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb7cdb2-bde8-4969-8133-03a51f625bca None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:37.017014 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb7cdb2-bde8-4969-8133-03a51f625bca None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:37.017294 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb7cdb2-bde8-4969-8133-03a51f625bca None admin] PATH_INFO: `/v3/roles` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:37.019819 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb7cdb2-bde8-4969-8133-03a51f625bca None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:43:37.019819 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb7cdb2-bde8-4969-8133-03a51f625bca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:37.019819 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb7cdb2-bde8-4969-8133-03a51f625bca None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:37.029190 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 506/1031] 10.222.0.15 () {56 vars in 1115 bytes} [Sun Oct 9 00:43:36 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:43:37.035708 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f75d07-b25e-4248-9c45-04f87550e58b None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:37.050320 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:37.163896 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f75d07-b25e-4248-9c45-04f87550e58b None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:37.200601 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d432224-5898-4e68-a9c9-da2119fa65a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:37.201228 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d432224-5898-4e68-a9c9-da2119fa65a0 None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:37.201501 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d432224-5898-4e68-a9c9-da2119fa65a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:37.201734 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d432224-5898-4e68-a9c9-da2119fa65a0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:37.214141 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d432224-5898-4e68-a9c9-da2119fa65a0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:37.215692 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d432224-5898-4e68-a9c9-da2119fa65a0 None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:37.217279 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011c11a7-27d2-4dae-8394-aab8c96191b4 None None] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:37.217550 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011c11a7-27d2-4dae-8394-aab8c96191b4 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:37.217819 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011c11a7-27d2-4dae-8394-aab8c96191b4 None None] PATH_INFO: `/` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:37.219384 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 507/1032] 10.222.0.15 () {54 vars in 927 bytes} [Sun Oct 9 00:43:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 09 00:43:37.224974 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a23bd5-e930-4675-9cf2-e77eac1242d7 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:37.225129 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a23bd5-e930-4675-9cf2-e77eac1242d7 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:37.225304 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a23bd5-e930-4675-9cf2-e77eac1242d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:37.232109 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application [None req-9d432224-5898-4e68-a9c9-da2119fa65a0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:43:37.232109 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:43:37.232109 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:43:37.232109 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:43:37.232109 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:43:37.232109 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:43:37.232109 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:43:37.232109 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:43:37.232109 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:43:37.232109 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:43:37.232109 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:43:37.232109 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:43:37.232109 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 09 00:43:37.232109 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 09 00:43:37.232109 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 09 00:43:37.232109 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 09 00:43:37.233113 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:43:37.233113 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:43:37.233113 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:43:37.233113 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:43:37.233113 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:43:37.233113 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:43:37.233113 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:43:37.233113 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application with Lock( Oct 09 00:43:37.233113 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:43:37.233113 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:43:37.233113 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:43:37.233113 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:43:37.233113 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:43:37.233113 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:43:37.233113 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:43:37.233113 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:43:37.233113 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 09 00:43:37.239236 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 09 00:43:37.239236 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:43:37.239236 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Oct 09 00:43:37.239236 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 526/1033] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Oct 9 00:43:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:43:37.241193 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d432224-5898-4e68-a9c9-da2119fa65a0 None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:37.245456 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-91a23bd5-e930-4675-9cf2-e77eac1242d7 None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:43:37.245983 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-91a23bd5-e930-4675-9cf2-e77eac1242d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:43:37.310432 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:37.331406 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 508/1034] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Oct 9 00:43:37 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 09 00:43:37.358512 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d432224-5898-4e68-a9c9-da2119fa65a0 None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:37.403250 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb91b69-9703-4d04-af04-d0b13b1b8e8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:37.403896 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb91b69-9703-4d04-af04-d0b13b1b8e8c None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:37.404171 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb91b69-9703-4d04-af04-d0b13b1b8e8c None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:37.404435 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb91b69-9703-4d04-af04-d0b13b1b8e8c None admin] PATH_INFO: `/v3/domains` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:37.405074 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb91b69-9703-4d04-af04-d0b13b1b8e8c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:43:37.405371 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb91b69-9703-4d04-af04-d0b13b1b8e8c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:37.406750 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb91b69-9703-4d04-af04-d0b13b1b8e8c None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:37.420631 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 527/1035] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Oct 9 00:43:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:43:37.426309 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a23bd5-e930-4675-9cf2-e77eac1242d7 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:37.468887 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:37.554695 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a23bd5-e930-4675-9cf2-e77eac1242d7 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:37.591271 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b2590c-4c96-4606-9aaa-0fe448cf3419 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:37.591928 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b2590c-4c96-4606-9aaa-0fe448cf3419 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:37.592195 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b2590c-4c96-4606-9aaa-0fe448cf3419 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:37.592463 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b2590c-4c96-4606-9aaa-0fe448cf3419 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:37.599010 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb91b69-9703-4d04-af04-d0b13b1b8e8c None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:37.600603 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b2590c-4c96-4606-9aaa-0fe448cf3419 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:37.602208 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b2590c-4c96-4606-9aaa-0fe448cf3419 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:37.614180 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application [None req-87b2590c-4c96-4606-9aaa-0fe448cf3419 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 09 00:43:37.614180 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:43:37.614180 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:43:37.614180 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:43:37.614180 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:43:37.614180 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:43:37.614180 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:43:37.614180 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:43:37.614180 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:43:37.614180 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:43:37.614180 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:43:37.614180 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:43:37.614180 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 09 00:43:37.614180 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 09 00:43:37.614180 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 09 00:43:37.614180 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 09 00:43:37.615302 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:43:37.615302 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:43:37.615302 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 09 00:43:37.615302 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 09 00:43:37.615302 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 09 00:43:37.615302 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 09 00:43:37.615302 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:43:37.615302 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:43:37.615302 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:43:37.615302 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:43:37.615302 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:43:37.615302 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application with Lock( Oct 09 00:43:37.615302 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:43:37.615302 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:43:37.615302 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:43:37.615302 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:43:37.615302 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:43:37.615302 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:43:37.616358 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:43:37.616358 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:43:37.616358 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 09 00:43:37.616358 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 09 00:43:37.616358 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 09 00:43:37.616358 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 09 00:43:37.616358 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 09 00:43:37.616358 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 09 00:43:37.616358 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 09 00:43:37.616358 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application Oct 09 00:43:37.619457 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 509/1036] 10.222.0.15 () {56 vars in 1093 bytes} [Sun Oct 9 00:43:37 2022] GET /identity/v3/users/nova => generated 82 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:43:37.621527 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b2590c-4c96-4606-9aaa-0fe448cf3419 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:37.719034 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb91b69-9703-4d04-af04-d0b13b1b8e8c None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:37.733582 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:37.742701 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b2590c-4c96-4606-9aaa-0fe448cf3419 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:37.744662 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:37.760913 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f84d1a-1083-47ff-8e25-02947d61777a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:37.761672 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f84d1a-1083-47ff-8e25-02947d61777a None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:37.761997 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f84d1a-1083-47ff-8e25-02947d61777a None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:37.762336 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f84d1a-1083-47ff-8e25-02947d61777a None admin] PATH_INFO: `/v3/domains/default` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:37.763699 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f84d1a-1083-47ff-8e25-02947d61777a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:37.765751 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f84d1a-1083-47ff-8e25-02947d61777a None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:37.767744 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 528/1037] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Oct 9 00:43:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 09 00:43:37.773449 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f84d1a-1083-47ff-8e25-02947d61777a None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:37.789708 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007f2ad4-9763-4be4-bda4-8cee7d21d4e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:37.790333 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007f2ad4-9763-4be4-bda4-8cee7d21d4e8 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:37.790606 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007f2ad4-9763-4be4-bda4-8cee7d21d4e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:37.790873 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007f2ad4-9763-4be4-bda4-8cee7d21d4e8 None admin] PATH_INFO: `/v3/users` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:37.791640 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007f2ad4-9763-4be4-bda4-8cee7d21d4e8 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:43:37.791945 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007f2ad4-9763-4be4-bda4-8cee7d21d4e8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:37.793380 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007f2ad4-9763-4be4-bda4-8cee7d21d4e8 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:37.813016 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 510/1038] 10.222.0.15 () {56 vars in 1133 bytes} [Sun Oct 9 00:43:37 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:43:37.818904 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007f2ad4-9763-4be4-bda4-8cee7d21d4e8 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:37.884692 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f84d1a-1083-47ff-8e25-02947d61777a None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:37.918543 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6319bf87-9868-4620-9f4c-dafffc3c58cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:37.919158 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6319bf87-9868-4620-9f4c-dafffc3c58cf None admin] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:37.919456 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6319bf87-9868-4620-9f4c-dafffc3c58cf None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:37.919720 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6319bf87-9868-4620-9f4c-dafffc3c58cf None admin] PATH_INFO: `/v3/users` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:37.920374 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6319bf87-9868-4620-9f4c-dafffc3c58cf None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:37.921830 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6319bf87-9868-4620-9f4c-dafffc3c58cf None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:37.925170 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007f2ad4-9763-4be4-bda4-8cee7d21d4e8 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:37.948445 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 529/1039] 10.222.0.15 () {60 vars in 1132 bytes} [Sun Oct 9 00:43:37 2022] POST /identity/v3/users => generated 285 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 09 00:43:37.978404 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e309df12-29ad-4811-9016-ebcd90bb4fef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:37.979057 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e309df12-29ad-4811-9016-ebcd90bb4fef None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:37.979365 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e309df12-29ad-4811-9016-ebcd90bb4fef None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:37.979638 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e309df12-29ad-4811-9016-ebcd90bb4fef None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:38.008779 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:38.064264 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e309df12-29ad-4811-9016-ebcd90bb4fef None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:38.065467 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e309df12-29ad-4811-9016-ebcd90bb4fef None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:38.200537 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 511/1040] 10.222.0.15 () {58 vars in 1282 bytes} [Sun Oct 9 00:43:37 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Oct 09 00:43:38.207212 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6319bf87-9868-4620-9f4c-dafffc3c58cf None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:38.272193 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:38.330978 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6319bf87-9868-4620-9f4c-dafffc3c58cf None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:38.366410 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6893d36-2136-494f-bec4-ae6a5652df0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:38.367897 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6893d36-2136-494f-bec4-ae6a5652df0e None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:38.368134 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af88ed2-ad67-4cba-ab1e-011e048d724d None None] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:38.368246 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6893d36-2136-494f-bec4-ae6a5652df0e None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:38.368424 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af88ed2-ad67-4cba-ab1e-011e048d724d None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:38.368534 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6893d36-2136-494f-bec4-ae6a5652df0e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:38.368703 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af88ed2-ad67-4cba-ab1e-011e048d724d None None] PATH_INFO: `/` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:38.370194 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 512/1041] 10.222.0.15 () {54 vars in 927 bytes} [Sun Oct 9 00:43:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:43:38.375888 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ca23d2-7023-4b1d-ae09-63accafb0f30 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:38.376236 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ca23d2-7023-4b1d-ae09-63accafb0f30 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:38.376410 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ca23d2-7023-4b1d-ae09-63accafb0f30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:38.381146 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6893d36-2136-494f-bec4-ae6a5652df0e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:38.382625 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6893d36-2136-494f-bec4-ae6a5652df0e None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:38.395628 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-26ca23d2-7023-4b1d-ae09-63accafb0f30 None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:43:38.396991 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-26ca23d2-7023-4b1d-ae09-63accafb0f30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:43:38.397794 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application [None req-c6893d36-2136-494f-bec4-ae6a5652df0e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:43:38.397794 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:43:38.397794 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:43:38.397794 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:43:38.397794 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:43:38.397794 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:43:38.397794 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:43:38.397794 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:43:38.397794 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:43:38.397794 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:43:38.397794 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:43:38.397794 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:43:38.397794 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 09 00:43:38.397794 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 09 00:43:38.397794 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 09 00:43:38.397794 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 09 00:43:38.398787 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:43:38.398787 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:43:38.398787 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:43:38.398787 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:43:38.398787 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:43:38.398787 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:43:38.398787 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:43:38.398787 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application with Lock( Oct 09 00:43:38.398787 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:43:38.398787 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:43:38.398787 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:43:38.398787 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:43:38.398787 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:43:38.398787 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:43:38.398787 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:43:38.398787 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:43:38.398787 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 09 00:43:38.400223 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 09 00:43:38.400223 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:43:38.400223 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Oct 09 00:43:38.400223 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 530/1042] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Oct 9 00:43:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:43:38.407399 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6893d36-2136-494f-bec4-ae6a5652df0e None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:38.461691 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:38.483624 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 513/1043] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Oct 9 00:43:38 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 09 00:43:38.538743 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:38.544789 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6893d36-2136-494f-bec4-ae6a5652df0e None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:38.587651 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513f641d-8de0-4dfd-bb1d-9da15060b7a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:38.588335 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513f641d-8de0-4dfd-bb1d-9da15060b7a8 None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:38.588647 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513f641d-8de0-4dfd-bb1d-9da15060b7a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:38.589106 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513f641d-8de0-4dfd-bb1d-9da15060b7a8 None admin] PATH_INFO: `/v3/domains` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:38.590115 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513f641d-8de0-4dfd-bb1d-9da15060b7a8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:43:38.590620 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513f641d-8de0-4dfd-bb1d-9da15060b7a8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:38.592619 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513f641d-8de0-4dfd-bb1d-9da15060b7a8 None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:38.610130 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 531/1044] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Oct 9 00:43:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 09 00:43:38.617615 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ca23d2-7023-4b1d-ae09-63accafb0f30 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:38.742345 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ca23d2-7023-4b1d-ae09-63accafb0f30 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:38.752067 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513f641d-8de0-4dfd-bb1d-9da15060b7a8 None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:38.796766 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00a41a6-5c2f-468c-aa8f-987331e1d077 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:38.797752 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00a41a6-5c2f-468c-aa8f-987331e1d077 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:38.798103 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00a41a6-5c2f-468c-aa8f-987331e1d077 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:38.798537 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00a41a6-5c2f-468c-aa8f-987331e1d077 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:38.809360 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00a41a6-5c2f-468c-aa8f-987331e1d077 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:38.810846 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00a41a6-5c2f-468c-aa8f-987331e1d077 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:38.823341 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application [None req-a00a41a6-5c2f-468c-aa8f-987331e1d077 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 09 00:43:38.823341 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:43:38.823341 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:43:38.823341 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:43:38.823341 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:43:38.823341 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:43:38.823341 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:43:38.823341 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:43:38.823341 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:43:38.823341 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:43:38.823341 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:43:38.823341 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:43:38.823341 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 09 00:43:38.823341 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 09 00:43:38.823341 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 09 00:43:38.824368 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 09 00:43:38.824368 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:43:38.824368 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:43:38.824368 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:43:38.824368 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:43:38.824368 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:43:38.824368 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:43:38.824368 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:43:38.824368 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application with Lock( Oct 09 00:43:38.824368 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:43:38.824368 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:43:38.824368 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:43:38.824368 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:43:38.824368 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:43:38.824368 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:43:38.824368 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:43:38.824368 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:43:38.825274 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 09 00:43:38.825274 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 09 00:43:38.825274 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 09 00:43:38.825274 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 09 00:43:38.825274 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 09 00:43:38.825274 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 09 00:43:38.825274 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 09 00:43:38.825274 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application Oct 09 00:43:38.825274 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 514/1045] 10.222.0.15 () {56 vars in 1111 bytes} [Sun Oct 9 00:43:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:43:38.831136 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00a41a6-5c2f-468c-aa8f-987331e1d077 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:38.882820 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:38.883831 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513f641d-8de0-4dfd-bb1d-9da15060b7a8 None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:38.921164 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3581756-6bb4-434c-bf70-7f4c24fcc21f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:38.922165 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3581756-6bb4-434c-bf70-7f4c24fcc21f None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:38.922589 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3581756-6bb4-434c-bf70-7f4c24fcc21f None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:38.923015 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3581756-6bb4-434c-bf70-7f4c24fcc21f None admin] PATH_INFO: `/v3/services/image` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:38.923795 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3581756-6bb4-434c-bf70-7f4c24fcc21f None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:38.925573 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3581756-6bb4-434c-bf70-7f4c24fcc21f None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:38.936050 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application [None req-a3581756-6bb4-434c-bf70-7f4c24fcc21f None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 09 00:43:38.936050 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:43:38.936050 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 09 00:43:38.936050 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 09 00:43:38.936050 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 09 00:43:38.936050 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 09 00:43:38.936050 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 09 00:43:38.936050 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 09 00:43:38.936050 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 09 00:43:38.936050 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Oct 09 00:43:38.936050 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 09 00:43:38.936050 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Oct 09 00:43:38.936050 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:43:38.936050 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:43:38.936050 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:43:38.936050 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:43:38.936050 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:43:38.937336 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:43:38.937336 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:43:38.937336 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:43:38.937336 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:43:38.937336 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:43:38.937336 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:43:38.937336 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 09 00:43:38.937336 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 09 00:43:38.937336 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 09 00:43:38.937336 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 09 00:43:38.937336 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:43:38.937336 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:43:38.937336 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:43:38.937336 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:43:38.937336 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:43:38.937336 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:43:38.938384 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:43:38.938384 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application with Lock( Oct 09 00:43:38.938384 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:43:38.938384 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:43:38.938384 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:43:38.938384 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:43:38.938384 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:43:38.938384 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:43:38.938384 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:43:38.938384 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:43:38.938384 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 09 00:43:38.938384 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 09 00:43:38.938384 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 09 00:43:38.938384 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Oct 09 00:43:38.941286 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 532/1046] 10.222.0.15 () {56 vars in 1105 bytes} [Sun Oct 9 00:43:38 2022] GET /identity/v3/services/image => generated 86 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:43:38.947333 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00a41a6-5c2f-468c-aa8f-987331e1d077 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:38.948047 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3581756-6bb4-434c-bf70-7f4c24fcc21f None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:38.976608 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:38.988142 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15aa278c-522a-41a3-8760-e2689a6770de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:38.988766 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15aa278c-522a-41a3-8760-e2689a6770de None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:38.989042 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15aa278c-522a-41a3-8760-e2689a6770de None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:38.989313 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15aa278c-522a-41a3-8760-e2689a6770de None admin] PATH_INFO: `/v3/projects` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:38.990012 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15aa278c-522a-41a3-8760-e2689a6770de None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:43:38.990312 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15aa278c-522a-41a3-8760-e2689a6770de None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:38.991948 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15aa278c-522a-41a3-8760-e2689a6770de None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:39.004878 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 515/1047] 10.222.0.15 () {56 vars in 1148 bytes} [Sun Oct 9 00:43:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 09 00:43:39.010987 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15aa278c-522a-41a3-8760-e2689a6770de None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:39.062732 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3581756-6bb4-434c-bf70-7f4c24fcc21f None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:39.098597 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8883f46b-0efc-49b3-bed6-7afdad9c2cce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:39.099633 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8883f46b-0efc-49b3-bed6-7afdad9c2cce None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:39.100262 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8883f46b-0efc-49b3-bed6-7afdad9c2cce None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:39.100745 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8883f46b-0efc-49b3-bed6-7afdad9c2cce None admin] PATH_INFO: `/v3/services` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:39.101489 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8883f46b-0efc-49b3-bed6-7afdad9c2cce None admin] RBAC: Adding query filter params (name=image) {{(pid=81525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:43:39.101791 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8883f46b-0efc-49b3-bed6-7afdad9c2cce None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:39.103181 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8883f46b-0efc-49b3-bed6-7afdad9c2cce None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:39.109342 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 533/1048] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Oct 9 00:43:38 2022] GET /identity/v3/services?name=image => generated 122 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 09 00:43:39.114806 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8883f46b-0efc-49b3-bed6-7afdad9c2cce None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:39.120020 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15aa278c-522a-41a3-8760-e2689a6770de None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:39.123676 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:39.159542 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749df537-8af2-4575-ba2a-5a3a28555044 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:39.160174 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749df537-8af2-4575-ba2a-5a3a28555044 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:39.160453 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749df537-8af2-4575-ba2a-5a3a28555044 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:39.160727 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749df537-8af2-4575-ba2a-5a3a28555044 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:39.161488 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749df537-8af2-4575-ba2a-5a3a28555044 None admin] RBAC: Adding query filter params (role.id=0a44a4718e6a4dd48874221bee2f6b20, scope.project.id=f148d39ced534860abfbe8fc3f98ace4, user.id=4ac83d57fba841e0a666710732249c49) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:43:39.161780 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749df537-8af2-4575-ba2a-5a3a28555044 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:39.163957 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749df537-8af2-4575-ba2a-5a3a28555044 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:39.171786 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 516/1049] 10.222.0.15 () {56 vars in 1374 bytes} [Sun Oct 9 00:43:39 2022] GET /identity/v3/role_assignments?user.id=4ac83d57fba841e0a666710732249c49&scope.project.id=f148d39ced534860abfbe8fc3f98ace4&role.id=0a44a4718e6a4dd48874221bee2f6b20 => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 09 00:43:39.222518 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:39.242275 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8883f46b-0efc-49b3-bed6-7afdad9c2cce None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:39.285014 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce112678-e7fa-4126-82d7-a0b418d11689 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:39.285671 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce112678-e7fa-4126-82d7-a0b418d11689 None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:39.285952 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce112678-e7fa-4126-82d7-a0b418d11689 None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:39.286224 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce112678-e7fa-4126-82d7-a0b418d11689 None admin] PATH_INFO: `/v3/services` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:39.287112 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce112678-e7fa-4126-82d7-a0b418d11689 None admin] RBAC: Adding query filter params (type=image) {{(pid=81525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:43:39.287433 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce112678-e7fa-4126-82d7-a0b418d11689 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:39.288887 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce112678-e7fa-4126-82d7-a0b418d11689 None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:39.299781 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 534/1050] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Oct 9 00:43:39 2022] GET /identity/v3/services?type=image => generated 350 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 09 00:43:39.301210 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749df537-8af2-4575-ba2a-5a3a28555044 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:39.425590 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749df537-8af2-4575-ba2a-5a3a28555044 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:39.469010 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2e9eff-196f-45be-ac80-c17e76084558 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:39.469635 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2e9eff-196f-45be-ac80-c17e76084558 None admin] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:39.469909 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2e9eff-196f-45be-ac80-c17e76084558 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:39.470173 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2e9eff-196f-45be-ac80-c17e76084558 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:39.470862 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2e9eff-196f-45be-ac80-c17e76084558 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:39.472279 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2e9eff-196f-45be-ac80-c17e76084558 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:39.503297 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 517/1051] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Oct 9 00:43:39 2022] POST /identity/v3/endpoints => generated 327 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 09 00:43:40.228905 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628420fd-9994-4498-b23f-6209ff132526 None None] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:40.229495 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628420fd-9994-4498-b23f-6209ff132526 None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:40.229495 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628420fd-9994-4498-b23f-6209ff132526 None None] PATH_INFO: `/` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:40.231014 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 535/1052] 10.222.0.15 () {54 vars in 927 bytes} [Sun Oct 9 00:43:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:43:40.236485 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3430c1-2ae7-4e14-bd99-2cccf0b1b878 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:40.236925 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3430c1-2ae7-4e14-bd99-2cccf0b1b878 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:40.237010 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3430c1-2ae7-4e14-bd99-2cccf0b1b878 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:40.256554 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-ba3430c1-2ae7-4e14-bd99-2cccf0b1b878 None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:43:40.257954 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-ba3430c1-2ae7-4e14-bd99-2cccf0b1b878 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:43:40.285283 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:40.377580 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 518/1053] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Oct 9 00:43:40 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 09 00:43:40.649072 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628420fd-9994-4498-b23f-6209ff132526 None None] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:40.756414 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628420fd-9994-4498-b23f-6209ff132526 None None] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:40.796871 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd93164-0131-4c8b-a29e-c8ff005871fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:40.797532 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd93164-0131-4c8b-a29e-c8ff005871fb None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:40.797804 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd93164-0131-4c8b-a29e-c8ff005871fb None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:40.798068 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd93164-0131-4c8b-a29e-c8ff005871fb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:40.810761 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd93164-0131-4c8b-a29e-c8ff005871fb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 09 00:43:40.815705 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application [None req-0fd93164-0131-4c8b-a29e-c8ff005871fb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 09 00:43:40.815705 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:43:40.815705 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:43:40.815705 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:43:40.815705 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:43:40.815705 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:43:40.815705 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:43:40.815705 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:43:40.815705 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:43:40.815705 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:43:40.815705 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:43:40.815705 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:43:40.815705 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 09 00:43:40.815705 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 09 00:43:40.815705 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 09 00:43:40.815705 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 09 00:43:40.816860 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 09 00:43:40.816860 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 09 00:43:40.816860 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 09 00:43:40.816860 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 09 00:43:40.816860 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:43:40.816860 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:43:40.816860 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:43:40.816860 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:43:40.816860 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:43:40.816860 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:43:40.816860 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:43:40.816860 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application with Lock( Oct 09 00:43:40.816860 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:43:40.816860 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:43:40.816860 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:43:40.816860 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:43:40.817856 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:43:40.817856 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:43:40.817856 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:43:40.817856 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:43:40.817856 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 09 00:43:40.817856 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 09 00:43:40.817856 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 09 00:43:40.817856 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 09 00:43:40.817856 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 09 00:43:40.817856 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 09 00:43:40.817856 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 09 00:43:40.817856 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Oct 09 00:43:40.817856 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 536/1054] 10.222.0.15 () {56 vars in 1096 bytes} [Sun Oct 9 00:43:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:43:40.823233 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3430c1-2ae7-4e14-bd99-2cccf0b1b878 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:40.939917 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3430c1-2ae7-4e14-bd99-2cccf0b1b878 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:40.976922 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d6106f-1fb8-4e1b-b2ec-dcc6a5e34d6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:40.977530 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d6106f-1fb8-4e1b-b2ec-dcc6a5e34d6b None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:40.977800 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d6106f-1fb8-4e1b-b2ec-dcc6a5e34d6b None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:40.978066 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d6106f-1fb8-4e1b-b2ec-dcc6a5e34d6b None admin] PATH_INFO: `/v3/roles` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:40.978746 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d6106f-1fb8-4e1b-b2ec-dcc6a5e34d6b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:43:40.979030 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d6106f-1fb8-4e1b-b2ec-dcc6a5e34d6b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:40.980452 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d6106f-1fb8-4e1b-b2ec-dcc6a5e34d6b None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:40.989568 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 519/1055] 10.222.0.15 () {56 vars in 1099 bytes} [Sun Oct 9 00:43:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:43:40.995690 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd93164-0131-4c8b-a29e-c8ff005871fb None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:41.009264 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:41.119006 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd93164-0131-4c8b-a29e-c8ff005871fb None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:41.178011 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5619354-aa49-49bc-861b-96c0ff91a9c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:41.179071 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5619354-aa49-49bc-861b-96c0ff91a9c5 None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:41.179574 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5619354-aa49-49bc-861b-96c0ff91a9c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:41.180040 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5619354-aa49-49bc-861b-96c0ff91a9c5 None admin] PATH_INFO: `/v3/users/67f5869b15444a23be60863bb6adf669` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:41.204140 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5619354-aa49-49bc-861b-96c0ff91a9c5 None admin] RBAC: Authorizing `identity:get_user(user_id=67f5869b15444a23be60863bb6adf669)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:41.206802 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5619354-aa49-49bc-861b-96c0ff91a9c5 None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:41.214963 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 537/1056] 10.222.0.15 () {56 vars in 1177 bytes} [Sun Oct 9 00:43:40 2022] GET /identity/v3/users/67f5869b15444a23be60863bb6adf669 => generated 285 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:43:41.216470 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d6106f-1fb8-4e1b-b2ec-dcc6a5e34d6b None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:41.235113 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:41.327641 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d6106f-1fb8-4e1b-b2ec-dcc6a5e34d6b None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:41.341236 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219332e4-6311-449e-9fdb-cee564a7f918 None None] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:41.341811 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219332e4-6311-449e-9fdb-cee564a7f918 None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:41.341811 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219332e4-6311-449e-9fdb-cee564a7f918 None None] PATH_INFO: `/` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:41.343130 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 538/1057] 10.222.0.15 () {54 vars in 927 bytes} [Sun Oct 9 00:43:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:43:41.348300 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6726eb-26c8-4e22-929a-72de897c873d None None] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:41.348583 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6726eb-26c8-4e22-929a-72de897c873d None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:41.348852 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6726eb-26c8-4e22-929a-72de897c873d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:41.367243 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.auth.core [None req-ec6726eb-26c8-4e22-929a-72de897c873d None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:43:41.368460 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-ec6726eb-26c8-4e22-929a-72de897c873d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:43:41.370270 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcd6b9a-9a88-409f-8463-db029a87c7bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:41.370885 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcd6b9a-9a88-409f-8463-db029a87c7bb None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:41.371155 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcd6b9a-9a88-409f-8463-db029a87c7bb None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:41.371441 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcd6b9a-9a88-409f-8463-db029a87c7bb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:41.437988 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:41.444627 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 539/1058] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Oct 9 00:43:41 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 09 00:43:41.448706 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcd6b9a-9a88-409f-8463-db029a87c7bb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:41.450183 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcd6b9a-9a88-409f-8463-db029a87c7bb None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:41.465105 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:41.554720 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 520/1059] 10.222.0.15 () {58 vars in 1282 bytes} [Sun Oct 9 00:43:41 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 09 00:43:41.560813 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6726eb-26c8-4e22-929a-72de897c873d None None] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:41.667311 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6726eb-26c8-4e22-929a-72de897c873d None None] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:41.703975 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c4d49e-0647-4781-90fa-0fcbd9d16920 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:41.704506 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcd6b9a-9a88-409f-8463-db029a87c7bb None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:41.704624 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c4d49e-0647-4781-90fa-0fcbd9d16920 None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:41.704885 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c4d49e-0647-4781-90fa-0fcbd9d16920 None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:41.705149 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c4d49e-0647-4781-90fa-0fcbd9d16920 None admin] PATH_INFO: `/v3/projects/8f61f695e9a6461fa2df8224a50ab50a` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:41.706286 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c4d49e-0647-4781-90fa-0fcbd9d16920 None admin] RBAC: Authorizing `identity:get_project(project_id=8f61f695e9a6461fa2df8224a50ab50a)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:41.707792 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c4d49e-0647-4781-90fa-0fcbd9d16920 None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:41.711638 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 540/1060] 10.222.0.15 () {56 vars in 1186 bytes} [Sun Oct 9 00:43:41 2022] GET /identity/v3/projects/8f61f695e9a6461fa2df8224a50ab50a => generated 311 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:43:41.716188 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c4d49e-0647-4781-90fa-0fcbd9d16920 None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:41.792241 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:41.817542 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcd6b9a-9a88-409f-8463-db029a87c7bb None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:41.832139 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:41.832436 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c4d49e-0647-4781-90fa-0fcbd9d16920 None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:41.855021 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf4fe9c-1e9d-4e8f-adac-68adf6de143a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:41.855704 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf4fe9c-1e9d-4e8f-adac-68adf6de143a None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:41.855979 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf4fe9c-1e9d-4e8f-adac-68adf6de143a None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:41.856246 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf4fe9c-1e9d-4e8f-adac-68adf6de143a None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:41.866908 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf4fe9c-1e9d-4e8f-adac-68adf6de143a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 09 00:43:41.867827 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace89858-ee1a-4880-94c5-b3a323ce3324 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:41.868437 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace89858-ee1a-4880-94c5-b3a323ce3324 None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:41.868713 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace89858-ee1a-4880-94c5-b3a323ce3324 None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:41.868983 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace89858-ee1a-4880-94c5-b3a323ce3324 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:41.869706 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace89858-ee1a-4880-94c5-b3a323ce3324 None admin] RBAC: Adding query filter params (role.id=f69dddf26daf4dd79d4c962beb877af5, scope.project.id=8f61f695e9a6461fa2df8224a50ab50a, user.id=67f5869b15444a23be60863bb6adf669) {{(pid=81525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:43:41.870011 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace89858-ee1a-4880-94c5-b3a323ce3324 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:41.871494 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace89858-ee1a-4880-94c5-b3a323ce3324 None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:41.871801 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application [None req-fbf4fe9c-1e9d-4e8f-adac-68adf6de143a None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 09 00:43:41.871801 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:43:41.871801 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:43:41.871801 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:43:41.871801 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:43:41.871801 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:43:41.871801 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:43:41.871801 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:43:41.871801 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:43:41.871801 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:43:41.871801 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:43:41.871801 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:43:41.871801 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 09 00:43:41.871801 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 09 00:43:41.871801 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 09 00:43:41.871801 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 09 00:43:41.873339 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 09 00:43:41.873339 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 09 00:43:41.873339 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 09 00:43:41.873339 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 09 00:43:41.873339 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:43:41.873339 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:43:41.873339 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:43:41.873339 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:43:41.873339 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:43:41.873339 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:43:41.873339 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:43:41.873339 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application with Lock( Oct 09 00:43:41.873339 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:43:41.873339 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:43:41.873339 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:43:41.873339 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:43:41.874243 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:43:41.874243 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:43:41.874243 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:43:41.874243 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:43:41.874243 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 09 00:43:41.874243 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 09 00:43:41.874243 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 09 00:43:41.874243 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 09 00:43:41.874243 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 09 00:43:41.874243 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 09 00:43:41.874243 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 09 00:43:41.874243 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application Oct 09 00:43:41.874243 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 521/1061] 10.222.0.15 () {56 vars in 1120 bytes} [Sun Oct 9 00:43:41 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 09 00:43:41.874989 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025ced93-0ced-4152-8e15-6c02cf2a24df None None] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:41.875184 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025ced93-0ced-4152-8e15-6c02cf2a24df None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:41.875771 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025ced93-0ced-4152-8e15-6c02cf2a24df None None] PATH_INFO: `/` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:41.877963 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 522/1062] 10.222.0.15 () {54 vars in 927 bytes} [Sun Oct 9 00:43:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:43:41.879236 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025ced93-0ced-4152-8e15-6c02cf2a24df None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:41.883024 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 541/1063] 10.222.0.15 () {56 vars in 1374 bytes} [Sun Oct 9 00:43:41 2022] GET /identity/v3/role_assignments?user.id=67f5869b15444a23be60863bb6adf669&scope.project.id=8f61f695e9a6461fa2df8224a50ab50a&role.id=f69dddf26daf4dd79d4c962beb877af5 => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 09 00:43:41.884373 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53142fdf-0e44-4536-bd1c-91511a2aee4b None None] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:41.884655 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53142fdf-0e44-4536-bd1c-91511a2aee4b None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:41.884919 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53142fdf-0e44-4536-bd1c-91511a2aee4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:41.905807 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.auth.core [None req-53142fdf-0e44-4536-bd1c-91511a2aee4b None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:43:41.907108 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-53142fdf-0e44-4536-bd1c-91511a2aee4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:43:41.981855 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 542/1064] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Oct 9 00:43:41 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 09 00:43:42.006339 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025ced93-0ced-4152-8e15-6c02cf2a24df None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:42.045658 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a842ce5-4499-4b40-961a-0c40ec8c5733 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:42.046290 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a842ce5-4499-4b40-961a-0c40ec8c5733 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:42.046566 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a842ce5-4499-4b40-961a-0c40ec8c5733 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:42.046990 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a842ce5-4499-4b40-961a-0c40ec8c5733 None admin] PATH_INFO: `/v3/roles` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:42.047540 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a842ce5-4499-4b40-961a-0c40ec8c5733 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:43:42.047836 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a842ce5-4499-4b40-961a-0c40ec8c5733 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:42.049266 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a842ce5-4499-4b40-961a-0c40ec8c5733 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:42.063352 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 523/1065] 10.222.0.15 () {56 vars in 1115 bytes} [Sun Oct 9 00:43:41 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 09 00:43:42.065188 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53142fdf-0e44-4536-bd1c-91511a2aee4b None None] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:42.128540 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:42.172855 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53142fdf-0e44-4536-bd1c-91511a2aee4b None None] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:42.208511 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa98340-3220-469b-a8a5-01bfb15ee31d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:42.209187 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa98340-3220-469b-a8a5-01bfb15ee31d None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:42.209461 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa98340-3220-469b-a8a5-01bfb15ee31d None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:42.209735 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa98340-3220-469b-a8a5-01bfb15ee31d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:42.220100 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa98340-3220-469b-a8a5-01bfb15ee31d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:42.221568 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa98340-3220-469b-a8a5-01bfb15ee31d None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:42.236736 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application [None req-1aa98340-3220-469b-a8a5-01bfb15ee31d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:43:42.236736 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:43:42.236736 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:43:42.236736 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:43:42.236736 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:43:42.236736 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:43:42.236736 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:43:42.236736 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:43:42.236736 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:43:42.236736 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:43:42.236736 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:43:42.236736 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:43:42.236736 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 09 00:43:42.236736 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 09 00:43:42.236736 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 09 00:43:42.236736 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 09 00:43:42.244265 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:43:42.244265 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:43:42.244265 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:43:42.244265 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:43:42.244265 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:43:42.244265 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:43:42.244265 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:43:42.244265 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application with Lock( Oct 09 00:43:42.244265 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:43:42.244265 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:43:42.244265 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:43:42.244265 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:43:42.244265 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:43:42.244265 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:43:42.244265 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:43:42.244265 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:43:42.244265 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 09 00:43:42.245250 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 09 00:43:42.245250 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:43:42.245250 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Oct 09 00:43:42.245250 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 543/1066] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Oct 9 00:43:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 09 00:43:42.245501 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a842ce5-4499-4b40-961a-0c40ec8c5733 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:42.249516 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa98340-3220-469b-a8a5-01bfb15ee31d None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:42.283405 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:42.352998 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa98340-3220-469b-a8a5-01bfb15ee31d None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:42.353700 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a842ce5-4499-4b40-961a-0c40ec8c5733 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:42.368275 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:42.390686 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6728dab-106c-4244-b0cc-4477a48d272a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:42.391337 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6728dab-106c-4244-b0cc-4477a48d272a None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:42.391620 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6728dab-106c-4244-b0cc-4477a48d272a None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:42.391891 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6728dab-106c-4244-b0cc-4477a48d272a None admin] PATH_INFO: `/v3/domains` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:42.392143 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f878b1-b166-48eb-9174-94d7b7e8443c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:42.392553 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6728dab-106c-4244-b0cc-4477a48d272a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:43:42.392767 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f878b1-b166-48eb-9174-94d7b7e8443c None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:42.392865 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6728dab-106c-4244-b0cc-4477a48d272a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:42.393034 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f878b1-b166-48eb-9174-94d7b7e8443c None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:42.393358 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f878b1-b166-48eb-9174-94d7b7e8443c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:42.394260 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6728dab-106c-4244-b0cc-4477a48d272a None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:42.407502 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 524/1067] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Oct 9 00:43:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:43:42.413238 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6728dab-106c-4244-b0cc-4477a48d272a None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:42.468995 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f878b1-b166-48eb-9174-94d7b7e8443c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:42.470463 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f878b1-b166-48eb-9174-94d7b7e8443c None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:42.515192 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:42.525599 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6728dab-106c-4244-b0cc-4477a48d272a None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:42.566004 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0154af8e-0887-4b04-b7b8-db1ebab4d3f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:42.566918 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0154af8e-0887-4b04-b7b8-db1ebab4d3f0 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:42.567190 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0154af8e-0887-4b04-b7b8-db1ebab4d3f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:42.567493 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0154af8e-0887-4b04-b7b8-db1ebab4d3f0 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:42.575168 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0154af8e-0887-4b04-b7b8-db1ebab4d3f0 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:42.579328 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 544/1068] 10.222.0.15 () {58 vars in 1282 bytes} [Sun Oct 9 00:43:42 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 09 00:43:42.579586 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0154af8e-0887-4b04-b7b8-db1ebab4d3f0 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:42.581880 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f878b1-b166-48eb-9174-94d7b7e8443c None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:42.589897 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application [None req-0154af8e-0887-4b04-b7b8-db1ebab4d3f0 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 09 00:43:42.589897 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:43:42.589897 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:43:42.589897 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:43:42.589897 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:43:42.589897 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:43:42.589897 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:43:42.589897 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:43:42.589897 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:43:42.589897 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:43:42.589897 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:43:42.589897 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:43:42.589897 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 09 00:43:42.589897 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 09 00:43:42.589897 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 09 00:43:42.589897 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 09 00:43:42.591120 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:43:42.591120 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:43:42.591120 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 09 00:43:42.591120 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 09 00:43:42.591120 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 09 00:43:42.591120 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 09 00:43:42.591120 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:43:42.591120 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:43:42.591120 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:43:42.591120 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:43:42.591120 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:43:42.591120 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application with Lock( Oct 09 00:43:42.591120 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:43:42.591120 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:43:42.591120 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:43:42.591120 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:43:42.591120 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:43:42.591120 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:43:42.592296 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:43:42.592296 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:43:42.592296 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 09 00:43:42.592296 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 09 00:43:42.592296 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 09 00:43:42.592296 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 09 00:43:42.592296 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 09 00:43:42.592296 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 09 00:43:42.592296 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 09 00:43:42.592296 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application Oct 09 00:43:42.592296 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 525/1069] 10.222.0.15 () {56 vars in 1093 bytes} [Sun Oct 9 00:43:42 2022] GET /identity/v3/users/nova => generated 82 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 09 00:43:42.596970 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0154af8e-0887-4b04-b7b8-db1ebab4d3f0 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:42.601000 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:42.694129 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f878b1-b166-48eb-9174-94d7b7e8443c None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:42.707849 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0154af8e-0887-4b04-b7b8-db1ebab4d3f0 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:42.730690 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81381c27-1b75-4f45-94a8-4b88a242c182 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:42.731380 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81381c27-1b75-4f45-94a8-4b88a242c182 None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:42.731657 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81381c27-1b75-4f45-94a8-4b88a242c182 None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:42.731926 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81381c27-1b75-4f45-94a8-4b88a242c182 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:42.742669 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81381c27-1b75-4f45-94a8-4b88a242c182 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:42.744156 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81381c27-1b75-4f45-94a8-4b88a242c182 None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:42.745608 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb27721-7bf0-4437-812b-cfc2f4ffdce7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:42.746597 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb27721-7bf0-4437-812b-cfc2f4ffdce7 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:42.747440 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb27721-7bf0-4437-812b-cfc2f4ffdce7 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:42.747860 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb27721-7bf0-4437-812b-cfc2f4ffdce7 None admin] PATH_INFO: `/v3/users` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:42.748783 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb27721-7bf0-4437-812b-cfc2f4ffdce7 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:43:42.749247 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb27721-7bf0-4437-812b-cfc2f4ffdce7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:42.750902 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb27721-7bf0-4437-812b-cfc2f4ffdce7 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:42.760757 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application [None req-81381c27-1b75-4f45-94a8-4b88a242c182 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:43:42.760757 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:43:42.760757 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:43:42.760757 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:43:42.760757 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:43:42.760757 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:43:42.760757 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:43:42.760757 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:43:42.760757 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:43:42.760757 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:43:42.760757 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:43:42.760757 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:43:42.760757 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 09 00:43:42.760757 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 09 00:43:42.760757 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 09 00:43:42.760757 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 09 00:43:42.761879 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:43:42.761879 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:43:42.761879 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:43:42.761879 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:43:42.761879 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:43:42.761879 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:43:42.761879 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:43:42.761879 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application with Lock( Oct 09 00:43:42.761879 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:43:42.761879 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:43:42.761879 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:43:42.761879 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:43:42.761879 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:43:42.761879 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:43:42.761879 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:43:42.761879 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:43:42.761879 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 09 00:43:42.762804 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 09 00:43:42.762804 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:43:42.762804 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Oct 09 00:43:42.762804 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 545/1070] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Oct 9 00:43:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 09 00:43:42.769994 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81381c27-1b75-4f45-94a8-4b88a242c182 None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:42.777659 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 526/1071] 10.222.0.15 () {56 vars in 1133 bytes} [Sun Oct 9 00:43:42 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 09 00:43:42.783989 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb27721-7bf0-4437-812b-cfc2f4ffdce7 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:42.800029 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:42.840820 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:42.883483 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81381c27-1b75-4f45-94a8-4b88a242c182 None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:42.901911 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb27721-7bf0-4437-812b-cfc2f4ffdce7 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:42.916986 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347e3127-8bec-4169-b93b-f7732a4b6784 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:42.917605 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347e3127-8bec-4169-b93b-f7732a4b6784 None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:42.917885 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347e3127-8bec-4169-b93b-f7732a4b6784 None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:42.918151 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347e3127-8bec-4169-b93b-f7732a4b6784 None admin] PATH_INFO: `/v3/domains` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:42.918817 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347e3127-8bec-4169-b93b-f7732a4b6784 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:43:42.919119 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347e3127-8bec-4169-b93b-f7732a4b6784 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:42.920537 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347e3127-8bec-4169-b93b-f7732a4b6784 None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:42.932515 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 546/1072] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Oct 9 00:43:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:43:42.940107 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1332ee-eea6-423c-aa23-44d8a0e1b1c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:42.940773 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1332ee-eea6-423c-aa23-44d8a0e1b1c7 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:42.941051 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1332ee-eea6-423c-aa23-44d8a0e1b1c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:42.941323 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1332ee-eea6-423c-aa23-44d8a0e1b1c7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:42.954135 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1332ee-eea6-423c-aa23-44d8a0e1b1c7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:42.955668 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1332ee-eea6-423c-aa23-44d8a0e1b1c7 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:42.972524 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application [None req-0f1332ee-eea6-423c-aa23-44d8a0e1b1c7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:43:42.972524 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:43:42.972524 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:43:42.972524 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:43:42.972524 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:43:42.972524 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:43:42.972524 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:43:42.972524 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:43:42.972524 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:43:42.972524 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:43:42.972524 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:43:42.972524 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:43:42.972524 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 09 00:43:42.972524 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 09 00:43:42.972524 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 09 00:43:42.972524 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 09 00:43:42.973552 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:43:42.973552 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:43:42.973552 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:43:42.973552 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:43:42.973552 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:43:42.973552 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:43:42.973552 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:43:42.973552 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application with Lock( Oct 09 00:43:42.973552 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:43:42.973552 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:43:42.973552 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:43:42.973552 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:43:42.973552 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:43:42.973552 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:43:42.973552 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:43:42.973552 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:43:42.973552 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 09 00:43:42.979790 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 09 00:43:42.979790 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:43:42.979790 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application Oct 09 00:43:42.979790 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 527/1073] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Oct 9 00:43:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 09 00:43:42.981694 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347e3127-8bec-4169-b93b-f7732a4b6784 None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:43.096530 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347e3127-8bec-4169-b93b-f7732a4b6784 None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:43.123650 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:43.137276 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d881689-d2eb-455e-b1ed-66df48bc33d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:43.138183 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d881689-d2eb-455e-b1ed-66df48bc33d5 None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:43.138454 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d881689-d2eb-455e-b1ed-66df48bc33d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:43.138731 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d881689-d2eb-455e-b1ed-66df48bc33d5 None admin] PATH_INFO: `/v3/domains` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:43.139435 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d881689-d2eb-455e-b1ed-66df48bc33d5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:43:43.139740 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d881689-d2eb-455e-b1ed-66df48bc33d5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:43.141167 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d881689-d2eb-455e-b1ed-66df48bc33d5 None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:43.154394 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 547/1074] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Oct 9 00:43:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:43:43.160525 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1332ee-eea6-423c-aa23-44d8a0e1b1c7 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:43.237024 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:43.277618 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1332ee-eea6-423c-aa23-44d8a0e1b1c7 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:43.311206 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4eb0e7-0b73-4e9d-b3d2-5c7589c4dc6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:43.311868 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4eb0e7-0b73-4e9d-b3d2-5c7589c4dc6d None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:43.312142 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4eb0e7-0b73-4e9d-b3d2-5c7589c4dc6d None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:43.312411 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4eb0e7-0b73-4e9d-b3d2-5c7589c4dc6d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:43.319200 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4eb0e7-0b73-4e9d-b3d2-5c7589c4dc6d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:43.320684 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4eb0e7-0b73-4e9d-b3d2-5c7589c4dc6d None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:43.332076 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application [None req-3d4eb0e7-0b73-4e9d-b3d2-5c7589c4dc6d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 09 00:43:43.332076 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:43:43.332076 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:43:43.332076 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:43:43.332076 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:43:43.332076 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:43:43.332076 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:43:43.332076 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:43:43.332076 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:43:43.332076 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:43:43.332076 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:43:43.332076 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:43:43.332076 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 09 00:43:43.332076 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 09 00:43:43.332076 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 09 00:43:43.333060 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 09 00:43:43.333060 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:43:43.333060 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:43:43.333060 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:43:43.333060 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:43:43.333060 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:43:43.333060 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:43:43.333060 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:43:43.333060 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application with Lock( Oct 09 00:43:43.333060 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:43:43.333060 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:43:43.333060 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:43:43.333060 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:43:43.333060 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:43:43.333060 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:43:43.333060 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:43:43.333060 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:43:43.334019 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 09 00:43:43.334019 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 09 00:43:43.334019 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 09 00:43:43.334019 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 09 00:43:43.334019 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 09 00:43:43.334019 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 09 00:43:43.334019 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 09 00:43:43.334019 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application Oct 09 00:43:43.334019 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 528/1075] 10.222.0.15 () {56 vars in 1111 bytes} [Sun Oct 9 00:43:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:43:43.339322 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d881689-d2eb-455e-b1ed-66df48bc33d5 None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:43.452551 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d881689-d2eb-455e-b1ed-66df48bc33d5 None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:43.489940 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2a99d4-cf9f-4616-8686-bdf646c8722d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:43.490691 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2a99d4-cf9f-4616-8686-bdf646c8722d None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:43.490961 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2a99d4-cf9f-4616-8686-bdf646c8722d None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:43.491213 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2a99d4-cf9f-4616-8686-bdf646c8722d None admin] PATH_INFO: `/v3/projects` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:43.491939 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2a99d4-cf9f-4616-8686-bdf646c8722d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:43:43.492232 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2a99d4-cf9f-4616-8686-bdf646c8722d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:43.493648 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2a99d4-cf9f-4616-8686-bdf646c8722d None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:43.506303 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 548/1076] 10.222.0.15 () {56 vars in 1148 bytes} [Sun Oct 9 00:43:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:43:43.512451 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4eb0e7-0b73-4e9d-b3d2-5c7589c4dc6d None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:43.623280 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4eb0e7-0b73-4e9d-b3d2-5c7589c4dc6d None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:43.646930 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:43.659073 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d50887-166f-49ae-a0b0-636eb512dcf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:43.659768 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d50887-166f-49ae-a0b0-636eb512dcf1 None admin] REQUEST_METHOD: `PUT` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:43.660041 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d50887-166f-49ae-a0b0-636eb512dcf1 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:43.660306 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d50887-166f-49ae-a0b0-636eb512dcf1 None admin] PATH_INFO: `/v3/projects/f148d39ced534860abfbe8fc3f98ace4/users/4ac83d57fba841e0a666710732249c49/roles/0a44a4718e6a4dd48874221bee2f6b20` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:43.662557 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d50887-166f-49ae-a0b0-636eb512dcf1 None admin] RBAC: Authorizing `identity:create_grant(project_id=f148d39ced534860abfbe8fc3f98ace4, user_id=4ac83d57fba841e0a666710732249c49, role_id=0a44a4718e6a4dd48874221bee2f6b20)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:43.664020 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d50887-166f-49ae-a0b0-636eb512dcf1 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:43.677909 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 529/1077] 10.222.0.15 () {58 vars in 1439 bytes} [Sun Oct 9 00:43:43 2022] PUT /identity/v3/projects/f148d39ced534860abfbe8fc3f98ace4/users/4ac83d57fba841e0a666710732249c49/roles/0a44a4718e6a4dd48874221bee2f6b20 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 00:43:44.053959 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d439e6bb-d5ff-4beb-8902-480b35af0e96 None None] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:44.054345 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d439e6bb-d5ff-4beb-8902-480b35af0e96 None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:44.054617 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d439e6bb-d5ff-4beb-8902-480b35af0e96 None None] PATH_INFO: `/` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:44.055997 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 549/1078] 10.222.0.15 () {54 vars in 927 bytes} [Sun Oct 9 00:43:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:43:44.061444 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755964bc-67c3-4e28-b69e-affb3f1c7e82 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:44.061729 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755964bc-67c3-4e28-b69e-affb3f1c7e82 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:44.062002 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755964bc-67c3-4e28-b69e-affb3f1c7e82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:44.080737 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-755964bc-67c3-4e28-b69e-affb3f1c7e82 None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:43:44.081936 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-755964bc-67c3-4e28-b69e-affb3f1c7e82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:43:44.151299 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 530/1079] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Oct 9 00:43:44 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 09 00:43:44.414997 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d439e6bb-d5ff-4beb-8902-480b35af0e96 None None] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:44.467121 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:44.528614 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d439e6bb-d5ff-4beb-8902-480b35af0e96 None None] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:44.566867 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a662ee06-170f-4440-b974-96381ee7df55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:44.567530 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a662ee06-170f-4440-b974-96381ee7df55 None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:44.567802 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a662ee06-170f-4440-b974-96381ee7df55 None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:44.568068 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a662ee06-170f-4440-b974-96381ee7df55 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:44.578788 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a662ee06-170f-4440-b974-96381ee7df55 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 09 00:43:44.583681 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application [None req-a662ee06-170f-4440-b974-96381ee7df55 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 09 00:43:44.583681 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:43:44.583681 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:43:44.583681 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:43:44.583681 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:43:44.583681 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:43:44.583681 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:43:44.583681 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:43:44.583681 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:43:44.583681 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:43:44.583681 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:43:44.583681 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:43:44.583681 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 09 00:43:44.583681 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 09 00:43:44.583681 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 09 00:43:44.583681 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 09 00:43:44.584691 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 09 00:43:44.584691 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 09 00:43:44.584691 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 09 00:43:44.584691 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 09 00:43:44.584691 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:43:44.584691 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:43:44.584691 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:43:44.584691 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:43:44.584691 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:43:44.584691 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:43:44.584691 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:43:44.584691 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application with Lock( Oct 09 00:43:44.584691 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:43:44.584691 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:43:44.584691 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:43:44.584691 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:43:44.586034 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:43:44.586034 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:43:44.586034 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:43:44.586034 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:43:44.586034 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 09 00:43:44.586034 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 09 00:43:44.586034 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 09 00:43:44.586034 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 09 00:43:44.586034 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 09 00:43:44.586034 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 09 00:43:44.586034 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 09 00:43:44.586034 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Oct 09 00:43:44.586034 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 550/1080] 10.222.0.15 () {56 vars in 1096 bytes} [Sun Oct 9 00:43:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:43:44.591128 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755964bc-67c3-4e28-b69e-affb3f1c7e82 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:44.694958 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755964bc-67c3-4e28-b69e-affb3f1c7e82 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:44.708964 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:44.731539 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e1593f-cac9-4283-9550-afb0eab46d36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:44.732150 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e1593f-cac9-4283-9550-afb0eab46d36 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:44.732424 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e1593f-cac9-4283-9550-afb0eab46d36 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:44.732691 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e1593f-cac9-4283-9550-afb0eab46d36 None admin] PATH_INFO: `/v3/roles` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:44.733352 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e1593f-cac9-4283-9550-afb0eab46d36 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:43:44.733655 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e1593f-cac9-4283-9550-afb0eab46d36 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:44.735030 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e1593f-cac9-4283-9550-afb0eab46d36 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:44.743222 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 531/1081] 10.222.0.15 () {56 vars in 1099 bytes} [Sun Oct 9 00:43:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:43:44.749584 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a662ee06-170f-4440-b974-96381ee7df55 None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:44.850263 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a662ee06-170f-4440-b974-96381ee7df55 None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:44.852636 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:44.884995 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b758161e-068f-44db-8bbe-9cddcf02417d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:44.885763 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b758161e-068f-44db-8bbe-9cddcf02417d None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:44.885896 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b758161e-068f-44db-8bbe-9cddcf02417d None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:44.886152 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b758161e-068f-44db-8bbe-9cddcf02417d None admin] PATH_INFO: `/v3/users/67f5869b15444a23be60863bb6adf669` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:44.887290 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b758161e-068f-44db-8bbe-9cddcf02417d None admin] RBAC: Authorizing `identity:get_user(user_id=67f5869b15444a23be60863bb6adf669)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:44.888764 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b758161e-068f-44db-8bbe-9cddcf02417d None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:44.890335 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 551/1082] 10.222.0.15 () {56 vars in 1177 bytes} [Sun Oct 9 00:43:44 2022] GET /identity/v3/users/67f5869b15444a23be60863bb6adf669 => generated 285 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:43:44.896365 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e1593f-cac9-4283-9550-afb0eab46d36 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:45.000798 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e1593f-cac9-4283-9550-afb0eab46d36 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:45.035456 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e15caa4-986c-464b-846c-461d15c8ac69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:45.036097 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e15caa4-986c-464b-846c-461d15c8ac69 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:45.036370 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e15caa4-986c-464b-846c-461d15c8ac69 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:45.036695 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e15caa4-986c-464b-846c-461d15c8ac69 None admin] PATH_INFO: `/v3/projects/8f61f695e9a6461fa2df8224a50ab50a` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:45.037853 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e15caa4-986c-464b-846c-461d15c8ac69 None admin] RBAC: Authorizing `identity:get_project(project_id=8f61f695e9a6461fa2df8224a50ab50a)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:45.039298 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e15caa4-986c-464b-846c-461d15c8ac69 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:45.040958 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 532/1083] 10.222.0.15 () {56 vars in 1186 bytes} [Sun Oct 9 00:43:44 2022] GET /identity/v3/projects/8f61f695e9a6461fa2df8224a50ab50a => generated 311 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 09 00:43:45.047286 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b758161e-068f-44db-8bbe-9cddcf02417d None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:45.149612 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b758161e-068f-44db-8bbe-9cddcf02417d None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:45.182635 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bea694-0e95-400a-a248-a05d08386621 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:45.183307 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bea694-0e95-400a-a248-a05d08386621 None admin] REQUEST_METHOD: `PUT` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:45.183584 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bea694-0e95-400a-a248-a05d08386621 None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:45.183864 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bea694-0e95-400a-a248-a05d08386621 None admin] PATH_INFO: `/v3/projects/8f61f695e9a6461fa2df8224a50ab50a/users/67f5869b15444a23be60863bb6adf669/roles/f69dddf26daf4dd79d4c962beb877af5` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:45.185818 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bea694-0e95-400a-a248-a05d08386621 None admin] RBAC: Authorizing `identity:create_grant(project_id=8f61f695e9a6461fa2df8224a50ab50a, user_id=67f5869b15444a23be60863bb6adf669, role_id=f69dddf26daf4dd79d4c962beb877af5)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:45.187281 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bea694-0e95-400a-a248-a05d08386621 None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:45.201738 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 552/1084] 10.222.0.15 () {58 vars in 1439 bytes} [Sun Oct 9 00:43:45 2022] PUT /identity/v3/projects/8f61f695e9a6461fa2df8224a50ab50a/users/67f5869b15444a23be60863bb6adf669/roles/f69dddf26daf4dd79d4c962beb877af5 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 00:43:45.810604 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b3b624-b47f-4d93-8075-ec6403e672fe None None] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:45.811149 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b3b624-b47f-4d93-8075-ec6403e672fe None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:45.811149 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b3b624-b47f-4d93-8075-ec6403e672fe None None] PATH_INFO: `/` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:45.812420 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 533/1085] 10.222.0.15 () {54 vars in 927 bytes} [Sun Oct 9 00:43:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:43:45.818155 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c2c202-c719-473d-a907-11e97db79532 None None] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:45.818618 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c2c202-c719-473d-a907-11e97db79532 None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:45.818712 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c2c202-c719-473d-a907-11e97db79532 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:45.838649 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.auth.core [None req-17c2c202-c719-473d-a907-11e97db79532 None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:43:45.839883 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-17c2c202-c719-473d-a907-11e97db79532 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:43:45.867429 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:45.913253 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 553/1086] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Oct 9 00:43:45 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 09 00:43:46.179047 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b3b624-b47f-4d93-8075-ec6403e672fe None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:46.226925 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:46.283541 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b3b624-b47f-4d93-8075-ec6403e672fe None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:46.317909 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd206bb-341e-46d6-b16b-ed7bb13b7763 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:46.318560 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd206bb-341e-46d6-b16b-ed7bb13b7763 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:46.318830 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd206bb-341e-46d6-b16b-ed7bb13b7763 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:46.319094 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd206bb-341e-46d6-b16b-ed7bb13b7763 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:46.330119 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd206bb-341e-46d6-b16b-ed7bb13b7763 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 09 00:43:46.335090 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application [None req-5fd206bb-341e-46d6-b16b-ed7bb13b7763 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 09 00:43:46.335090 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:43:46.335090 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:43:46.335090 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:43:46.335090 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:43:46.335090 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:43:46.335090 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:43:46.335090 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:43:46.335090 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:43:46.335090 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:43:46.335090 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:43:46.335090 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:43:46.335090 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 09 00:43:46.335090 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 09 00:43:46.335090 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 09 00:43:46.335090 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 09 00:43:46.336160 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 09 00:43:46.336160 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 09 00:43:46.336160 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 09 00:43:46.336160 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 09 00:43:46.336160 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:43:46.336160 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:43:46.336160 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:43:46.336160 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:43:46.336160 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:43:46.336160 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:43:46.336160 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:43:46.336160 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application with Lock( Oct 09 00:43:46.336160 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:43:46.336160 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:43:46.336160 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:43:46.336160 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:43:46.336997 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:43:46.336997 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:43:46.336997 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:43:46.336997 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:43:46.336997 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 09 00:43:46.336997 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 09 00:43:46.336997 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 09 00:43:46.336997 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 09 00:43:46.336997 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 09 00:43:46.336997 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 09 00:43:46.336997 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 09 00:43:46.336997 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application Oct 09 00:43:46.336997 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 534/1087] 10.222.0.15 () {56 vars in 1120 bytes} [Sun Oct 9 00:43:46 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:43:46.342415 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c2c202-c719-473d-a907-11e97db79532 None None] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:46.444835 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c2c202-c719-473d-a907-11e97db79532 None None] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:46.481805 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa43205-2a9f-4d81-a757-803f846ee11e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:46.482412 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa43205-2a9f-4d81-a757-803f846ee11e None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:46.482684 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa43205-2a9f-4d81-a757-803f846ee11e None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:46.482947 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa43205-2a9f-4d81-a757-803f846ee11e None admin] PATH_INFO: `/v3/roles` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:46.483625 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa43205-2a9f-4d81-a757-803f846ee11e None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:43:46.483913 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa43205-2a9f-4d81-a757-803f846ee11e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:46.485296 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa43205-2a9f-4d81-a757-803f846ee11e None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:46.494422 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 554/1088] 10.222.0.15 () {56 vars in 1115 bytes} [Sun Oct 9 00:43:46 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:43:46.501053 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd206bb-341e-46d6-b16b-ed7bb13b7763 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:46.603887 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd206bb-341e-46d6-b16b-ed7bb13b7763 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:46.606393 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:46.642977 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d650f16e-312a-4ed1-9c74-af38a4e48bea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:46.643686 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d650f16e-312a-4ed1-9c74-af38a4e48bea None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:46.643957 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d650f16e-312a-4ed1-9c74-af38a4e48bea None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:46.644225 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d650f16e-312a-4ed1-9c74-af38a4e48bea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:46.656475 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d650f16e-312a-4ed1-9c74-af38a4e48bea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:46.657950 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d650f16e-312a-4ed1-9c74-af38a4e48bea None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:46.674032 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application [None req-d650f16e-312a-4ed1-9c74-af38a4e48bea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:43:46.674032 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:43:46.674032 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:43:46.674032 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:43:46.674032 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:43:46.674032 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:43:46.674032 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:43:46.674032 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:43:46.674032 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:43:46.674032 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:43:46.674032 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:43:46.674032 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:43:46.674032 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 09 00:43:46.674032 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 09 00:43:46.674032 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 09 00:43:46.674032 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 09 00:43:46.675121 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:43:46.675121 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:43:46.675121 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:43:46.675121 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:43:46.675121 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:43:46.675121 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:43:46.675121 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:43:46.675121 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application with Lock( Oct 09 00:43:46.675121 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:43:46.675121 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:43:46.675121 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:43:46.675121 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:43:46.675121 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:43:46.675121 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:43:46.675121 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:43:46.675121 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:43:46.675121 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 09 00:43:46.676104 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 09 00:43:46.676104 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:43:46.676104 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application Oct 09 00:43:46.676104 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 535/1089] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Oct 9 00:43:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:43:46.681663 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa43205-2a9f-4d81-a757-803f846ee11e None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:46.711888 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:46.798670 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa43205-2a9f-4d81-a757-803f846ee11e None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:46.837179 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab355f1d-2640-441c-abbc-5fe402341c1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:46.837842 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab355f1d-2640-441c-abbc-5fe402341c1d None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:46.838040 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab355f1d-2640-441c-abbc-5fe402341c1d None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:46.838317 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab355f1d-2640-441c-abbc-5fe402341c1d None admin] PATH_INFO: `/v3/domains` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:46.838963 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab355f1d-2640-441c-abbc-5fe402341c1d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:43:46.839271 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab355f1d-2640-441c-abbc-5fe402341c1d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:46.840685 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab355f1d-2640-441c-abbc-5fe402341c1d None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:46.853342 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 555/1090] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Oct 9 00:43:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:43:46.859229 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d650f16e-312a-4ed1-9c74-af38a4e48bea None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:46.968478 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d650f16e-312a-4ed1-9c74-af38a4e48bea None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:47.008291 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43dab68-1de2-4ae8-b884-69eea93b4399 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:47.009026 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43dab68-1de2-4ae8-b884-69eea93b4399 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:47.009364 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43dab68-1de2-4ae8-b884-69eea93b4399 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:47.009693 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43dab68-1de2-4ae8-b884-69eea93b4399 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:47.017955 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43dab68-1de2-4ae8-b884-69eea93b4399 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:47.019437 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43dab68-1de2-4ae8-b884-69eea93b4399 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:47.030988 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application [None req-a43dab68-1de2-4ae8-b884-69eea93b4399 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 09 00:43:47.030988 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:43:47.030988 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:43:47.030988 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:43:47.030988 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:43:47.030988 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:43:47.030988 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:43:47.030988 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:43:47.030988 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:43:47.030988 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:43:47.030988 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:43:47.030988 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:43:47.030988 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 09 00:43:47.030988 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 09 00:43:47.030988 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 09 00:43:47.030988 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 09 00:43:47.032001 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:43:47.032001 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:43:47.032001 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 09 00:43:47.032001 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 09 00:43:47.032001 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 09 00:43:47.032001 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 09 00:43:47.032001 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:43:47.032001 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:43:47.032001 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:43:47.032001 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:43:47.032001 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:43:47.032001 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application with Lock( Oct 09 00:43:47.032001 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:43:47.032001 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:43:47.032001 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:43:47.032001 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:43:47.032001 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:43:47.032001 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:43:47.033392 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:43:47.033392 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:43:47.033392 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 09 00:43:47.033392 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 09 00:43:47.033392 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 09 00:43:47.033392 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 09 00:43:47.033392 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 09 00:43:47.033392 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 09 00:43:47.033392 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 09 00:43:47.033392 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application Oct 09 00:43:47.033392 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 536/1091] 10.222.0.15 () {56 vars in 1093 bytes} [Sun Oct 9 00:43:46 2022] GET /identity/v3/users/nova => generated 82 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:43:47.038126 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab355f1d-2640-441c-abbc-5fe402341c1d None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:47.122247 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:47.138502 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab355f1d-2640-441c-abbc-5fe402341c1d None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:47.175406 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab0a013-0943-4d03-8829-7a15f95068b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:47.176064 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab0a013-0943-4d03-8829-7a15f95068b5 None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:47.176317 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab0a013-0943-4d03-8829-7a15f95068b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:47.176586 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab0a013-0943-4d03-8829-7a15f95068b5 None admin] PATH_INFO: `/v3/users` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:47.177356 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab0a013-0943-4d03-8829-7a15f95068b5 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:43:47.177854 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab0a013-0943-4d03-8829-7a15f95068b5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:47.179401 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab0a013-0943-4d03-8829-7a15f95068b5 None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:47.201095 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 556/1092] 10.222.0.15 () {56 vars in 1133 bytes} [Sun Oct 9 00:43:47 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:43:47.207130 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43dab68-1de2-4ae8-b884-69eea93b4399 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:47.229162 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:47.321198 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43dab68-1de2-4ae8-b884-69eea93b4399 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:47.351587 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a452d0-8418-458e-88be-d8e9efbf8ba0 None None] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:47.352024 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a452d0-8418-458e-88be-d8e9efbf8ba0 None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:47.352446 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a452d0-8418-458e-88be-d8e9efbf8ba0 None None] PATH_INFO: `/` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:47.354870 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 557/1093] 10.222.0.15 () {54 vars in 927 bytes} [Sun Oct 9 00:43:47 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:43:47.360313 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c89b34c-975d-4644-8543-2e5e928661b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:47.360702 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f77b149-1404-45cc-bef0-3579958dd386 None None] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:47.360983 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f77b149-1404-45cc-bef0-3579958dd386 None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:47.361213 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c89b34c-975d-4644-8543-2e5e928661b0 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:47.361309 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f77b149-1404-45cc-bef0-3579958dd386 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:47.361629 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c89b34c-975d-4644-8543-2e5e928661b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:47.362036 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c89b34c-975d-4644-8543-2e5e928661b0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:47.380466 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.auth.core [None req-1f77b149-1404-45cc-bef0-3579958dd386 None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:43:47.381771 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-1f77b149-1404-45cc-bef0-3579958dd386 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:43:47.438202 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c89b34c-975d-4644-8543-2e5e928661b0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:47.440985 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c89b34c-975d-4644-8543-2e5e928661b0 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:47.464500 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 558/1094] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Oct 9 00:43:47 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 09 00:43:47.470872 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:47.570415 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 537/1095] 10.222.0.15 () {58 vars in 1282 bytes} [Sun Oct 9 00:43:47 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 09 00:43:47.576283 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f77b149-1404-45cc-bef0-3579958dd386 None None] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:47.646578 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:47.679962 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f77b149-1404-45cc-bef0-3579958dd386 None None] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:47.716977 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3ea19d-74c2-4c1d-9d61-734aefb72616 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:47.717630 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3ea19d-74c2-4c1d-9d61-734aefb72616 None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:47.717903 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3ea19d-74c2-4c1d-9d61-734aefb72616 None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:47.718172 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3ea19d-74c2-4c1d-9d61-734aefb72616 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:47.729794 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c89b34c-975d-4644-8543-2e5e928661b0 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:47.730057 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3ea19d-74c2-4c1d-9d61-734aefb72616 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:47.731332 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3ea19d-74c2-4c1d-9d61-734aefb72616 None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:47.749017 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application [None req-2f3ea19d-74c2-4c1d-9d61-734aefb72616 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:43:47.749017 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:43:47.749017 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:43:47.749017 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:43:47.749017 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:43:47.749017 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:43:47.749017 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:43:47.749017 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:43:47.749017 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:43:47.749017 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:43:47.749017 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:43:47.749017 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:43:47.749017 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 09 00:43:47.749017 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 09 00:43:47.749017 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 09 00:43:47.749017 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 09 00:43:47.750137 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:43:47.750137 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:43:47.750137 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:43:47.750137 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:43:47.750137 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:43:47.750137 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:43:47.750137 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:43:47.750137 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application with Lock( Oct 09 00:43:47.750137 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:43:47.750137 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:43:47.750137 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:43:47.750137 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:43:47.750137 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:43:47.750137 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:43:47.750137 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:43:47.750137 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:43:47.750137 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 09 00:43:47.751029 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 09 00:43:47.751029 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:43:47.751029 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Oct 09 00:43:47.751029 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 559/1096] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Oct 9 00:43:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:43:47.756381 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3ea19d-74c2-4c1d-9d61-734aefb72616 None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:47.850164 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c89b34c-975d-4644-8543-2e5e928661b0 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:47.871605 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:47.878061 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3ea19d-74c2-4c1d-9d61-734aefb72616 None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:47.896734 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fafab8-3033-4371-9bd6-1bf79abd5ac8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:47.897377 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fafab8-3033-4371-9bd6-1bf79abd5ac8 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:47.897646 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fafab8-3033-4371-9bd6-1bf79abd5ac8 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:47.897916 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fafab8-3033-4371-9bd6-1bf79abd5ac8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:47.905415 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:47.909979 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fafab8-3033-4371-9bd6-1bf79abd5ac8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 09 00:43:47.915016 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application [None req-77fafab8-3033-4371-9bd6-1bf79abd5ac8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 09 00:43:47.915016 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:43:47.915016 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:43:47.915016 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:43:47.915016 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:43:47.915016 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:43:47.915016 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:43:47.915016 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:43:47.915016 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:43:47.915016 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:43:47.915016 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:43:47.915016 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:43:47.915016 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 09 00:43:47.915016 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 09 00:43:47.915016 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 09 00:43:47.915016 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 09 00:43:47.916651 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 09 00:43:47.916651 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 09 00:43:47.916651 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 09 00:43:47.916651 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 09 00:43:47.916651 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:43:47.916651 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:43:47.916651 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:43:47.916651 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:43:47.916651 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:43:47.916651 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:43:47.916651 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:43:47.916651 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application with Lock( Oct 09 00:43:47.916651 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:43:47.916651 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:43:47.916651 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:43:47.916651 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:43:47.918274 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:43:47.918274 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:43:47.918274 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:43:47.918274 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:43:47.918274 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 09 00:43:47.918274 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 09 00:43:47.918274 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 09 00:43:47.918274 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 09 00:43:47.918274 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 09 00:43:47.918274 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 09 00:43:47.918274 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 09 00:43:47.918274 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application Oct 09 00:43:47.918274 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 538/1097] 10.222.0.15 () {56 vars in 1096 bytes} [Sun Oct 9 00:43:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:43:47.920527 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842347aa-8ad2-4e52-b551-fe987bb1b41c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:47.920527 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842347aa-8ad2-4e52-b551-fe987bb1b41c None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:47.920527 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842347aa-8ad2-4e52-b551-fe987bb1b41c None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:47.920527 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842347aa-8ad2-4e52-b551-fe987bb1b41c None admin] PATH_INFO: `/v3/domains` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:47.921428 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842347aa-8ad2-4e52-b551-fe987bb1b41c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:43:47.921428 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842347aa-8ad2-4e52-b551-fe987bb1b41c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:47.921428 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842347aa-8ad2-4e52-b551-fe987bb1b41c None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:47.925289 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fafab8-3033-4371-9bd6-1bf79abd5ac8 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:47.934854 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 560/1098] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Oct 9 00:43:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:43:47.940871 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842347aa-8ad2-4e52-b551-fe987bb1b41c None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:48.028267 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fafab8-3033-4371-9bd6-1bf79abd5ac8 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:48.040586 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842347aa-8ad2-4e52-b551-fe987bb1b41c None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:48.063618 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47413af7-95be-4533-bbf4-ea02e42713d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:48.064414 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47413af7-95be-4533-bbf4-ea02e42713d8 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:48.065040 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47413af7-95be-4533-bbf4-ea02e42713d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:48.065319 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47413af7-95be-4533-bbf4-ea02e42713d8 None admin] PATH_INFO: `/v3/roles` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:48.066154 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47413af7-95be-4533-bbf4-ea02e42713d8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:43:48.066454 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47413af7-95be-4533-bbf4-ea02e42713d8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:48.067882 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47413af7-95be-4533-bbf4-ea02e42713d8 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:48.077002 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 539/1099] 10.222.0.15 () {56 vars in 1099 bytes} [Sun Oct 9 00:43:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 09 00:43:48.083080 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c991339c-5535-4166-ab72-fe2fadd880fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:48.083992 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c991339c-5535-4166-ab72-fe2fadd880fe None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:48.084268 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c991339c-5535-4166-ab72-fe2fadd880fe None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:48.084538 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c991339c-5535-4166-ab72-fe2fadd880fe None admin] PATH_INFO: `/v3/projects/service` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:48.085560 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47413af7-95be-4533-bbf4-ea02e42713d8 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:48.092169 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c991339c-5535-4166-ab72-fe2fadd880fe None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:48.093646 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c991339c-5535-4166-ab72-fe2fadd880fe None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:48.106819 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application [None req-c991339c-5535-4166-ab72-fe2fadd880fe None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 09 00:43:48.106819 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:43:48.106819 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:43:48.106819 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:43:48.106819 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:43:48.106819 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:43:48.106819 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:43:48.106819 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:43:48.106819 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:43:48.106819 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:43:48.106819 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:43:48.106819 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:43:48.106819 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 09 00:43:48.106819 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 09 00:43:48.106819 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 09 00:43:48.108320 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 09 00:43:48.108320 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:43:48.108320 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:43:48.108320 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:43:48.108320 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:43:48.108320 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:43:48.108320 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:43:48.108320 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:43:48.108320 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application with Lock( Oct 09 00:43:48.108320 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:43:48.108320 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:43:48.108320 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:43:48.108320 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:43:48.108320 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:43:48.108320 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:43:48.108320 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:43:48.108320 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:43:48.109368 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 09 00:43:48.109368 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 09 00:43:48.109368 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 09 00:43:48.109368 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 09 00:43:48.109368 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 09 00:43:48.109368 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 09 00:43:48.109368 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 09 00:43:48.109368 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Oct 09 00:43:48.109368 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 561/1100] 10.222.0.15 () {56 vars in 1111 bytes} [Sun Oct 9 00:43:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 09 00:43:48.116059 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c991339c-5535-4166-ab72-fe2fadd880fe None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:48.138811 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:48.164884 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:48.203411 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47413af7-95be-4533-bbf4-ea02e42713d8 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:48.218660 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c991339c-5535-4166-ab72-fe2fadd880fe None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:48.238107 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83e7aa6-bc50-4e03-a014-351d2d71ac74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:48.238757 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83e7aa6-bc50-4e03-a014-351d2d71ac74 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:48.239008 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83e7aa6-bc50-4e03-a014-351d2d71ac74 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:48.239426 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83e7aa6-bc50-4e03-a014-351d2d71ac74 None admin] PATH_INFO: `/v3/users/67f5869b15444a23be60863bb6adf669` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:48.240689 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83e7aa6-bc50-4e03-a014-351d2d71ac74 None admin] RBAC: Authorizing `identity:get_user(user_id=67f5869b15444a23be60863bb6adf669)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:48.242142 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83e7aa6-bc50-4e03-a014-351d2d71ac74 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:48.243785 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 540/1101] 10.222.0.15 () {56 vars in 1177 bytes} [Sun Oct 9 00:43:48 2022] GET /identity/v3/users/67f5869b15444a23be60863bb6adf669 => generated 285 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:43:48.250071 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83e7aa6-bc50-4e03-a014-351d2d71ac74 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:48.258254 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001e0801-694d-4a36-8439-d272c812bb82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:48.258876 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001e0801-694d-4a36-8439-d272c812bb82 None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:48.259150 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001e0801-694d-4a36-8439-d272c812bb82 None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:48.259440 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001e0801-694d-4a36-8439-d272c812bb82 None admin] PATH_INFO: `/v3/projects` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:48.260589 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001e0801-694d-4a36-8439-d272c812bb82 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:43:48.260894 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001e0801-694d-4a36-8439-d272c812bb82 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:48.262721 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001e0801-694d-4a36-8439-d272c812bb82 None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:48.276767 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 562/1102] 10.222.0.15 () {56 vars in 1148 bytes} [Sun Oct 9 00:43:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:43:48.282977 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001e0801-694d-4a36-8439-d272c812bb82 None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:48.361185 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83e7aa6-bc50-4e03-a014-351d2d71ac74 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:48.369340 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:48.401608 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbab35f3-443e-4fe7-923a-99c982259eff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:48.402443 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001e0801-694d-4a36-8439-d272c812bb82 None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:48.402550 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbab35f3-443e-4fe7-923a-99c982259eff None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:48.402926 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbab35f3-443e-4fe7-923a-99c982259eff None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:48.403377 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbab35f3-443e-4fe7-923a-99c982259eff None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:48.406262 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:48.443626 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc327bc-f9bc-4fa2-938a-86ac587e5bed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:48.444453 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc327bc-f9bc-4fa2-938a-86ac587e5bed None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:48.444720 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc327bc-f9bc-4fa2-938a-86ac587e5bed None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:48.444983 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc327bc-f9bc-4fa2-938a-86ac587e5bed None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:48.445719 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc327bc-f9bc-4fa2-938a-86ac587e5bed None admin] RBAC: Adding query filter params (role.id=0a44a4718e6a4dd48874221bee2f6b20, scope.project.id=f148d39ced534860abfbe8fc3f98ace4, user.id=4ac83d57fba841e0a666710732249c49) {{(pid=81525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:43:48.446019 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc327bc-f9bc-4fa2-938a-86ac587e5bed None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:48.447501 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc327bc-f9bc-4fa2-938a-86ac587e5bed None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:48.454279 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 563/1103] 10.222.0.15 () {56 vars in 1374 bytes} [Sun Oct 9 00:43:48 2022] GET /identity/v3/role_assignments?user.id=4ac83d57fba841e0a666710732249c49&scope.project.id=f148d39ced534860abfbe8fc3f98ace4&role.id=0a44a4718e6a4dd48874221bee2f6b20 => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:43:48.491023 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbab35f3-443e-4fe7-923a-99c982259eff None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:48.492629 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbab35f3-443e-4fe7-923a-99c982259eff None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:48.609238 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 541/1104] 10.222.0.15 () {58 vars in 1282 bytes} [Sun Oct 9 00:43:48 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Oct 09 00:43:48.616246 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc327bc-f9bc-4fa2-938a-86ac587e5bed None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:48.743380 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc327bc-f9bc-4fa2-938a-86ac587e5bed None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:48.781105 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc47542-01ca-42cf-9654-218e18699e8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:48.781755 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc47542-01ca-42cf-9654-218e18699e8b None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:48.782024 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc47542-01ca-42cf-9654-218e18699e8b None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:48.782287 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc47542-01ca-42cf-9654-218e18699e8b None admin] PATH_INFO: `/v3/projects/8f61f695e9a6461fa2df8224a50ab50a` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:48.783470 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc47542-01ca-42cf-9654-218e18699e8b None admin] RBAC: Authorizing `identity:get_project(project_id=8f61f695e9a6461fa2df8224a50ab50a)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:48.784962 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc47542-01ca-42cf-9654-218e18699e8b None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:48.786601 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 564/1105] 10.222.0.15 () {56 vars in 1186 bytes} [Sun Oct 9 00:43:48 2022] GET /identity/v3/projects/8f61f695e9a6461fa2df8224a50ab50a => generated 311 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:43:48.793482 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbab35f3-443e-4fe7-923a-99c982259eff None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:48.804044 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:48.926518 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbab35f3-443e-4fe7-923a-99c982259eff None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:48.971217 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986c5872-2fe2-4db9-a569-99d3b9a7acfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:48.972244 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986c5872-2fe2-4db9-a569-99d3b9a7acfd None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:48.972703 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986c5872-2fe2-4db9-a569-99d3b9a7acfd None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:48.973144 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986c5872-2fe2-4db9-a569-99d3b9a7acfd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:48.974189 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986c5872-2fe2-4db9-a569-99d3b9a7acfd None admin] RBAC: Adding query filter params (role.id=f69dddf26daf4dd79d4c962beb877af5, scope.project.id=8f61f695e9a6461fa2df8224a50ab50a, user.id=67f5869b15444a23be60863bb6adf669) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:43:48.974669 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986c5872-2fe2-4db9-a569-99d3b9a7acfd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:48.976378 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986c5872-2fe2-4db9-a569-99d3b9a7acfd None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:48.985700 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 542/1106] 10.222.0.15 () {56 vars in 1374 bytes} [Sun Oct 9 00:43:48 2022] GET /identity/v3/role_assignments?user.id=67f5869b15444a23be60863bb6adf669&scope.project.id=8f61f695e9a6461fa2df8224a50ab50a&role.id=f69dddf26daf4dd79d4c962beb877af5 => generated 608 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 09 00:43:51.277215 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3d7f04-90d7-41a8-a54f-ff762fbecf62 None None] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:51.277835 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3d7f04-90d7-41a8-a54f-ff762fbecf62 None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:51.277835 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3d7f04-90d7-41a8-a54f-ff762fbecf62 None None] PATH_INFO: `/` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:51.279213 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 565/1107] 10.222.0.15 () {54 vars in 927 bytes} [Sun Oct 9 00:43:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:43:51.285300 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e8a33f-060b-4c07-8522-da233bcc124e None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:51.285800 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e8a33f-060b-4c07-8522-da233bcc124e None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:51.285957 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e8a33f-060b-4c07-8522-da233bcc124e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:51.306159 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-f1e8a33f-060b-4c07-8522-da233bcc124e None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:43:51.307413 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-f1e8a33f-060b-4c07-8522-da233bcc124e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:43:51.380054 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:51.385568 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 543/1108] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Oct 9 00:43:51 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 09 00:43:51.657189 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3d7f04-90d7-41a8-a54f-ff762fbecf62 None None] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:51.699763 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:51.769501 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3d7f04-90d7-41a8-a54f-ff762fbecf62 None None] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:51.805413 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2296a4-5914-4a5d-9726-a755e038923a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:51.806098 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2296a4-5914-4a5d-9726-a755e038923a None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:51.806414 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2296a4-5914-4a5d-9726-a755e038923a None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:51.806820 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2296a4-5914-4a5d-9726-a755e038923a None admin] PATH_INFO: `/v3/domains/default` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:51.807915 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2296a4-5914-4a5d-9726-a755e038923a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:51.809403 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2296a4-5914-4a5d-9726-a755e038923a None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:51.811038 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 566/1109] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Oct 9 00:43:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:43:51.817327 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e8a33f-060b-4c07-8522-da233bcc124e None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:51.922194 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e8a33f-060b-4c07-8522-da233bcc124e None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:51.964298 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4097f543-5253-4595-8ead-a53c9cecf413 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:51.964998 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4097f543-5253-4595-8ead-a53c9cecf413 None admin] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:51.965311 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4097f543-5253-4595-8ead-a53c9cecf413 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:51.965622 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4097f543-5253-4595-8ead-a53c9cecf413 None admin] PATH_INFO: `/v3/users` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:51.966328 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4097f543-5253-4595-8ead-a53c9cecf413 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:51.967835 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4097f543-5253-4595-8ead-a53c9cecf413 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:51.991942 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 544/1110] 10.222.0.15 () {60 vars in 1132 bytes} [Sun Oct 9 00:43:51 2022] POST /identity/v3/users => generated 286 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 09 00:43:54.232187 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6752b135-5b52-4778-b201-8cc1ec5e2d60 None None] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:54.232766 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6752b135-5b52-4778-b201-8cc1ec5e2d60 None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:54.232766 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6752b135-5b52-4778-b201-8cc1ec5e2d60 None None] PATH_INFO: `/` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:54.234084 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 567/1111] 10.222.0.15 () {54 vars in 927 bytes} [Sun Oct 9 00:43:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:43:54.240378 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14531c75-550d-4a3d-951c-766ce559e6f5 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:54.240935 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14531c75-550d-4a3d-951c-766ce559e6f5 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:54.240935 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14531c75-550d-4a3d-951c-766ce559e6f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:54.261189 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-14531c75-550d-4a3d-951c-766ce559e6f5 None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:43:54.262402 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-14531c75-550d-4a3d-951c-766ce559e6f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:43:54.317936 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:54.336058 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 545/1112] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Oct 9 00:43:54 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 09 00:43:54.594773 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6752b135-5b52-4778-b201-8cc1ec5e2d60 None None] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:54.704735 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6752b135-5b52-4778-b201-8cc1ec5e2d60 None None] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:54.707286 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:54.741848 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b726249-6054-4b9c-bd8f-8dcdcdd63e4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:54.742488 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b726249-6054-4b9c-bd8f-8dcdcdd63e4c None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:54.742756 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b726249-6054-4b9c-bd8f-8dcdcdd63e4c None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:54.743022 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b726249-6054-4b9c-bd8f-8dcdcdd63e4c None admin] PATH_INFO: `/v3/roles/93f141c2a808407dae6f9704941d0cb2` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:54.744498 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b726249-6054-4b9c-bd8f-8dcdcdd63e4c None admin] RBAC: Authorizing `identity:get_role(role_id=93f141c2a808407dae6f9704941d0cb2)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:54.745873 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b726249-6054-4b9c-bd8f-8dcdcdd63e4c None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:54.747602 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 568/1113] 10.222.0.15 () {56 vars in 1177 bytes} [Sun Oct 9 00:43:54 2022] GET /identity/v3/roles/93f141c2a808407dae6f9704941d0cb2 => generated 223 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:43:54.753831 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14531c75-550d-4a3d-951c-766ce559e6f5 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:54.864023 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14531c75-550d-4a3d-951c-766ce559e6f5 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:54.901937 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7ce5a7-4ed3-4d68-b513-0101f10a1ad6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:54.902586 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7ce5a7-4ed3-4d68-b513-0101f10a1ad6 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:54.902855 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7ce5a7-4ed3-4d68-b513-0101f10a1ad6 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:54.903119 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7ce5a7-4ed3-4d68-b513-0101f10a1ad6 None admin] PATH_INFO: `/v3/users/f584189e559d433493983dd92c2a712d` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:54.917780 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7ce5a7-4ed3-4d68-b513-0101f10a1ad6 None admin] RBAC: Authorizing `identity:get_user(user_id=f584189e559d433493983dd92c2a712d)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:54.919235 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7ce5a7-4ed3-4d68-b513-0101f10a1ad6 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:54.920956 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 546/1114] 10.222.0.15 () {56 vars in 1177 bytes} [Sun Oct 9 00:43:54 2022] GET /identity/v3/users/f584189e559d433493983dd92c2a712d => generated 286 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:43:54.927154 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b726249-6054-4b9c-bd8f-8dcdcdd63e4c None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:55.036912 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b726249-6054-4b9c-bd8f-8dcdcdd63e4c None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:55.073544 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebb5365-e2f1-4d5f-9696-1d6b8dcf8ed0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:55.074236 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebb5365-e2f1-4d5f-9696-1d6b8dcf8ed0 None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:55.074510 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebb5365-e2f1-4d5f-9696-1d6b8dcf8ed0 None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:55.074775 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebb5365-e2f1-4d5f-9696-1d6b8dcf8ed0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:55.117332 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:55.143960 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebb5365-e2f1-4d5f-9696-1d6b8dcf8ed0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:55.145408 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebb5365-e2f1-4d5f-9696-1d6b8dcf8ed0 None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:55.242118 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 569/1115] 10.222.0.15 () {58 vars in 1282 bytes} [Sun Oct 9 00:43:54 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 09 00:43:55.248835 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7ce5a7-4ed3-4d68-b513-0101f10a1ad6 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:55.293608 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:55.349801 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7ce5a7-4ed3-4d68-b513-0101f10a1ad6 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:55.385136 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b167e89e-ab9b-40ca-8d18-294b45dad22a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:55.385674 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b167e89e-ab9b-40ca-8d18-294b45dad22a None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:55.385947 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b167e89e-ab9b-40ca-8d18-294b45dad22a None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:55.386216 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b167e89e-ab9b-40ca-8d18-294b45dad22a None admin] PATH_INFO: `/v3/projects/8f61f695e9a6461fa2df8224a50ab50a` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:55.387372 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b167e89e-ab9b-40ca-8d18-294b45dad22a None admin] RBAC: Authorizing `identity:get_project(project_id=8f61f695e9a6461fa2df8224a50ab50a)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:55.388811 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b167e89e-ab9b-40ca-8d18-294b45dad22a None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:55.390462 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 547/1116] 10.222.0.15 () {56 vars in 1186 bytes} [Sun Oct 9 00:43:55 2022] GET /identity/v3/projects/8f61f695e9a6461fa2df8224a50ab50a => generated 311 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:43:55.397012 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebb5365-e2f1-4d5f-9696-1d6b8dcf8ed0 None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:55.469876 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:55.500830 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebb5365-e2f1-4d5f-9696-1d6b8dcf8ed0 None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:55.536472 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7936bbf9-8473-4a96-9c83-c4683c94862a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:55.537078 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7936bbf9-8473-4a96-9c83-c4683c94862a None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:55.537349 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7936bbf9-8473-4a96-9c83-c4683c94862a None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:55.537611 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7936bbf9-8473-4a96-9c83-c4683c94862a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:55.538363 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7936bbf9-8473-4a96-9c83-c4683c94862a None admin] RBAC: Adding query filter params (role.id=93f141c2a808407dae6f9704941d0cb2, scope.project.id=8f61f695e9a6461fa2df8224a50ab50a, user.id=f584189e559d433493983dd92c2a712d) {{(pid=81525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:43:55.538642 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7936bbf9-8473-4a96-9c83-c4683c94862a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:55.540113 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7936bbf9-8473-4a96-9c83-c4683c94862a None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:55.545641 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 570/1117] 10.222.0.15 () {56 vars in 1374 bytes} [Sun Oct 9 00:43:55 2022] GET /identity/v3/role_assignments?user.id=f584189e559d433493983dd92c2a712d&scope.project.id=8f61f695e9a6461fa2df8224a50ab50a&role.id=93f141c2a808407dae6f9704941d0cb2 => generated 259 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 09 00:43:57.696762 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac275aa-ef65-49d7-97d8-4351f1df9f2e None None] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:57.697294 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac275aa-ef65-49d7-97d8-4351f1df9f2e None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:57.697294 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac275aa-ef65-49d7-97d8-4351f1df9f2e None None] PATH_INFO: `/` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:57.698535 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 548/1118] 10.222.0.15 () {54 vars in 927 bytes} [Sun Oct 9 00:43:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:43:57.704322 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e71045-68a5-43f4-8236-b0683ce7b5bf None None] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:57.704745 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e71045-68a5-43f4-8236-b0683ce7b5bf None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:57.704877 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e71045-68a5-43f4-8236-b0683ce7b5bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:57.723974 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.auth.core [None req-c3e71045-68a5-43f4-8236-b0683ce7b5bf None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:43:57.725177 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-c3e71045-68a5-43f4-8236-b0683ce7b5bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:43:57.800034 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 571/1119] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Oct 9 00:43:57 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 09 00:43:58.063882 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac275aa-ef65-49d7-97d8-4351f1df9f2e None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:58.173861 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac275aa-ef65-49d7-97d8-4351f1df9f2e None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:58.187546 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:58.210121 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d3f800-60f2-40b4-a5c0-5de18f107c35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:58.210762 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d3f800-60f2-40b4-a5c0-5de18f107c35 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:58.211035 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d3f800-60f2-40b4-a5c0-5de18f107c35 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:58.211358 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d3f800-60f2-40b4-a5c0-5de18f107c35 None admin] PATH_INFO: `/v3/roles/93f141c2a808407dae6f9704941d0cb2` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:58.212751 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d3f800-60f2-40b4-a5c0-5de18f107c35 None admin] RBAC: Authorizing `identity:get_role(role_id=93f141c2a808407dae6f9704941d0cb2)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:58.214123 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d3f800-60f2-40b4-a5c0-5de18f107c35 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:58.215494 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 549/1120] 10.222.0.15 () {56 vars in 1177 bytes} [Sun Oct 9 00:43:58 2022] GET /identity/v3/roles/93f141c2a808407dae6f9704941d0cb2 => generated 223 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:43:58.221694 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e71045-68a5-43f4-8236-b0683ce7b5bf None None] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:58.287363 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:58.323663 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e71045-68a5-43f4-8236-b0683ce7b5bf None None] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:58.359770 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e555a5-45b2-4d70-9cad-e098040ac9bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:58.360409 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e555a5-45b2-4d70-9cad-e098040ac9bd None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:58.360685 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e555a5-45b2-4d70-9cad-e098040ac9bd None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:58.360959 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e555a5-45b2-4d70-9cad-e098040ac9bd None admin] PATH_INFO: `/v3/users/f584189e559d433493983dd92c2a712d` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:58.362113 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e555a5-45b2-4d70-9cad-e098040ac9bd None admin] RBAC: Authorizing `identity:get_user(user_id=f584189e559d433493983dd92c2a712d)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:58.363621 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e555a5-45b2-4d70-9cad-e098040ac9bd None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:58.365263 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 572/1121] 10.222.0.15 () {56 vars in 1177 bytes} [Sun Oct 9 00:43:58 2022] GET /identity/v3/users/f584189e559d433493983dd92c2a712d => generated 286 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:43:58.371891 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d3f800-60f2-40b4-a5c0-5de18f107c35 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:58.474374 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d3f800-60f2-40b4-a5c0-5de18f107c35 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:58.509623 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fba24e-8820-467d-94b8-d1d24ccd1946 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:58.510260 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fba24e-8820-467d-94b8-d1d24ccd1946 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:58.510536 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fba24e-8820-467d-94b8-d1d24ccd1946 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:58.510809 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fba24e-8820-467d-94b8-d1d24ccd1946 None admin] PATH_INFO: `/v3/projects/8f61f695e9a6461fa2df8224a50ab50a` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:58.511978 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fba24e-8820-467d-94b8-d1d24ccd1946 None admin] RBAC: Authorizing `identity:get_project(project_id=8f61f695e9a6461fa2df8224a50ab50a)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:58.513425 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fba24e-8820-467d-94b8-d1d24ccd1946 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:58.515114 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 550/1122] 10.222.0.15 () {56 vars in 1186 bytes} [Sun Oct 9 00:43:58 2022] GET /identity/v3/projects/8f61f695e9a6461fa2df8224a50ab50a => generated 311 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:43:58.521361 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e555a5-45b2-4d70-9cad-e098040ac9bd None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:43:58.624835 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e555a5-45b2-4d70-9cad-e098040ac9bd None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:43:58.660219 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402dc0a5-e989-493a-a08a-4d0c811ec8b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:43:58.660889 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402dc0a5-e989-493a-a08a-4d0c811ec8b1 None admin] REQUEST_METHOD: `PUT` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:43:58.661166 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402dc0a5-e989-493a-a08a-4d0c811ec8b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:43:58.661516 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402dc0a5-e989-493a-a08a-4d0c811ec8b1 None admin] PATH_INFO: `/v3/projects/8f61f695e9a6461fa2df8224a50ab50a/users/f584189e559d433493983dd92c2a712d/roles/93f141c2a808407dae6f9704941d0cb2` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:43:58.663821 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402dc0a5-e989-493a-a08a-4d0c811ec8b1 None admin] RBAC: Authorizing `identity:create_grant(project_id=8f61f695e9a6461fa2df8224a50ab50a, user_id=f584189e559d433493983dd92c2a712d, role_id=93f141c2a808407dae6f9704941d0cb2)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:43:58.665277 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402dc0a5-e989-493a-a08a-4d0c811ec8b1 None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:43:58.667626 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:43:58.680607 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 573/1123] 10.222.0.15 () {58 vars in 1439 bytes} [Sun Oct 9 00:43:58 2022] PUT /identity/v3/projects/8f61f695e9a6461fa2df8224a50ab50a/users/f584189e559d433493983dd92c2a712d/roles/93f141c2a808407dae6f9704941d0cb2 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 00:44:00.853600 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4a918f-eea6-429f-aa90-5f4ece0fb05e None None] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:00.854133 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4a918f-eea6-429f-aa90-5f4ece0fb05e None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:00.854133 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4a918f-eea6-429f-aa90-5f4ece0fb05e None None] PATH_INFO: `/` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:00.855420 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 551/1124] 10.222.0.15 () {54 vars in 927 bytes} [Sun Oct 9 00:44:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:44:00.861029 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9184ef-8ac9-46c8-ba7c-fcdcfad55e9a None None] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:00.861420 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9184ef-8ac9-46c8-ba7c-fcdcfad55e9a None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:00.861565 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9184ef-8ac9-46c8-ba7c-fcdcfad55e9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:00.881298 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.auth.core [None req-fc9184ef-8ac9-46c8-ba7c-fcdcfad55e9a None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:44:00.882493 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-fc9184ef-8ac9-46c8-ba7c-fcdcfad55e9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:44:00.952275 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 574/1125] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Oct 9 00:44:00 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 09 00:44:01.217883 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4a918f-eea6-429f-aa90-5f4ece0fb05e None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:44:01.269762 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:44:01.324760 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4a918f-eea6-429f-aa90-5f4ece0fb05e None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:44:01.364676 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab22d2e4-25f7-49cd-a581-287d78d26126 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:44:01.365348 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab22d2e4-25f7-49cd-a581-287d78d26126 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:01.365613 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab22d2e4-25f7-49cd-a581-287d78d26126 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:01.365887 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab22d2e4-25f7-49cd-a581-287d78d26126 None admin] PATH_INFO: `/v3/roles/93f141c2a808407dae6f9704941d0cb2` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:01.367434 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab22d2e4-25f7-49cd-a581-287d78d26126 None admin] RBAC: Authorizing `identity:get_role(role_id=93f141c2a808407dae6f9704941d0cb2)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:44:01.368848 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab22d2e4-25f7-49cd-a581-287d78d26126 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:44:01.370254 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 552/1126] 10.222.0.15 () {56 vars in 1177 bytes} [Sun Oct 9 00:44:01 2022] GET /identity/v3/roles/93f141c2a808407dae6f9704941d0cb2 => generated 223 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:44:01.376856 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9184ef-8ac9-46c8-ba7c-fcdcfad55e9a None None] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:44:01.484120 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9184ef-8ac9-46c8-ba7c-fcdcfad55e9a None None] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:44:01.508574 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:44:01.520933 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc348e7-6a09-421f-a008-afe4935332bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:44:01.521573 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc348e7-6a09-421f-a008-afe4935332bd None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:01.521849 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc348e7-6a09-421f-a008-afe4935332bd None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:01.522118 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc348e7-6a09-421f-a008-afe4935332bd None admin] PATH_INFO: `/v3/users/f584189e559d433493983dd92c2a712d` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:01.523274 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc348e7-6a09-421f-a008-afe4935332bd None admin] RBAC: Authorizing `identity:get_user(user_id=f584189e559d433493983dd92c2a712d)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:44:01.524737 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc348e7-6a09-421f-a008-afe4935332bd None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:44:01.526366 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 575/1127] 10.222.0.15 () {56 vars in 1177 bytes} [Sun Oct 9 00:44:01 2022] GET /identity/v3/users/f584189e559d433493983dd92c2a712d => generated 286 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:44:01.532384 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab22d2e4-25f7-49cd-a581-287d78d26126 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:44:01.634197 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab22d2e4-25f7-49cd-a581-287d78d26126 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:44:01.652463 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:44:01.672139 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc629eb9-16ce-4f7c-b869-fdbe15ecff0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:44:01.672753 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc629eb9-16ce-4f7c-b869-fdbe15ecff0d None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:01.673029 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc629eb9-16ce-4f7c-b869-fdbe15ecff0d None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:01.673297 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc629eb9-16ce-4f7c-b869-fdbe15ecff0d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:01.744127 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc629eb9-16ce-4f7c-b869-fdbe15ecff0d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:44:01.745505 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc629eb9-16ce-4f7c-b869-fdbe15ecff0d None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:44:01.855297 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 553/1128] 10.222.0.15 () {58 vars in 1282 bytes} [Sun Oct 9 00:44:01 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 09 00:44:01.861560 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc348e7-6a09-421f-a008-afe4935332bd None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:44:01.967759 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc348e7-6a09-421f-a008-afe4935332bd None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:44:02.003148 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ce28da-782d-41f0-a5e2-0720395ba9f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:44:02.003719 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ce28da-782d-41f0-a5e2-0720395ba9f4 None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:02.003994 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ce28da-782d-41f0-a5e2-0720395ba9f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:02.004257 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ce28da-782d-41f0-a5e2-0720395ba9f4 None admin] PATH_INFO: `/v3/projects/8f61f695e9a6461fa2df8224a50ab50a` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:02.005455 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ce28da-782d-41f0-a5e2-0720395ba9f4 None admin] RBAC: Authorizing `identity:get_project(project_id=8f61f695e9a6461fa2df8224a50ab50a)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:44:02.006897 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ce28da-782d-41f0-a5e2-0720395ba9f4 None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:44:02.008610 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 576/1129] 10.222.0.15 () {56 vars in 1186 bytes} [Sun Oct 9 00:44:01 2022] GET /identity/v3/projects/8f61f695e9a6461fa2df8224a50ab50a => generated 311 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:44:02.015180 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc629eb9-16ce-4f7c-b869-fdbe15ecff0d None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:44:02.035014 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:44:02.121231 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc629eb9-16ce-4f7c-b869-fdbe15ecff0d None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:44:02.157335 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966c6918-501f-478a-b38d-de033e2900cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:44:02.157942 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966c6918-501f-478a-b38d-de033e2900cd None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:02.158216 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966c6918-501f-478a-b38d-de033e2900cd None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:02.158484 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966c6918-501f-478a-b38d-de033e2900cd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:02.159218 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966c6918-501f-478a-b38d-de033e2900cd None admin] RBAC: Adding query filter params (role.id=93f141c2a808407dae6f9704941d0cb2, scope.project.id=8f61f695e9a6461fa2df8224a50ab50a, user.id=f584189e559d433493983dd92c2a712d) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:44:02.159561 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966c6918-501f-478a-b38d-de033e2900cd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:44:02.161006 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966c6918-501f-478a-b38d-de033e2900cd None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:44:02.167281 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 554/1130] 10.222.0.15 () {56 vars in 1374 bytes} [Sun Oct 9 00:44:02 2022] GET /identity/v3/role_assignments?user.id=f584189e559d433493983dd92c2a712d&scope.project.id=8f61f695e9a6461fa2df8224a50ab50a&role.id=93f141c2a808407dae6f9704941d0cb2 => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:44:04.300279 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92373fc-43e7-49a5-a4c4-b2d280d820b7 None None] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:04.300898 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92373fc-43e7-49a5-a4c4-b2d280d820b7 None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:04.300898 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92373fc-43e7-49a5-a4c4-b2d280d820b7 None None] PATH_INFO: `/` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:04.302218 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 577/1131] 10.222.0.15 () {54 vars in 927 bytes} [Sun Oct 9 00:44:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:44:04.307972 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422a3075-9022-4fc1-830e-77b7b91a6355 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:04.308364 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422a3075-9022-4fc1-830e-77b7b91a6355 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:04.308506 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422a3075-9022-4fc1-830e-77b7b91a6355 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:04.326941 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-422a3075-9022-4fc1-830e-77b7b91a6355 None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:44:04.328161 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-422a3075-9022-4fc1-830e-77b7b91a6355 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:44:04.401329 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 555/1132] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Oct 9 00:44:04 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 09 00:44:04.667218 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92373fc-43e7-49a5-a4c4-b2d280d820b7 None None] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:44:04.731184 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:44:04.775778 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92373fc-43e7-49a5-a4c4-b2d280d820b7 None None] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:44:04.813093 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb65dc0-5604-4a42-bb82-97cac3771b27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:44:04.813716 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb65dc0-5604-4a42-bb82-97cac3771b27 None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:04.813990 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb65dc0-5604-4a42-bb82-97cac3771b27 None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:04.814253 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb65dc0-5604-4a42-bb82-97cac3771b27 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:04.815384 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb65dc0-5604-4a42-bb82-97cac3771b27 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:44:04.816792 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb65dc0-5604-4a42-bb82-97cac3771b27 None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:44:04.818492 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 578/1133] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Oct 9 00:44:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:44:04.824450 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422a3075-9022-4fc1-830e-77b7b91a6355 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:44:04.836045 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:44:04.926078 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422a3075-9022-4fc1-830e-77b7b91a6355 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:44:04.963722 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32838fd-dcab-4daf-9278-c1d54d0e88e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:44:04.964348 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32838fd-dcab-4daf-9278-c1d54d0e88e5 None admin] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:04.964626 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32838fd-dcab-4daf-9278-c1d54d0e88e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:04.964895 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32838fd-dcab-4daf-9278-c1d54d0e88e5 None admin] PATH_INFO: `/v3/projects` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:04.965567 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32838fd-dcab-4daf-9278-c1d54d0e88e5 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:44:04.967014 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32838fd-dcab-4daf-9278-c1d54d0e88e5 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:44:04.997215 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 556/1134] 10.222.0.15 () {60 vars in 1141 bytes} [Sun Oct 9 00:44:04 2022] POST /identity/v3/projects => generated 311 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 09 00:44:07.182967 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b81834-58ea-4d74-9221-77aadffe9c91 None None] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:07.183668 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b81834-58ea-4d74-9221-77aadffe9c91 None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:07.183668 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b81834-58ea-4d74-9221-77aadffe9c91 None None] PATH_INFO: `/` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:07.184893 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 579/1135] 10.222.0.15 () {54 vars in 927 bytes} [Sun Oct 9 00:44:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:44:07.190584 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cc493f-a614-451d-8da0-7472bb1d17fd None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:07.191074 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cc493f-a614-451d-8da0-7472bb1d17fd None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:07.191171 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cc493f-a614-451d-8da0-7472bb1d17fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:07.209890 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-b6cc493f-a614-451d-8da0-7472bb1d17fd None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:44:07.211085 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-b6cc493f-a614-451d-8da0-7472bb1d17fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:44:07.268947 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:44:07.280584 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 557/1136] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Oct 9 00:44:07 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 09 00:44:07.543101 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b81834-58ea-4d74-9221-77aadffe9c91 None None] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:44:07.654869 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b81834-58ea-4d74-9221-77aadffe9c91 None None] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:44:07.681860 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:44:07.690720 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe8d9e8-596f-4349-8cd9-70f14ba9c4e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:44:07.691282 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe8d9e8-596f-4349-8cd9-70f14ba9c4e7 None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:07.691585 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe8d9e8-596f-4349-8cd9-70f14ba9c4e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:07.691855 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe8d9e8-596f-4349-8cd9-70f14ba9c4e7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:07.693087 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe8d9e8-596f-4349-8cd9-70f14ba9c4e7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:44:07.694568 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe8d9e8-596f-4349-8cd9-70f14ba9c4e7 None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:44:07.696195 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 580/1137] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Oct 9 00:44:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:44:07.702163 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cc493f-a614-451d-8da0-7472bb1d17fd None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:44:07.800075 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cc493f-a614-451d-8da0-7472bb1d17fd None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:44:07.834804 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39dedd1-683a-4cec-9b1d-8f77bfae6622 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:44:07.835446 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39dedd1-683a-4cec-9b1d-8f77bfae6622 None admin] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:07.835697 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39dedd1-683a-4cec-9b1d-8f77bfae6622 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:07.835967 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39dedd1-683a-4cec-9b1d-8f77bfae6622 None admin] PATH_INFO: `/v3/users` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:07.836616 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39dedd1-683a-4cec-9b1d-8f77bfae6622 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:44:07.838063 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39dedd1-683a-4cec-9b1d-8f77bfae6622 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:44:07.860292 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 558/1138] 10.222.0.15 () {60 vars in 1132 bytes} [Sun Oct 9 00:44:07 2022] POST /identity/v3/users => generated 286 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 09 00:44:10.027555 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2075ee47-42b9-47b9-a2a4-b24f24403302 None None] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:10.028126 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2075ee47-42b9-47b9-a2a4-b24f24403302 None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:10.028126 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2075ee47-42b9-47b9-a2a4-b24f24403302 None None] PATH_INFO: `/` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:10.029815 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 581/1139] 10.222.0.15 () {54 vars in 927 bytes} [Sun Oct 9 00:44:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:44:10.035492 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7907ac3-0771-4a75-99c3-c615757ebb34 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:10.036045 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7907ac3-0771-4a75-99c3-c615757ebb34 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:10.036192 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7907ac3-0771-4a75-99c3-c615757ebb34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:10.054816 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-e7907ac3-0771-4a75-99c3-c615757ebb34 None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:44:10.056050 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-e7907ac3-0771-4a75-99c3-c615757ebb34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:44:10.103233 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:44:10.130310 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 559/1140] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Oct 9 00:44:10 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 09 00:44:10.395502 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2075ee47-42b9-47b9-a2a4-b24f24403302 None None] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:44:10.508891 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2075ee47-42b9-47b9-a2a4-b24f24403302 None None] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:44:10.551640 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a357239b-7beb-4724-9385-75354c3f3e3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:44:10.552278 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a357239b-7beb-4724-9385-75354c3f3e3f None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:10.552551 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a357239b-7beb-4724-9385-75354c3f3e3f None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:10.552820 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a357239b-7beb-4724-9385-75354c3f3e3f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:10.564048 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a357239b-7beb-4724-9385-75354c3f3e3f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 09 00:44:10.568940 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application [None req-a357239b-7beb-4724-9385-75354c3f3e3f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 09 00:44:10.568940 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:44:10.568940 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:44:10.568940 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:44:10.568940 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:44:10.568940 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:44:10.568940 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:44:10.568940 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:44:10.568940 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:44:10.568940 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:44:10.568940 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:44:10.568940 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:44:10.568940 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 09 00:44:10.568940 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 09 00:44:10.568940 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 09 00:44:10.568940 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 09 00:44:10.571358 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 09 00:44:10.571358 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 09 00:44:10.571358 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 09 00:44:10.571358 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 09 00:44:10.571358 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:44:10.571358 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:44:10.571358 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:44:10.571358 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:44:10.571358 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:44:10.571358 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:44:10.571358 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:44:10.571358 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application with Lock( Oct 09 00:44:10.571358 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:44:10.571358 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:44:10.571358 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:44:10.571358 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:44:10.572599 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:44:10.572599 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:44:10.572599 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:44:10.572599 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:44:10.572599 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 09 00:44:10.572599 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 09 00:44:10.572599 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 09 00:44:10.572599 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 09 00:44:10.572599 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 09 00:44:10.572599 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 09 00:44:10.572599 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 09 00:44:10.572599 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Oct 09 00:44:10.572599 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 582/1141] 10.222.0.15 () {56 vars in 1096 bytes} [Sun Oct 9 00:44:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:44:10.576391 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7907ac3-0771-4a75-99c3-c615757ebb34 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:44:10.678285 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7907ac3-0771-4a75-99c3-c615757ebb34 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:44:10.713295 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e09590d-a1d1-4265-a80e-5442d03e94bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:44:10.713907 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e09590d-a1d1-4265-a80e-5442d03e94bf None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:10.714182 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e09590d-a1d1-4265-a80e-5442d03e94bf None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:10.714454 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e09590d-a1d1-4265-a80e-5442d03e94bf None admin] PATH_INFO: `/v3/roles` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:10.715118 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e09590d-a1d1-4265-a80e-5442d03e94bf None admin] RBAC: Adding query filter params (name=admin) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:44:10.715448 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e09590d-a1d1-4265-a80e-5442d03e94bf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:44:10.716823 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e09590d-a1d1-4265-a80e-5442d03e94bf None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:44:10.725274 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 560/1142] 10.222.0.15 () {56 vars in 1099 bytes} [Sun Oct 9 00:44:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:44:10.731485 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a357239b-7beb-4724-9385-75354c3f3e3f None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:44:10.791638 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:44:10.836533 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a357239b-7beb-4724-9385-75354c3f3e3f None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:44:10.874599 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4f380e-c57e-4538-9499-e4cbf854178d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:44:10.875276 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4f380e-c57e-4538-9499-e4cbf854178d None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:10.875560 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4f380e-c57e-4538-9499-e4cbf854178d None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:10.875823 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4f380e-c57e-4538-9499-e4cbf854178d None admin] PATH_INFO: `/v3/users/76fa417923c4455cac71cd092387002f` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:10.891128 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4f380e-c57e-4538-9499-e4cbf854178d None admin] RBAC: Authorizing `identity:get_user(user_id=76fa417923c4455cac71cd092387002f)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:44:10.892622 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4f380e-c57e-4538-9499-e4cbf854178d None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:44:10.894279 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 583/1143] 10.222.0.15 () {56 vars in 1177 bytes} [Sun Oct 9 00:44:10 2022] GET /identity/v3/users/76fa417923c4455cac71cd092387002f => generated 286 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:44:10.900384 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e09590d-a1d1-4265-a80e-5442d03e94bf None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:44:10.943674 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:44:11.003750 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e09590d-a1d1-4265-a80e-5442d03e94bf None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:44:11.038609 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7462066a-551c-4e10-9f27-fdf748013d58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:44:11.039310 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7462066a-551c-4e10-9f27-fdf748013d58 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:11.039514 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7462066a-551c-4e10-9f27-fdf748013d58 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:11.039782 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7462066a-551c-4e10-9f27-fdf748013d58 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:11.109048 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7462066a-551c-4e10-9f27-fdf748013d58 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:44:11.110502 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7462066a-551c-4e10-9f27-fdf748013d58 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:44:11.151819 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:44:11.214715 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 561/1144] 10.222.0.15 () {58 vars in 1282 bytes} [Sun Oct 9 00:44:10 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 09 00:44:11.221028 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4f380e-c57e-4538-9499-e4cbf854178d None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:44:11.325163 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4f380e-c57e-4538-9499-e4cbf854178d None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:44:11.341230 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:44:11.362605 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d53e175-bf2e-45b6-872a-5dd9cf4dad2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:44:11.363229 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d53e175-bf2e-45b6-872a-5dd9cf4dad2d None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:11.363538 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d53e175-bf2e-45b6-872a-5dd9cf4dad2d None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:11.363842 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d53e175-bf2e-45b6-872a-5dd9cf4dad2d None admin] PATH_INFO: `/v3/projects/f59c28059fea4e7b95eb5f43cc306b45` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:11.365005 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d53e175-bf2e-45b6-872a-5dd9cf4dad2d None admin] RBAC: Authorizing `identity:get_project(project_id=f59c28059fea4e7b95eb5f43cc306b45)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:44:11.366438 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d53e175-bf2e-45b6-872a-5dd9cf4dad2d None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:44:11.368108 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 584/1145] 10.222.0.15 () {56 vars in 1186 bytes} [Sun Oct 9 00:44:11 2022] GET /identity/v3/projects/f59c28059fea4e7b95eb5f43cc306b45 => generated 311 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:44:11.374892 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7462066a-551c-4e10-9f27-fdf748013d58 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:44:11.474856 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7462066a-551c-4e10-9f27-fdf748013d58 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:44:11.513162 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe031176-92ed-4e86-b7ff-3c9d093eb4e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:44:11.513771 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe031176-92ed-4e86-b7ff-3c9d093eb4e7 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:11.514046 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe031176-92ed-4e86-b7ff-3c9d093eb4e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:11.514313 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe031176-92ed-4e86-b7ff-3c9d093eb4e7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:11.515041 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe031176-92ed-4e86-b7ff-3c9d093eb4e7 None admin] RBAC: Adding query filter params (role.id=f69dddf26daf4dd79d4c962beb877af5, scope.project.id=f59c28059fea4e7b95eb5f43cc306b45, user.id=76fa417923c4455cac71cd092387002f) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:44:11.515366 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe031176-92ed-4e86-b7ff-3c9d093eb4e7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:44:11.516784 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe031176-92ed-4e86-b7ff-3c9d093eb4e7 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:44:11.522428 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 562/1146] 10.222.0.15 () {56 vars in 1374 bytes} [Sun Oct 9 00:44:11 2022] GET /identity/v3/role_assignments?user.id=76fa417923c4455cac71cd092387002f&scope.project.id=f59c28059fea4e7b95eb5f43cc306b45&role.id=f69dddf26daf4dd79d4c962beb877af5 => generated 259 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:44:13.606480 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1de39b0-11bf-4957-9364-c1543b4d2c7d None None] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:13.607064 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1de39b0-11bf-4957-9364-c1543b4d2c7d None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:13.607064 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1de39b0-11bf-4957-9364-c1543b4d2c7d None None] PATH_INFO: `/` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:13.608388 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 585/1147] 10.222.0.15 () {54 vars in 927 bytes} [Sun Oct 9 00:44:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:44:13.613973 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aad53e6-8369-4e14-8736-7abc7e4d1e6d None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:13.614438 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aad53e6-8369-4e14-8736-7abc7e4d1e6d None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:13.614542 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aad53e6-8369-4e14-8736-7abc7e4d1e6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:13.622877 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:44:13.634639 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-8aad53e6-8369-4e14-8736-7abc7e4d1e6d None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:44:13.635898 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-8aad53e6-8369-4e14-8736-7abc7e4d1e6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:44:13.704545 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 563/1148] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Oct 9 00:44:13 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 09 00:44:13.969659 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1de39b0-11bf-4957-9364-c1543b4d2c7d None None] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:44:14.077716 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1de39b0-11bf-4957-9364-c1543b4d2c7d None None] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:44:14.112716 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff89a00-b6d0-491f-a293-cad002a220cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:44:14.113343 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff89a00-b6d0-491f-a293-cad002a220cd None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:14.113647 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff89a00-b6d0-491f-a293-cad002a220cd None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:14.113945 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff89a00-b6d0-491f-a293-cad002a220cd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:14.125222 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff89a00-b6d0-491f-a293-cad002a220cd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 09 00:44:14.130187 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application [None req-aff89a00-b6d0-491f-a293-cad002a220cd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 09 00:44:14.130187 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:44:14.130187 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:44:14.130187 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:44:14.130187 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:44:14.130187 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:44:14.130187 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:44:14.130187 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:44:14.130187 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:44:14.130187 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:44:14.130187 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:44:14.130187 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:44:14.130187 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 09 00:44:14.130187 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 09 00:44:14.130187 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 09 00:44:14.130187 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 09 00:44:14.131243 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 09 00:44:14.131243 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 09 00:44:14.131243 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 09 00:44:14.131243 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 09 00:44:14.131243 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:44:14.131243 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:44:14.131243 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:44:14.131243 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:44:14.131243 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:44:14.131243 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:44:14.131243 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:44:14.131243 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application with Lock( Oct 09 00:44:14.131243 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:44:14.131243 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:44:14.131243 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:44:14.131243 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:44:14.132546 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:44:14.132546 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:44:14.132546 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:44:14.132546 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:44:14.132546 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 09 00:44:14.132546 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 09 00:44:14.132546 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 09 00:44:14.132546 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 09 00:44:14.132546 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 09 00:44:14.132546 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 09 00:44:14.132546 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 09 00:44:14.132546 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Oct 09 00:44:14.132546 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 586/1149] 10.222.0.15 () {56 vars in 1096 bytes} [Sun Oct 9 00:44:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:44:14.137715 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aad53e6-8369-4e14-8736-7abc7e4d1e6d None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:44:14.248711 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aad53e6-8369-4e14-8736-7abc7e4d1e6d None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:44:14.286946 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec34be8-d9f4-489d-b151-f253d32e4f76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:44:14.287599 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec34be8-d9f4-489d-b151-f253d32e4f76 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:14.287872 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec34be8-d9f4-489d-b151-f253d32e4f76 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:14.288142 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec34be8-d9f4-489d-b151-f253d32e4f76 None admin] PATH_INFO: `/v3/roles` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:14.288822 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec34be8-d9f4-489d-b151-f253d32e4f76 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:44:14.289124 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec34be8-d9f4-489d-b151-f253d32e4f76 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:44:14.290518 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec34be8-d9f4-489d-b151-f253d32e4f76 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:44:14.292128 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:44:14.300196 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 564/1150] 10.222.0.15 () {56 vars in 1099 bytes} [Sun Oct 9 00:44:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:44:14.306361 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff89a00-b6d0-491f-a293-cad002a220cd None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:44:14.352018 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:44:14.412908 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff89a00-b6d0-491f-a293-cad002a220cd None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:44:14.449019 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8a9b79-b499-4181-99fd-a69e54e7ab87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:44:14.449728 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8a9b79-b499-4181-99fd-a69e54e7ab87 None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:14.450050 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8a9b79-b499-4181-99fd-a69e54e7ab87 None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:14.450367 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8a9b79-b499-4181-99fd-a69e54e7ab87 None admin] PATH_INFO: `/v3/users/76fa417923c4455cac71cd092387002f` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:14.451599 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8a9b79-b499-4181-99fd-a69e54e7ab87 None admin] RBAC: Authorizing `identity:get_user(user_id=76fa417923c4455cac71cd092387002f)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:44:14.453092 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8a9b79-b499-4181-99fd-a69e54e7ab87 None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:44:14.454703 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 587/1151] 10.222.0.15 () {56 vars in 1177 bytes} [Sun Oct 9 00:44:14 2022] GET /identity/v3/users/76fa417923c4455cac71cd092387002f => generated 286 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:44:14.460935 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec34be8-d9f4-489d-b151-f253d32e4f76 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:44:14.564096 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec34be8-d9f4-489d-b151-f253d32e4f76 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:44:14.598639 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a526d4-b7ef-4a93-b57c-a1158018dbdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:44:14.599252 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a526d4-b7ef-4a93-b57c-a1158018dbdd None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:14.599543 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a526d4-b7ef-4a93-b57c-a1158018dbdd None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:14.599808 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a526d4-b7ef-4a93-b57c-a1158018dbdd None admin] PATH_INFO: `/v3/projects/f59c28059fea4e7b95eb5f43cc306b45` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:14.600951 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a526d4-b7ef-4a93-b57c-a1158018dbdd None admin] RBAC: Authorizing `identity:get_project(project_id=f59c28059fea4e7b95eb5f43cc306b45)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:44:14.602390 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a526d4-b7ef-4a93-b57c-a1158018dbdd None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:44:14.604065 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 565/1152] 10.222.0.15 () {56 vars in 1186 bytes} [Sun Oct 9 00:44:14 2022] GET /identity/v3/projects/f59c28059fea4e7b95eb5f43cc306b45 => generated 311 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:44:14.610410 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8a9b79-b499-4181-99fd-a69e54e7ab87 None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:44:14.708273 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8a9b79-b499-4181-99fd-a69e54e7ab87 None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:44:14.718416 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:44:14.742996 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af803072-3255-41a7-b7e7-2cda87da112b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:44:14.743693 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af803072-3255-41a7-b7e7-2cda87da112b None admin] REQUEST_METHOD: `PUT` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:14.743964 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af803072-3255-41a7-b7e7-2cda87da112b None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:14.744213 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af803072-3255-41a7-b7e7-2cda87da112b None admin] PATH_INFO: `/v3/projects/f59c28059fea4e7b95eb5f43cc306b45/users/76fa417923c4455cac71cd092387002f/roles/f69dddf26daf4dd79d4c962beb877af5` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:14.746533 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af803072-3255-41a7-b7e7-2cda87da112b None admin] RBAC: Authorizing `identity:create_grant(project_id=f59c28059fea4e7b95eb5f43cc306b45, user_id=76fa417923c4455cac71cd092387002f, role_id=f69dddf26daf4dd79d4c962beb877af5)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:44:14.748016 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af803072-3255-41a7-b7e7-2cda87da112b None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:44:14.762503 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 588/1153] 10.222.0.15 () {58 vars in 1439 bytes} [Sun Oct 9 00:44:14 2022] PUT /identity/v3/projects/f59c28059fea4e7b95eb5f43cc306b45/users/76fa417923c4455cac71cd092387002f/roles/f69dddf26daf4dd79d4c962beb877af5 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 00:44:16.897219 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c681d41-88d5-495a-9425-a9b8cd56110f None None] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:16.897808 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c681d41-88d5-495a-9425-a9b8cd56110f None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:16.897808 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c681d41-88d5-495a-9425-a9b8cd56110f None None] PATH_INFO: `/` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:16.899165 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 566/1154] 10.222.0.15 () {54 vars in 927 bytes} [Sun Oct 9 00:44:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:44:16.905269 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65492616-a4b8-4e6e-bc4e-eef060aa3b00 None None] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:16.905785 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65492616-a4b8-4e6e-bc4e-eef060aa3b00 None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:16.905785 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65492616-a4b8-4e6e-bc4e-eef060aa3b00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:16.925006 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.auth.core [None req-65492616-a4b8-4e6e-bc4e-eef060aa3b00 None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:44:16.926271 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-65492616-a4b8-4e6e-bc4e-eef060aa3b00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:44:17.007846 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 589/1155] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Oct 9 00:44:16 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 09 00:44:17.274358 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c681d41-88d5-495a-9425-a9b8cd56110f None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:44:17.343811 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:44:17.385979 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c681d41-88d5-495a-9425-a9b8cd56110f None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:44:17.422942 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc7a12d-4d73-4df7-a5c1-63f5fc6d440e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:44:17.423604 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc7a12d-4d73-4df7-a5c1-63f5fc6d440e None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:17.423876 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc7a12d-4d73-4df7-a5c1-63f5fc6d440e None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:17.424139 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc7a12d-4d73-4df7-a5c1-63f5fc6d440e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:17.435657 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc7a12d-4d73-4df7-a5c1-63f5fc6d440e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 09 00:44:17.440935 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application [None req-acc7a12d-4d73-4df7-a5c1-63f5fc6d440e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 09 00:44:17.440935 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:44:17.440935 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:44:17.440935 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:44:17.440935 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:44:17.440935 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:44:17.440935 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:44:17.440935 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:44:17.440935 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:44:17.440935 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:44:17.440935 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:44:17.440935 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:44:17.440935 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 09 00:44:17.440935 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 09 00:44:17.440935 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 09 00:44:17.440935 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 09 00:44:17.441976 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 09 00:44:17.441976 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 09 00:44:17.441976 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 09 00:44:17.441976 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 09 00:44:17.441976 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:44:17.441976 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:44:17.441976 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:44:17.441976 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:44:17.441976 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:44:17.441976 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:44:17.441976 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:44:17.441976 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application with Lock( Oct 09 00:44:17.441976 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:44:17.441976 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:44:17.441976 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:44:17.441976 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:44:17.443333 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:44:17.443333 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:44:17.443333 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:44:17.443333 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:44:17.443333 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 09 00:44:17.443333 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 09 00:44:17.443333 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 09 00:44:17.443333 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 09 00:44:17.443333 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 09 00:44:17.443333 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 09 00:44:17.443333 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 09 00:44:17.443333 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application Oct 09 00:44:17.443333 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 567/1156] 10.222.0.15 () {56 vars in 1096 bytes} [Sun Oct 9 00:44:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 09 00:44:17.448302 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65492616-a4b8-4e6e-bc4e-eef060aa3b00 None None] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:44:17.554025 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:44:17.557133 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65492616-a4b8-4e6e-bc4e-eef060aa3b00 None None] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:44:17.594143 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b9114d-afcf-4af2-a142-65fc004690ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:44:17.594759 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b9114d-afcf-4af2-a142-65fc004690ad None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:17.595032 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b9114d-afcf-4af2-a142-65fc004690ad None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:17.595324 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b9114d-afcf-4af2-a142-65fc004690ad None admin] PATH_INFO: `/v3/roles` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:17.595996 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b9114d-afcf-4af2-a142-65fc004690ad None admin] RBAC: Adding query filter params (name=admin) {{(pid=81525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:44:17.596295 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b9114d-afcf-4af2-a142-65fc004690ad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:44:17.597679 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b9114d-afcf-4af2-a142-65fc004690ad None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:44:17.606382 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 590/1157] 10.222.0.15 () {56 vars in 1099 bytes} [Sun Oct 9 00:44:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 09 00:44:17.616072 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc7a12d-4d73-4df7-a5c1-63f5fc6d440e None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:44:17.744679 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc7a12d-4d73-4df7-a5c1-63f5fc6d440e None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:44:17.767788 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:44:17.779312 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73ddf77-afd9-4de0-86aa-247717c361a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:44:17.779959 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73ddf77-afd9-4de0-86aa-247717c361a3 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:17.780229 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73ddf77-afd9-4de0-86aa-247717c361a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:17.780496 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73ddf77-afd9-4de0-86aa-247717c361a3 None admin] PATH_INFO: `/v3/users/76fa417923c4455cac71cd092387002f` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:17.781605 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73ddf77-afd9-4de0-86aa-247717c361a3 None admin] RBAC: Authorizing `identity:get_user(user_id=76fa417923c4455cac71cd092387002f)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:44:17.783111 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73ddf77-afd9-4de0-86aa-247717c361a3 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:44:17.784821 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 568/1158] 10.222.0.15 () {56 vars in 1177 bytes} [Sun Oct 9 00:44:17 2022] GET /identity/v3/users/76fa417923c4455cac71cd092387002f => generated 286 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:44:17.790966 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b9114d-afcf-4af2-a142-65fc004690ad None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:44:17.891757 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b9114d-afcf-4af2-a142-65fc004690ad None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:44:17.927180 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfb9c53-fe42-41e2-a0b9-4c7d4d037152 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:44:17.927919 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfb9c53-fe42-41e2-a0b9-4c7d4d037152 None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:17.928089 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfb9c53-fe42-41e2-a0b9-4c7d4d037152 None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:17.928349 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfb9c53-fe42-41e2-a0b9-4c7d4d037152 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:17.960083 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:44:18.001968 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfb9c53-fe42-41e2-a0b9-4c7d4d037152 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:44:18.003467 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfb9c53-fe42-41e2-a0b9-4c7d4d037152 None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:44:18.105712 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 591/1159] 10.222.0.15 () {58 vars in 1282 bytes} [Sun Oct 9 00:44:17 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 09 00:44:18.112038 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73ddf77-afd9-4de0-86aa-247717c361a3 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:44:18.223776 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73ddf77-afd9-4de0-86aa-247717c361a3 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:44:18.257942 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b38a876-ed6d-4386-95ab-3e20252d3efd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:44:18.258593 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b38a876-ed6d-4386-95ab-3e20252d3efd None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:18.258863 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b38a876-ed6d-4386-95ab-3e20252d3efd None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:18.259124 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b38a876-ed6d-4386-95ab-3e20252d3efd None admin] PATH_INFO: `/v3/projects/f59c28059fea4e7b95eb5f43cc306b45` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:18.260265 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b38a876-ed6d-4386-95ab-3e20252d3efd None admin] RBAC: Authorizing `identity:get_project(project_id=f59c28059fea4e7b95eb5f43cc306b45)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:44:18.261693 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b38a876-ed6d-4386-95ab-3e20252d3efd None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:44:18.263664 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 569/1160] 10.222.0.15 () {56 vars in 1186 bytes} [Sun Oct 9 00:44:18 2022] GET /identity/v3/projects/f59c28059fea4e7b95eb5f43cc306b45 => generated 311 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:44:18.269719 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfb9c53-fe42-41e2-a0b9-4c7d4d037152 None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:44:18.329852 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:44:18.372456 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfb9c53-fe42-41e2-a0b9-4c7d4d037152 None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:44:18.406473 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d7033e-0d50-4147-958f-edf59cd26d7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:44:18.407086 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d7033e-0d50-4147-958f-edf59cd26d7d None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:18.407441 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d7033e-0d50-4147-958f-edf59cd26d7d None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:18.407711 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d7033e-0d50-4147-958f-edf59cd26d7d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:18.408436 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d7033e-0d50-4147-958f-edf59cd26d7d None admin] RBAC: Adding query filter params (role.id=f69dddf26daf4dd79d4c962beb877af5, scope.project.id=f59c28059fea4e7b95eb5f43cc306b45, user.id=76fa417923c4455cac71cd092387002f) {{(pid=81525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:44:18.408739 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d7033e-0d50-4147-958f-edf59cd26d7d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:44:18.410176 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d7033e-0d50-4147-958f-edf59cd26d7d None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:44:18.416426 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 592/1161] 10.222.0.15 () {56 vars in 1374 bytes} [Sun Oct 9 00:44:18 2022] GET /identity/v3/role_assignments?user.id=76fa417923c4455cac71cd092387002f&scope.project.id=f59c28059fea4e7b95eb5f43cc306b45&role.id=f69dddf26daf4dd79d4c962beb877af5 => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:44:20.590652 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a98728f-6e56-4acc-b08d-f6ce0d214519 None None] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:20.591213 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a98728f-6e56-4acc-b08d-f6ce0d214519 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:20.591213 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a98728f-6e56-4acc-b08d-f6ce0d214519 None None] PATH_INFO: `/` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:20.592542 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 570/1162] 10.222.0.15 () {54 vars in 927 bytes} [Sun Oct 9 00:44:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:44:20.598068 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fac1b67-dcab-4770-bb68-98058c96c160 None None] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:20.598528 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fac1b67-dcab-4770-bb68-98058c96c160 None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:20.598628 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fac1b67-dcab-4770-bb68-98058c96c160 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:20.622127 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.auth.core [None req-7fac1b67-dcab-4770-bb68-98058c96c160 None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:44:20.623808 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-7fac1b67-dcab-4770-bb68-98058c96c160 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:44:20.711131 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 593/1163] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Oct 9 00:44:20 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 09 00:44:20.979421 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a98728f-6e56-4acc-b08d-f6ce0d214519 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:44:21.041179 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:44:21.090285 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a98728f-6e56-4acc-b08d-f6ce0d214519 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:44:21.124708 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4700c4d3-6415-4bb9-afa0-14cf1f03a95c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:44:21.125319 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4700c4d3-6415-4bb9-afa0-14cf1f03a95c None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:21.125589 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4700c4d3-6415-4bb9-afa0-14cf1f03a95c None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:21.125827 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4700c4d3-6415-4bb9-afa0-14cf1f03a95c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:21.196507 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4700c4d3-6415-4bb9-afa0-14cf1f03a95c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:44:21.197969 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4700c4d3-6415-4bb9-afa0-14cf1f03a95c None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:44:21.260636 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:44:21.303901 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 571/1164] 10.222.0.15 () {58 vars in 1282 bytes} [Sun Oct 9 00:44:20 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 09 00:44:21.310076 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fac1b67-dcab-4770-bb68-98058c96c160 None None] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:44:21.366020 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:44:21.411887 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fac1b67-dcab-4770-bb68-98058c96c160 None None] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:44:21.448986 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cede656c-2a04-4d5a-b7a2-52e7dc4d9530 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:44:21.449626 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cede656c-2a04-4d5a-b7a2-52e7dc4d9530 None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:21.449896 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cede656c-2a04-4d5a-b7a2-52e7dc4d9530 None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:21.450160 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cede656c-2a04-4d5a-b7a2-52e7dc4d9530 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:21.457285 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cede656c-2a04-4d5a-b7a2-52e7dc4d9530 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:44:21.458745 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cede656c-2a04-4d5a-b7a2-52e7dc4d9530 None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:44:21.470269 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application [None req-cede656c-2a04-4d5a-b7a2-52e7dc4d9530 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Oct 09 00:44:21.470269 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:44:21.470269 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Oct 09 00:44:21.470269 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Oct 09 00:44:21.470269 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 09 00:44:21.470269 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 09 00:44:21.470269 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 09 00:44:21.470269 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 09 00:44:21.470269 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Oct 09 00:44:21.470269 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Oct 09 00:44:21.470269 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 09 00:44:21.470269 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Oct 09 00:44:21.470269 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:44:21.470269 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:44:21.470269 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:44:21.470269 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:44:21.470269 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:44:21.475509 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:44:21.475509 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:44:21.475509 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:44:21.475509 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:44:21.475509 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:44:21.475509 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:44:21.475509 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 09 00:44:21.475509 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 09 00:44:21.475509 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 09 00:44:21.475509 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 09 00:44:21.475509 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:44:21.475509 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:44:21.475509 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:44:21.475509 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:44:21.475509 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:44:21.475509 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:44:21.476605 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:44:21.476605 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application with Lock( Oct 09 00:44:21.476605 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:44:21.476605 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:44:21.476605 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:44:21.476605 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:44:21.476605 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:44:21.476605 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:44:21.476605 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:44:21.476605 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:44:21.476605 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Oct 09 00:44:21.476605 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 09 00:44:21.476605 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Oct 09 00:44:21.476605 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Oct 09 00:44:21.476605 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 594/1165] 10.222.0.15 () {56 vars in 1117 bytes} [Sun Oct 9 00:44:21 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:44:21.477812 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4700c4d3-6415-4bb9-afa0-14cf1f03a95c None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:44:21.585059 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4700c4d3-6415-4bb9-afa0-14cf1f03a95c None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:44:21.621793 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852deee0-d4b0-4e9f-9ab4-978bd00c19ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:44:21.622474 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852deee0-d4b0-4e9f-9ab4-978bd00c19ae None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:21.622683 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852deee0-d4b0-4e9f-9ab4-978bd00c19ae None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:21.622946 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852deee0-d4b0-4e9f-9ab4-978bd00c19ae None admin] PATH_INFO: `/v3/domains` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:21.623615 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852deee0-d4b0-4e9f-9ab4-978bd00c19ae None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:44:21.623914 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852deee0-d4b0-4e9f-9ab4-978bd00c19ae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:44:21.625282 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852deee0-d4b0-4e9f-9ab4-978bd00c19ae None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:44:21.632699 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 572/1166] 10.222.0.15 () {56 vars in 1115 bytes} [Sun Oct 9 00:44:21 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:44:23.773597 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99724f7-5492-4f21-8e14-c1a35a739537 None None] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:23.774147 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99724f7-5492-4f21-8e14-c1a35a739537 None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:23.774147 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99724f7-5492-4f21-8e14-c1a35a739537 None None] PATH_INFO: `/` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:23.775439 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 595/1167] 10.222.0.15 () {54 vars in 927 bytes} [Sun Oct 9 00:44:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:44:23.781059 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920bde05-6256-4c14-9e90-9cfa32e8e94c None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:23.781495 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920bde05-6256-4c14-9e90-9cfa32e8e94c None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:23.781591 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920bde05-6256-4c14-9e90-9cfa32e8e94c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:23.801037 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-920bde05-6256-4c14-9e90-9cfa32e8e94c None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:44:23.802237 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-920bde05-6256-4c14-9e90-9cfa32e8e94c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:44:23.821478 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:44:23.876868 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 573/1168] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Oct 9 00:44:23 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 09 00:44:24.140968 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99724f7-5492-4f21-8e14-c1a35a739537 None None] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:44:24.246694 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99724f7-5492-4f21-8e14-c1a35a739537 None None] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:44:24.263579 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:44:24.283402 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c775ef6-6ae3-421d-a095-bcc83747ef8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:44:24.284005 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c775ef6-6ae3-421d-a095-bcc83747ef8d None admin] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:24.284273 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c775ef6-6ae3-421d-a095-bcc83747ef8d None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:24.284537 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c775ef6-6ae3-421d-a095-bcc83747ef8d None admin] PATH_INFO: `/v3/domains` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:24.285265 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c775ef6-6ae3-421d-a095-bcc83747ef8d None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:44:24.286635 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c775ef6-6ae3-421d-a095-bcc83747ef8d None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:44:24.304338 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 596/1169] 10.222.0.15 () {60 vars in 1138 bytes} [Sun Oct 9 00:44:24 2022] POST /identity/v3/domains => generated 267 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 09 00:44:26.544855 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb56dc7-4a90-4ef8-a411-a8c7118fb713 None None] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:26.545444 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb56dc7-4a90-4ef8-a411-a8c7118fb713 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:26.545444 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb56dc7-4a90-4ef8-a411-a8c7118fb713 None None] PATH_INFO: `/` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:26.546727 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 574/1170] 10.222.0.15 () {54 vars in 927 bytes} [Sun Oct 9 00:44:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:44:26.555513 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cd53e9-0a5b-4c2d-a425-59ac287729ba None None] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:26.555929 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cd53e9-0a5b-4c2d-a425-59ac287729ba None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:26.556122 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cd53e9-0a5b-4c2d-a425-59ac287729ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:26.579881 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.auth.core [None req-f2cd53e9-0a5b-4c2d-a425-59ac287729ba None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:44:26.581642 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-f2cd53e9-0a5b-4c2d-a425-59ac287729ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:44:26.657266 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 597/1171] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Oct 9 00:44:26 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 09 00:44:26.944192 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb56dc7-4a90-4ef8-a411-a8c7118fb713 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:44:27.075984 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb56dc7-4a90-4ef8-a411-a8c7118fb713 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:44:27.114367 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd1bb57-30c5-4ccb-b1c1-5fe8a1de8a9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:44:27.114994 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd1bb57-30c5-4ccb-b1c1-5fe8a1de8a9f None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:27.115292 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd1bb57-30c5-4ccb-b1c1-5fe8a1de8a9f None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:27.115695 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd1bb57-30c5-4ccb-b1c1-5fe8a1de8a9f None admin] PATH_INFO: `/v3/domains/9f3d1c3bc4d84d33a42828b2c5620965` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:27.127222 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd1bb57-30c5-4ccb-b1c1-5fe8a1de8a9f None admin] RBAC: Authorizing `identity:get_domain(domain_id=9f3d1c3bc4d84d33a42828b2c5620965)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:44:27.128892 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd1bb57-30c5-4ccb-b1c1-5fe8a1de8a9f None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:44:27.130765 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 575/1172] 10.222.0.15 () {56 vars in 1183 bytes} [Sun Oct 9 00:44:26 2022] GET /identity/v3/domains/9f3d1c3bc4d84d33a42828b2c5620965 => generated 267 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:44:27.138715 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cd53e9-0a5b-4c2d-a425-59ac287729ba None None] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:44:27.243452 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cd53e9-0a5b-4c2d-a425-59ac287729ba None None] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:44:27.251701 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:44:27.281800 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606ee694-16ce-47b7-8c80-ed945a5f4f0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:44:27.282413 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606ee694-16ce-47b7-8c80-ed945a5f4f0f None admin] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:27.282684 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606ee694-16ce-47b7-8c80-ed945a5f4f0f None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:27.282950 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606ee694-16ce-47b7-8c80-ed945a5f4f0f None admin] PATH_INFO: `/v3/projects` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:27.283623 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606ee694-16ce-47b7-8c80-ed945a5f4f0f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:44:27.285147 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606ee694-16ce-47b7-8c80-ed945a5f4f0f None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:44:27.311681 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 598/1173] 10.222.0.15 () {60 vars in 1141 bytes} [Sun Oct 9 00:44:27 2022] POST /identity/v3/projects => generated 361 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 09 00:44:29.530880 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdba38b4-55e0-4026-aa27-105d511d0bdd None None] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:29.531479 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdba38b4-55e0-4026-aa27-105d511d0bdd None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:29.531479 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdba38b4-55e0-4026-aa27-105d511d0bdd None None] PATH_INFO: `/` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:29.532785 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 576/1174] 10.222.0.15 () {54 vars in 927 bytes} [Sun Oct 9 00:44:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:44:29.538604 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b80c4a-395b-427b-847a-41f96c3d898a None None] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:29.539052 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b80c4a-395b-427b-847a-41f96c3d898a None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:29.539169 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b80c4a-395b-427b-847a-41f96c3d898a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:29.558140 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.auth.core [None req-15b80c4a-395b-427b-847a-41f96c3d898a None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:44:29.559376 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-15b80c4a-395b-427b-847a-41f96c3d898a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:44:29.628565 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 599/1175] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Oct 9 00:44:29 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 09 00:44:29.889776 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdba38b4-55e0-4026-aa27-105d511d0bdd None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:44:29.907054 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:44:29.994027 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdba38b4-55e0-4026-aa27-105d511d0bdd None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:44:30.028029 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edd077b-23cf-4b55-858c-0ae949ba8af8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:44:30.028650 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edd077b-23cf-4b55-858c-0ae949ba8af8 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:30.028920 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edd077b-23cf-4b55-858c-0ae949ba8af8 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:30.029187 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edd077b-23cf-4b55-858c-0ae949ba8af8 None admin] PATH_INFO: `/v3/domains/9f3d1c3bc4d84d33a42828b2c5620965` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:30.030336 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edd077b-23cf-4b55-858c-0ae949ba8af8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=9f3d1c3bc4d84d33a42828b2c5620965)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:44:30.031802 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edd077b-23cf-4b55-858c-0ae949ba8af8 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:44:30.033372 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 577/1176] 10.222.0.15 () {56 vars in 1183 bytes} [Sun Oct 9 00:44:29 2022] GET /identity/v3/domains/9f3d1c3bc4d84d33a42828b2c5620965 => generated 267 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:44:30.039531 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b80c4a-395b-427b-847a-41f96c3d898a None None] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:44:30.127571 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:44:30.140857 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b80c4a-395b-427b-847a-41f96c3d898a None None] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:44:30.176886 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b45bad-def3-40d1-9350-008b57075994 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:44:30.177492 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b45bad-def3-40d1-9350-008b57075994 None admin] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:30.177763 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b45bad-def3-40d1-9350-008b57075994 None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:30.178028 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b45bad-def3-40d1-9350-008b57075994 None admin] PATH_INFO: `/v3/users` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:30.178672 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b45bad-def3-40d1-9350-008b57075994 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:44:30.180164 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b45bad-def3-40d1-9350-008b57075994 None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:44:30.203727 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 600/1177] 10.222.0.15 () {60 vars in 1132 bytes} [Sun Oct 9 00:44:30 2022] POST /identity/v3/users => generated 311 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 09 00:44:32.375127 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a9db3c-8164-4c02-8bf8-812c6470d490 None None] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:32.376270 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a9db3c-8164-4c02-8bf8-812c6470d490 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:32.376270 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a9db3c-8164-4c02-8bf8-812c6470d490 None None] PATH_INFO: `/` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:32.377027 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 578/1178] 10.222.0.15 () {54 vars in 927 bytes} [Sun Oct 9 00:44:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:44:32.382825 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a3ce06-8238-4e62-8793-1c86951887fc None None] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:32.383308 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a3ce06-8238-4e62-8793-1c86951887fc None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:32.383437 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a3ce06-8238-4e62-8793-1c86951887fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:32.402430 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.auth.core [None req-a7a3ce06-8238-4e62-8793-1c86951887fc None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:44:32.403660 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-a7a3ce06-8238-4e62-8793-1c86951887fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:44:32.479422 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 601/1179] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Oct 9 00:44:32 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 09 00:44:32.742338 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a9db3c-8164-4c02-8bf8-812c6470d490 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:44:32.828020 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:44:32.848056 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a9db3c-8164-4c02-8bf8-812c6470d490 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:44:32.882831 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bd648c-572a-4f10-a2d8-a7e2107400aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:44:32.883483 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bd648c-572a-4f10-a2d8-a7e2107400aa None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:32.883759 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bd648c-572a-4f10-a2d8-a7e2107400aa None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:32.884021 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bd648c-572a-4f10-a2d8-a7e2107400aa None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:32.895193 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bd648c-572a-4f10-a2d8-a7e2107400aa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 09 00:44:32.899975 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application [None req-40bd648c-572a-4f10-a2d8-a7e2107400aa None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 09 00:44:32.899975 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:44:32.899975 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:44:32.899975 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:44:32.899975 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:44:32.899975 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:44:32.899975 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:44:32.899975 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:44:32.899975 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:44:32.899975 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:44:32.899975 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:44:32.899975 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:44:32.899975 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 09 00:44:32.899975 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 09 00:44:32.899975 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 09 00:44:32.899975 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 09 00:44:32.901053 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 09 00:44:32.901053 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 09 00:44:32.901053 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 09 00:44:32.901053 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 09 00:44:32.901053 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:44:32.901053 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:44:32.901053 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:44:32.901053 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:44:32.901053 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:44:32.901053 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:44:32.901053 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:44:32.901053 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application with Lock( Oct 09 00:44:32.901053 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:44:32.901053 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:44:32.901053 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:44:32.901053 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:44:32.901927 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:44:32.901927 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:44:32.901927 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:44:32.901927 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:44:32.901927 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 09 00:44:32.901927 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 09 00:44:32.901927 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 09 00:44:32.901927 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 09 00:44:32.901927 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 09 00:44:32.901927 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 09 00:44:32.901927 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 09 00:44:32.901927 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application Oct 09 00:44:32.901927 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 579/1180] 10.222.0.15 () {56 vars in 1096 bytes} [Sun Oct 9 00:44:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:44:32.907395 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a3ce06-8238-4e62-8793-1c86951887fc None None] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:44:32.987125 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:44:33.016530 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a3ce06-8238-4e62-8793-1c86951887fc None None] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:44:33.051282 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340c0323-8b4b-4faf-bf0f-0e2255d0e3bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:44:33.051911 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340c0323-8b4b-4faf-bf0f-0e2255d0e3bf None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:33.052183 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340c0323-8b4b-4faf-bf0f-0e2255d0e3bf None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:33.052453 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340c0323-8b4b-4faf-bf0f-0e2255d0e3bf None admin] PATH_INFO: `/v3/roles` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:33.053117 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340c0323-8b4b-4faf-bf0f-0e2255d0e3bf None admin] RBAC: Adding query filter params (name=admin) {{(pid=81525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:44:33.053420 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340c0323-8b4b-4faf-bf0f-0e2255d0e3bf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:44:33.054790 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340c0323-8b4b-4faf-bf0f-0e2255d0e3bf None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:44:33.063281 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 602/1181] 10.222.0.15 () {56 vars in 1099 bytes} [Sun Oct 9 00:44:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:44:33.069706 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bd648c-572a-4f10-a2d8-a7e2107400aa None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:44:33.180527 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bd648c-572a-4f10-a2d8-a7e2107400aa None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:44:33.214901 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d441f1-9ed8-4b90-aba8-45b2f09bcb15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:44:33.215565 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d441f1-9ed8-4b90-aba8-45b2f09bcb15 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:33.215837 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d441f1-9ed8-4b90-aba8-45b2f09bcb15 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:33.216109 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d441f1-9ed8-4b90-aba8-45b2f09bcb15 None admin] PATH_INFO: `/v3/users/fb0ddbeb40a248ada72bb4417c80f8c5` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:33.227799 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:44:33.230087 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d441f1-9ed8-4b90-aba8-45b2f09bcb15 None admin] RBAC: Authorizing `identity:get_user(user_id=fb0ddbeb40a248ada72bb4417c80f8c5)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:44:33.231781 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d441f1-9ed8-4b90-aba8-45b2f09bcb15 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:44:33.233440 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 580/1182] 10.222.0.15 () {56 vars in 1177 bytes} [Sun Oct 9 00:44:33 2022] GET /identity/v3/users/fb0ddbeb40a248ada72bb4417c80f8c5 => generated 311 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:44:33.239755 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340c0323-8b4b-4faf-bf0f-0e2255d0e3bf None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:44:33.342715 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340c0323-8b4b-4faf-bf0f-0e2255d0e3bf None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:44:33.383331 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ad7eed-e520-461b-9e15-371fec5e4e8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:44:33.384226 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ad7eed-e520-461b-9e15-371fec5e4e8c None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:33.384687 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ad7eed-e520-461b-9e15-371fec5e4e8c None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:33.385035 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ad7eed-e520-461b-9e15-371fec5e4e8c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:33.390790 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:44:33.470540 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ad7eed-e520-461b-9e15-371fec5e4e8c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:44:33.472163 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ad7eed-e520-461b-9e15-371fec5e4e8c None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:44:33.569163 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 603/1183] 10.222.0.15 () {58 vars in 1282 bytes} [Sun Oct 9 00:44:33 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 09 00:44:33.575723 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d441f1-9ed8-4b90-aba8-45b2f09bcb15 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:44:33.678784 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d441f1-9ed8-4b90-aba8-45b2f09bcb15 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:44:33.713168 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9440f126-2770-4fdc-beca-c3dfa6d23cda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:44:33.713796 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9440f126-2770-4fdc-beca-c3dfa6d23cda None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:33.714070 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9440f126-2770-4fdc-beca-c3dfa6d23cda None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:33.714346 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9440f126-2770-4fdc-beca-c3dfa6d23cda None admin] PATH_INFO: `/v3/projects/0797674a7ec64d4dbd22591ad4397d98` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:33.715479 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9440f126-2770-4fdc-beca-c3dfa6d23cda None admin] RBAC: Authorizing `identity:get_project(project_id=0797674a7ec64d4dbd22591ad4397d98)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:44:33.716927 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9440f126-2770-4fdc-beca-c3dfa6d23cda None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:44:33.718568 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 581/1184] 10.222.0.15 () {56 vars in 1186 bytes} [Sun Oct 9 00:44:33 2022] GET /identity/v3/projects/0797674a7ec64d4dbd22591ad4397d98 => generated 361 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:44:33.725086 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ad7eed-e520-461b-9e15-371fec5e4e8c None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:44:33.761605 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:44:33.828011 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ad7eed-e520-461b-9e15-371fec5e4e8c None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:44:33.864038 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020bd9f9-ad63-4e50-83b0-0f8db1fcb4ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:44:33.864642 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020bd9f9-ad63-4e50-83b0-0f8db1fcb4ff None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:33.864911 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020bd9f9-ad63-4e50-83b0-0f8db1fcb4ff None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:33.865177 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020bd9f9-ad63-4e50-83b0-0f8db1fcb4ff None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:33.865889 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020bd9f9-ad63-4e50-83b0-0f8db1fcb4ff None admin] RBAC: Adding query filter params (role.id=f69dddf26daf4dd79d4c962beb877af5, scope.project.id=0797674a7ec64d4dbd22591ad4397d98, user.id=fb0ddbeb40a248ada72bb4417c80f8c5) {{(pid=81525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:44:33.866188 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020bd9f9-ad63-4e50-83b0-0f8db1fcb4ff None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:44:33.867655 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020bd9f9-ad63-4e50-83b0-0f8db1fcb4ff None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:44:33.873398 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 604/1185] 10.222.0.15 () {56 vars in 1374 bytes} [Sun Oct 9 00:44:33 2022] GET /identity/v3/role_assignments?user.id=fb0ddbeb40a248ada72bb4417c80f8c5&scope.project.id=0797674a7ec64d4dbd22591ad4397d98&role.id=f69dddf26daf4dd79d4c962beb877af5 => generated 259 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:44:36.003328 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e741a9c-ebfd-408a-86ba-cf9070f4ebf6 None None] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:36.003932 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e741a9c-ebfd-408a-86ba-cf9070f4ebf6 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:36.003932 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e741a9c-ebfd-408a-86ba-cf9070f4ebf6 None None] PATH_INFO: `/` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:36.005190 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 582/1186] 10.222.0.15 () {54 vars in 927 bytes} [Sun Oct 9 00:44:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:44:36.011193 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8b1834-df0c-4b90-9fcf-81eae1120c76 None None] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:36.011674 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8b1834-df0c-4b90-9fcf-81eae1120c76 None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:36.011763 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8b1834-df0c-4b90-9fcf-81eae1120c76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:36.033161 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.auth.core [None req-5a8b1834-df0c-4b90-9fcf-81eae1120c76 None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:44:36.033161 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-5a8b1834-df0c-4b90-9fcf-81eae1120c76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:44:36.116542 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 605/1187] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Oct 9 00:44:36 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 09 00:44:36.389342 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e741a9c-ebfd-408a-86ba-cf9070f4ebf6 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:44:36.465946 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:44:36.502061 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e741a9c-ebfd-408a-86ba-cf9070f4ebf6 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:44:36.549651 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b675a207-6446-49bc-b246-b67f8cc784b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:44:36.550339 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b675a207-6446-49bc-b246-b67f8cc784b9 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:36.550614 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b675a207-6446-49bc-b246-b67f8cc784b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:36.550880 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b675a207-6446-49bc-b246-b67f8cc784b9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:36.561814 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b675a207-6446-49bc-b246-b67f8cc784b9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 09 00:44:36.566666 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application [None req-b675a207-6446-49bc-b246-b67f8cc784b9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 09 00:44:36.566666 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:44:36.566666 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:44:36.566666 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:44:36.566666 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:44:36.566666 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:44:36.566666 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:44:36.566666 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:44:36.566666 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:44:36.566666 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:44:36.566666 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:44:36.566666 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:44:36.566666 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 09 00:44:36.566666 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 09 00:44:36.566666 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 09 00:44:36.566666 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 09 00:44:36.567827 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 09 00:44:36.567827 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 09 00:44:36.567827 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 09 00:44:36.567827 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 09 00:44:36.567827 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:44:36.567827 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:44:36.567827 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:44:36.567827 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:44:36.567827 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:44:36.567827 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:44:36.567827 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:44:36.567827 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application with Lock( Oct 09 00:44:36.567827 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:44:36.567827 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:44:36.567827 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:44:36.567827 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:44:36.569011 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:44:36.569011 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:44:36.569011 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:44:36.569011 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:44:36.569011 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 09 00:44:36.569011 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 09 00:44:36.569011 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 09 00:44:36.569011 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 09 00:44:36.569011 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 09 00:44:36.569011 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 09 00:44:36.569011 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 09 00:44:36.569011 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application Oct 09 00:44:36.569011 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 583/1188] 10.222.0.15 () {56 vars in 1096 bytes} [Sun Oct 9 00:44:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:44:36.574304 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8b1834-df0c-4b90-9fcf-81eae1120c76 None None] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:44:36.603826 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:44:36.674079 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8b1834-df0c-4b90-9fcf-81eae1120c76 None None] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:44:36.707913 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7affad-3e37-40af-8318-251602ff9098 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:44:36.708514 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7affad-3e37-40af-8318-251602ff9098 None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:36.708783 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7affad-3e37-40af-8318-251602ff9098 None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:36.709050 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7affad-3e37-40af-8318-251602ff9098 None admin] PATH_INFO: `/v3/roles` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:36.709696 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7affad-3e37-40af-8318-251602ff9098 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:44:36.709990 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7affad-3e37-40af-8318-251602ff9098 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:44:36.711376 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7affad-3e37-40af-8318-251602ff9098 None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:44:36.719483 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 606/1189] 10.222.0.15 () {56 vars in 1099 bytes} [Sun Oct 9 00:44:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:44:36.725637 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b675a207-6446-49bc-b246-b67f8cc784b9 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:44:36.830681 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b675a207-6446-49bc-b246-b67f8cc784b9 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:44:36.859322 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:44:36.868254 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58787151-62b1-4f78-97a0-f812973795de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:44:36.868885 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58787151-62b1-4f78-97a0-f812973795de None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:36.869158 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58787151-62b1-4f78-97a0-f812973795de None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:36.869427 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58787151-62b1-4f78-97a0-f812973795de None admin] PATH_INFO: `/v3/users/fb0ddbeb40a248ada72bb4417c80f8c5` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:36.870899 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58787151-62b1-4f78-97a0-f812973795de None admin] RBAC: Authorizing `identity:get_user(user_id=fb0ddbeb40a248ada72bb4417c80f8c5)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:44:36.872377 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58787151-62b1-4f78-97a0-f812973795de None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:44:36.873998 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 584/1190] 10.222.0.15 () {56 vars in 1177 bytes} [Sun Oct 9 00:44:36 2022] GET /identity/v3/users/fb0ddbeb40a248ada72bb4417c80f8c5 => generated 311 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:44:36.880982 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7affad-3e37-40af-8318-251602ff9098 None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:44:36.975787 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:44:36.984716 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7affad-3e37-40af-8318-251602ff9098 None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:44:37.019476 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9978a2b4-06c8-4ded-9044-cb9e32976acc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:44:37.020145 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9978a2b4-06c8-4ded-9044-cb9e32976acc None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:37.020358 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9978a2b4-06c8-4ded-9044-cb9e32976acc None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:37.020621 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9978a2b4-06c8-4ded-9044-cb9e32976acc None admin] PATH_INFO: `/v3/projects/0797674a7ec64d4dbd22591ad4397d98` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:37.021722 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9978a2b4-06c8-4ded-9044-cb9e32976acc None admin] RBAC: Authorizing `identity:get_project(project_id=0797674a7ec64d4dbd22591ad4397d98)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:44:37.023164 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9978a2b4-06c8-4ded-9044-cb9e32976acc None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:44:37.024841 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 607/1191] 10.222.0.15 () {56 vars in 1186 bytes} [Sun Oct 9 00:44:36 2022] GET /identity/v3/projects/0797674a7ec64d4dbd22591ad4397d98 => generated 361 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:44:37.031248 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58787151-62b1-4f78-97a0-f812973795de None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:44:37.137165 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58787151-62b1-4f78-97a0-f812973795de None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:44:37.171639 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9648f308-8496-4734-9350-6e3fa5602a46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:44:37.172537 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9648f308-8496-4734-9350-6e3fa5602a46 None admin] REQUEST_METHOD: `PUT` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:37.173992 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9648f308-8496-4734-9350-6e3fa5602a46 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:37.174405 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9648f308-8496-4734-9350-6e3fa5602a46 None admin] PATH_INFO: `/v3/projects/0797674a7ec64d4dbd22591ad4397d98/users/fb0ddbeb40a248ada72bb4417c80f8c5/roles/f69dddf26daf4dd79d4c962beb877af5` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:37.176741 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9648f308-8496-4734-9350-6e3fa5602a46 None admin] RBAC: Authorizing `identity:create_grant(project_id=0797674a7ec64d4dbd22591ad4397d98, user_id=fb0ddbeb40a248ada72bb4417c80f8c5, role_id=f69dddf26daf4dd79d4c962beb877af5)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:44:37.178195 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9648f308-8496-4734-9350-6e3fa5602a46 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:44:37.192675 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 585/1192] 10.222.0.15 () {58 vars in 1439 bytes} [Sun Oct 9 00:44:37 2022] PUT /identity/v3/projects/0797674a7ec64d4dbd22591ad4397d98/users/fb0ddbeb40a248ada72bb4417c80f8c5/roles/f69dddf26daf4dd79d4c962beb877af5 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 00:44:39.326054 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2cc10b-7878-403e-b0aa-5b991c7d9863 None None] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:39.326634 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2cc10b-7878-403e-b0aa-5b991c7d9863 None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:39.326634 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2cc10b-7878-403e-b0aa-5b991c7d9863 None None] PATH_INFO: `/` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:39.327981 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 608/1193] 10.222.0.15 () {54 vars in 927 bytes} [Sun Oct 9 00:44:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:44:39.333654 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be4e4a6-3243-44b8-9e5a-5ad2d2393e15 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:39.334121 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be4e4a6-3243-44b8-9e5a-5ad2d2393e15 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:39.334222 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be4e4a6-3243-44b8-9e5a-5ad2d2393e15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:39.352822 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-9be4e4a6-3243-44b8-9e5a-5ad2d2393e15 None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:44:39.354015 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-9be4e4a6-3243-44b8-9e5a-5ad2d2393e15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:44:39.406221 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:44:39.425738 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 586/1194] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Oct 9 00:44:39 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 09 00:44:39.690556 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2cc10b-7878-403e-b0aa-5b991c7d9863 None None] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:44:39.797054 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2cc10b-7878-403e-b0aa-5b991c7d9863 None None] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:44:39.831910 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf59fa00-9bcf-4ee2-b974-fbb8b2d4c1c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:44:39.832536 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf59fa00-9bcf-4ee2-b974-fbb8b2d4c1c8 None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:39.832808 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf59fa00-9bcf-4ee2-b974-fbb8b2d4c1c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:39.833074 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf59fa00-9bcf-4ee2-b974-fbb8b2d4c1c8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:39.843372 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf59fa00-9bcf-4ee2-b974-fbb8b2d4c1c8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 09 00:44:39.848240 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application [None req-cf59fa00-9bcf-4ee2-b974-fbb8b2d4c1c8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 09 00:44:39.848240 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:44:39.848240 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:44:39.848240 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:44:39.848240 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:44:39.848240 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:44:39.848240 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:44:39.848240 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:44:39.848240 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:44:39.848240 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:44:39.848240 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:44:39.848240 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:44:39.848240 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 09 00:44:39.848240 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 09 00:44:39.848240 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 09 00:44:39.848240 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 09 00:44:39.849311 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 09 00:44:39.849311 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 09 00:44:39.849311 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 09 00:44:39.849311 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 09 00:44:39.849311 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:44:39.849311 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:44:39.849311 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:44:39.849311 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:44:39.849311 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:44:39.849311 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:44:39.849311 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:44:39.849311 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application with Lock( Oct 09 00:44:39.849311 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:44:39.849311 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:44:39.849311 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:44:39.849311 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:44:39.850390 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:44:39.850390 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:44:39.850390 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:44:39.850390 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:44:39.850390 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 09 00:44:39.850390 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 09 00:44:39.850390 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 09 00:44:39.850390 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 09 00:44:39.850390 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 09 00:44:39.850390 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 09 00:44:39.850390 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 09 00:44:39.850390 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Oct 09 00:44:39.851440 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 609/1195] 10.222.0.15 () {56 vars in 1096 bytes} [Sun Oct 9 00:44:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:44:39.855536 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be4e4a6-3243-44b8-9e5a-5ad2d2393e15 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:44:39.956149 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be4e4a6-3243-44b8-9e5a-5ad2d2393e15 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:44:39.991347 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2ba321-302f-4149-88fc-c46c32984943 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:44:39.991983 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2ba321-302f-4149-88fc-c46c32984943 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:39.992259 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2ba321-302f-4149-88fc-c46c32984943 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:39.992529 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2ba321-302f-4149-88fc-c46c32984943 None admin] PATH_INFO: `/v3/roles` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:39.993204 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2ba321-302f-4149-88fc-c46c32984943 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:44:39.993506 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2ba321-302f-4149-88fc-c46c32984943 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:44:39.994973 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2ba321-302f-4149-88fc-c46c32984943 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:44:40.003612 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 587/1196] 10.222.0.15 () {56 vars in 1099 bytes} [Sun Oct 9 00:44:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:44:40.009831 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf59fa00-9bcf-4ee2-b974-fbb8b2d4c1c8 None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:44:40.032556 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:44:40.112480 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf59fa00-9bcf-4ee2-b974-fbb8b2d4c1c8 None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:44:40.149296 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94e0ad0-a8b0-4333-b5b3-fd76b86fa1ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:44:40.149916 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94e0ad0-a8b0-4333-b5b3-fd76b86fa1ca None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:40.150186 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94e0ad0-a8b0-4333-b5b3-fd76b86fa1ca None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:40.150468 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94e0ad0-a8b0-4333-b5b3-fd76b86fa1ca None admin] PATH_INFO: `/v3/users/fb0ddbeb40a248ada72bb4417c80f8c5` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:40.151651 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94e0ad0-a8b0-4333-b5b3-fd76b86fa1ca None admin] RBAC: Authorizing `identity:get_user(user_id=fb0ddbeb40a248ada72bb4417c80f8c5)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:44:40.153077 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94e0ad0-a8b0-4333-b5b3-fd76b86fa1ca None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:44:40.154651 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 610/1197] 10.222.0.15 () {56 vars in 1177 bytes} [Sun Oct 9 00:44:40 2022] GET /identity/v3/users/fb0ddbeb40a248ada72bb4417c80f8c5 => generated 311 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 09 00:44:40.160843 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2ba321-302f-4149-88fc-c46c32984943 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:44:40.212987 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:44:40.263954 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2ba321-302f-4149-88fc-c46c32984943 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:44:40.298745 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f488948d-178b-4220-9b3a-db4b4c397ec6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:44:40.299389 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f488948d-178b-4220-9b3a-db4b4c397ec6 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:40.299702 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f488948d-178b-4220-9b3a-db4b4c397ec6 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:40.300035 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f488948d-178b-4220-9b3a-db4b4c397ec6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:40.365322 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f488948d-178b-4220-9b3a-db4b4c397ec6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:44:40.366774 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f488948d-178b-4220-9b3a-db4b4c397ec6 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:44:40.415037 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:44:40.468794 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 588/1198] 10.222.0.15 () {58 vars in 1282 bytes} [Sun Oct 9 00:44:40 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 09 00:44:40.475024 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94e0ad0-a8b0-4333-b5b3-fd76b86fa1ca None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:44:40.563490 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:44:40.576082 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94e0ad0-a8b0-4333-b5b3-fd76b86fa1ca None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:44:40.610319 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6141dfab-6749-44ae-bf3d-14db92ea382f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:44:40.610941 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6141dfab-6749-44ae-bf3d-14db92ea382f None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:40.611209 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6141dfab-6749-44ae-bf3d-14db92ea382f None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:40.611512 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6141dfab-6749-44ae-bf3d-14db92ea382f None admin] PATH_INFO: `/v3/projects/0797674a7ec64d4dbd22591ad4397d98` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:40.612736 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6141dfab-6749-44ae-bf3d-14db92ea382f None admin] RBAC: Authorizing `identity:get_project(project_id=0797674a7ec64d4dbd22591ad4397d98)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:44:40.614203 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6141dfab-6749-44ae-bf3d-14db92ea382f None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:44:40.615977 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 611/1199] 10.222.0.15 () {56 vars in 1186 bytes} [Sun Oct 9 00:44:40 2022] GET /identity/v3/projects/0797674a7ec64d4dbd22591ad4397d98 => generated 361 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:44:40.622802 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f488948d-178b-4220-9b3a-db4b4c397ec6 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:44:40.725753 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f488948d-178b-4220-9b3a-db4b4c397ec6 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:44:40.761086 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd3255a-bd61-4d8f-8dfe-2ff63e1224fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:44:40.761686 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd3255a-bd61-4d8f-8dfe-2ff63e1224fb None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:44:40.761959 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd3255a-bd61-4d8f-8dfe-2ff63e1224fb None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:44:40.762226 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd3255a-bd61-4d8f-8dfe-2ff63e1224fb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:44:40.762943 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd3255a-bd61-4d8f-8dfe-2ff63e1224fb None admin] RBAC: Adding query filter params (role.id=f69dddf26daf4dd79d4c962beb877af5, scope.project.id=0797674a7ec64d4dbd22591ad4397d98, user.id=fb0ddbeb40a248ada72bb4417c80f8c5) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:44:40.763241 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd3255a-bd61-4d8f-8dfe-2ff63e1224fb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:44:40.764739 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd3255a-bd61-4d8f-8dfe-2ff63e1224fb None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:44:40.770460 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 589/1200] 10.222.0.15 () {56 vars in 1374 bytes} [Sun Oct 9 00:44:40 2022] GET /identity/v3/role_assignments?user.id=fb0ddbeb40a248ada72bb4417c80f8c5&scope.project.id=0797674a7ec64d4dbd22591ad4397d98&role.id=f69dddf26daf4dd79d4c962beb877af5 => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:44:50.605567 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=22 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:44:50.768283 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=94 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:45:40.090942 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dd1fb3-1f4b-4041-bf88-3aad7c805cac None None] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:45:40.091596 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dd1fb3-1f4b-4041-bf88-3aad7c805cac None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:45:40.091596 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dd1fb3-1f4b-4041-bf88-3aad7c805cac None None] PATH_INFO: `/` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:45:40.093303 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 612/1201] 10.222.0.15 () {54 vars in 927 bytes} [Sun Oct 9 00:45:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:45:40.100062 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34923561-b589-4420-8ed3-b70a74e2263d None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:45:40.100997 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34923561-b589-4420-8ed3-b70a74e2263d None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:45:40.100997 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34923561-b589-4420-8ed3-b70a74e2263d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:45:40.125333 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-34923561-b589-4420-8ed3-b70a74e2263d None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:45:40.126640 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-34923561-b589-4420-8ed3-b70a74e2263d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:45:40.246406 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 590/1202] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Oct 9 00:45:40 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 09 00:45:40.753949 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dd1fb3-1f4b-4041-bf88-3aad7c805cac None None] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:45:40.961904 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dd1fb3-1f4b-4041-bf88-3aad7c805cac None None] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:45:41.032433 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5071dc1-e0b8-45ed-84d8-579598684fdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:45:41.033391 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5071dc1-e0b8-45ed-84d8-579598684fdd None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:45:41.033969 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5071dc1-e0b8-45ed-84d8-579598684fdd None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:45:41.038131 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5071dc1-e0b8-45ed-84d8-579598684fdd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:45:41.056069 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5071dc1-e0b8-45ed-84d8-579598684fdd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:45:41.058139 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5071dc1-e0b8-45ed-84d8-579598684fdd None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:45:41.089175 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application [None req-f5071dc1-e0b8-45ed-84d8-579598684fdd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:45:41.089175 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:45:41.089175 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:45:41.089175 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:45:41.089175 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:45:41.089175 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:45:41.089175 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:45:41.089175 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:45:41.089175 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:45:41.089175 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:45:41.089175 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:45:41.089175 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:45:41.089175 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 09 00:45:41.089175 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 09 00:45:41.089175 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 09 00:45:41.089175 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 09 00:45:41.096363 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:45:41.096363 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:45:41.096363 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:45:41.096363 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:45:41.096363 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:45:41.096363 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:45:41.096363 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:45:41.096363 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application with Lock( Oct 09 00:45:41.096363 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:45:41.096363 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:45:41.096363 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:45:41.096363 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:45:41.096363 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:45:41.096363 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:45:41.096363 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:45:41.096363 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:45:41.096363 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 09 00:45:41.098232 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 09 00:45:41.098232 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:45:41.098232 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Oct 09 00:45:41.098232 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 613/1203] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Oct 9 00:45:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 339 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:45:41.102390 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34923561-b589-4420-8ed3-b70a74e2263d None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:45:41.308082 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34923561-b589-4420-8ed3-b70a74e2263d None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:45:41.377314 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:45:41.396430 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67816d5a-b70d-472e-a994-0fbdc50f4584 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:45:41.397086 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67816d5a-b70d-472e-a994-0fbdc50f4584 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:45:41.397362 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67816d5a-b70d-472e-a994-0fbdc50f4584 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:45:41.397668 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67816d5a-b70d-472e-a994-0fbdc50f4584 None admin] PATH_INFO: `/v3/domains` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:45:41.398346 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67816d5a-b70d-472e-a994-0fbdc50f4584 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:45:41.398661 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67816d5a-b70d-472e-a994-0fbdc50f4584 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:45:41.400206 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67816d5a-b70d-472e-a994-0fbdc50f4584 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:45:41.416537 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 591/1204] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Oct 9 00:45:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:45:41.424741 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5071dc1-e0b8-45ed-84d8-579598684fdd None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:45:41.574341 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:45:41.690166 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5071dc1-e0b8-45ed-84d8-579598684fdd None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:45:41.778855 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6277505-de99-4260-826c-10a310926dfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:45:41.779961 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6277505-de99-4260-826c-10a310926dfd None admin] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:45:41.780440 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6277505-de99-4260-826c-10a310926dfd None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:45:41.780872 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6277505-de99-4260-826c-10a310926dfd None admin] PATH_INFO: `/v3/users` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:45:41.782187 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6277505-de99-4260-826c-10a310926dfd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:45:41.784998 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6277505-de99-4260-826c-10a310926dfd None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:45:41.831514 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 614/1205] 10.222.0.15 () {60 vars in 1132 bytes} [Sun Oct 9 00:45:41 2022] POST /identity/v3/users => generated 251 bytes in 401 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 09 00:45:45.187038 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5762932-d697-4bd0-b446-31ac4d14b44a None None] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:45:45.188042 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5762932-d697-4bd0-b446-31ac4d14b44a None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:45:45.188257 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5762932-d697-4bd0-b446-31ac4d14b44a None None] PATH_INFO: `/` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:45:45.190934 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 592/1206] 10.222.0.15 () {54 vars in 927 bytes} [Sun Oct 9 00:45:45 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:45:45.199686 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd14eba6-472d-4c6f-81d9-e7229ed697d5 None None] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:45:45.200518 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd14eba6-472d-4c6f-81d9-e7229ed697d5 None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:45:45.200518 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd14eba6-472d-4c6f-81d9-e7229ed697d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:45:45.230961 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.auth.core [None req-cd14eba6-472d-4c6f-81d9-e7229ed697d5 None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:45:45.233795 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-cd14eba6-472d-4c6f-81d9-e7229ed697d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:45:45.371356 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 615/1207] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Oct 9 00:45:45 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 09 00:45:45.694225 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5762932-d697-4bd0-b446-31ac4d14b44a None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:45:45.905847 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5762932-d697-4bd0-b446-31ac4d14b44a None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:45:45.969289 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2bc440-2e48-4782-b8bc-440af0bff64a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:45:45.969813 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2bc440-2e48-4782-b8bc-440af0bff64a None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:45:45.969985 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2bc440-2e48-4782-b8bc-440af0bff64a None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:45:45.970262 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2bc440-2e48-4782-b8bc-440af0bff64a None admin] PATH_INFO: `/v3/roles/service` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:45:45.987074 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2bc440-2e48-4782-b8bc-440af0bff64a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 09 00:45:45.992344 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application [None req-5b2bc440-2e48-4782-b8bc-440af0bff64a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 09 00:45:45.992344 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:45:45.992344 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:45:45.992344 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:45:45.992344 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:45:45.992344 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:45:45.992344 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:45:45.992344 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:45:45.992344 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:45:45.992344 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:45:45.992344 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:45:45.992344 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:45:45.992344 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 09 00:45:45.992344 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 09 00:45:45.992344 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 09 00:45:45.992344 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 09 00:45:45.994628 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 09 00:45:45.994628 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 09 00:45:45.994628 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 09 00:45:45.994628 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 09 00:45:45.994628 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:45:45.994628 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:45:45.994628 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:45:45.994628 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:45:45.994628 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:45:45.994628 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:45:45.994628 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:45:45.994628 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application with Lock( Oct 09 00:45:45.994628 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:45:45.994628 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:45:45.994628 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:45:45.994628 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:45:45.996323 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:45:45.996323 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:45:45.996323 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:45:45.996323 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:45:45.996323 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 09 00:45:45.996323 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 09 00:45:45.996323 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 09 00:45:45.996323 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 09 00:45:45.996323 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 09 00:45:45.996323 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 09 00:45:45.996323 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 09 00:45:45.996323 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application Oct 09 00:45:45.996323 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 593/1208] 10.222.0.15 () {56 vars in 1102 bytes} [Sun Oct 9 00:45:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:45:46.001086 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd14eba6-472d-4c6f-81d9-e7229ed697d5 None None] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:45:46.081628 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:45:46.207840 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd14eba6-472d-4c6f-81d9-e7229ed697d5 None None] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:45:46.281582 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9f746f-95cf-44ff-b1c0-96cf18757e2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:45:46.283144 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9f746f-95cf-44ff-b1c0-96cf18757e2c None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:45:46.283706 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9f746f-95cf-44ff-b1c0-96cf18757e2c None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:45:46.284105 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9f746f-95cf-44ff-b1c0-96cf18757e2c None admin] PATH_INFO: `/v3/roles` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:45:46.285052 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9f746f-95cf-44ff-b1c0-96cf18757e2c None admin] RBAC: Adding query filter params (name=service) {{(pid=81525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:45:46.285515 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9f746f-95cf-44ff-b1c0-96cf18757e2c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:45:46.287329 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9f746f-95cf-44ff-b1c0-96cf18757e2c None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:45:46.302563 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 616/1209] 10.222.0.15 () {56 vars in 1103 bytes} [Sun Oct 9 00:45:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 09 00:45:46.309447 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2bc440-2e48-4782-b8bc-440af0bff64a None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:45:46.377819 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:45:46.467455 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2bc440-2e48-4782-b8bc-440af0bff64a None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:45:46.516131 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff050067-1ef6-472a-a171-1f9b3ceed018 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:45:46.517159 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff050067-1ef6-472a-a171-1f9b3ceed018 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:45:46.517682 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff050067-1ef6-472a-a171-1f9b3ceed018 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:45:46.518154 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff050067-1ef6-472a-a171-1f9b3ceed018 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:45:46.537188 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff050067-1ef6-472a-a171-1f9b3ceed018 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:45:46.539736 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff050067-1ef6-472a-a171-1f9b3ceed018 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:45:46.560937 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application [None req-ff050067-1ef6-472a-a171-1f9b3ceed018 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:45:46.560937 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:45:46.560937 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:45:46.560937 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:45:46.560937 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:45:46.560937 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:45:46.560937 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:45:46.560937 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:45:46.560937 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:45:46.560937 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:45:46.560937 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:45:46.560937 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:45:46.560937 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 09 00:45:46.560937 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 09 00:45:46.560937 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 09 00:45:46.560937 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 09 00:45:46.562995 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:45:46.562995 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:45:46.562995 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:45:46.562995 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:45:46.562995 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:45:46.562995 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:45:46.562995 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:45:46.562995 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application with Lock( Oct 09 00:45:46.562995 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:45:46.562995 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:45:46.562995 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:45:46.562995 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:45:46.562995 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:45:46.562995 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:45:46.562995 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:45:46.562995 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:45:46.562995 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 09 00:45:46.564685 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 09 00:45:46.564685 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:45:46.564685 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application Oct 09 00:45:46.564685 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 594/1210] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Oct 9 00:45:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:45:46.569536 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9f746f-95cf-44ff-b1c0-96cf18757e2c None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:45:46.690799 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:45:46.694667 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9f746f-95cf-44ff-b1c0-96cf18757e2c None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:45:46.735684 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515db255-8a0a-4b13-ba0b-585eeed9a2ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:45:46.736296 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515db255-8a0a-4b13-ba0b-585eeed9a2ac None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:45:46.736569 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515db255-8a0a-4b13-ba0b-585eeed9a2ac None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:45:46.736835 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515db255-8a0a-4b13-ba0b-585eeed9a2ac None admin] PATH_INFO: `/v3/domains` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:45:46.737501 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515db255-8a0a-4b13-ba0b-585eeed9a2ac None admin] RBAC: Adding query filter params (name=Default) {{(pid=81525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:45:46.737795 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515db255-8a0a-4b13-ba0b-585eeed9a2ac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:45:46.739201 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515db255-8a0a-4b13-ba0b-585eeed9a2ac None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:45:46.755698 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 617/1211] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Oct 9 00:45:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:45:46.762966 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff050067-1ef6-472a-a171-1f9b3ceed018 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:45:46.911119 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff050067-1ef6-472a-a171-1f9b3ceed018 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:45:46.913621 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:45:46.963557 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8c8a28-9faa-430d-b3d9-4a2bacb439e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:45:46.964630 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8c8a28-9faa-430d-b3d9-4a2bacb439e2 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:45:46.965468 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8c8a28-9faa-430d-b3d9-4a2bacb439e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:45:46.966024 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8c8a28-9faa-430d-b3d9-4a2bacb439e2 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:45:46.979736 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8c8a28-9faa-430d-b3d9-4a2bacb439e2 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:45:46.982198 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8c8a28-9faa-430d-b3d9-4a2bacb439e2 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:45:47.000475 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application [None req-be8c8a28-9faa-430d-b3d9-4a2bacb439e2 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 09 00:45:47.000475 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:45:47.000475 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:45:47.000475 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:45:47.000475 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:45:47.000475 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:45:47.000475 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:45:47.000475 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:45:47.000475 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:45:47.000475 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:45:47.000475 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:45:47.000475 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:45:47.000475 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 09 00:45:47.000475 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 09 00:45:47.000475 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 09 00:45:47.000475 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 09 00:45:47.002408 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:45:47.002408 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:45:47.002408 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 09 00:45:47.002408 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 09 00:45:47.002408 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 09 00:45:47.002408 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 09 00:45:47.002408 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:45:47.002408 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:45:47.002408 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:45:47.002408 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:45:47.002408 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:45:47.002408 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application with Lock( Oct 09 00:45:47.002408 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:45:47.002408 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:45:47.002408 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:45:47.002408 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:45:47.002408 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:45:47.002408 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:45:47.003775 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:45:47.003775 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:45:47.003775 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 09 00:45:47.003775 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 09 00:45:47.003775 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 09 00:45:47.003775 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 09 00:45:47.003775 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 09 00:45:47.003775 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 09 00:45:47.003775 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 09 00:45:47.003775 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application Oct 09 00:45:47.003775 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 595/1212] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Oct 9 00:45:46 2022] GET /identity/v3/users/placement => generated 87 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 09 00:45:47.009944 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515db255-8a0a-4b13-ba0b-585eeed9a2ac None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:45:47.164437 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515db255-8a0a-4b13-ba0b-585eeed9a2ac None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:45:47.223076 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f4ed20-ed4f-494b-bcc6-d65b98f4c6fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:45:47.224129 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f4ed20-ed4f-494b-bcc6-d65b98f4c6fd None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:45:47.224590 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f4ed20-ed4f-494b-bcc6-d65b98f4c6fd None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:45:47.225078 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f4ed20-ed4f-494b-bcc6-d65b98f4c6fd None admin] PATH_INFO: `/v3/users` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:45:47.226385 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f4ed20-ed4f-494b-bcc6-d65b98f4c6fd None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:45:47.226904 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f4ed20-ed4f-494b-bcc6-d65b98f4c6fd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:45:47.229018 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f4ed20-ed4f-494b-bcc6-d65b98f4c6fd None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:45:47.260170 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 618/1213] 10.222.0.15 () {56 vars in 1143 bytes} [Sun Oct 9 00:45:47 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:45:47.267480 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8c8a28-9faa-430d-b3d9-4a2bacb439e2 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:45:47.409208 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8c8a28-9faa-430d-b3d9-4a2bacb439e2 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:45:47.463846 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c30c82-2e01-47bf-b444-29e428ba66e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:45:47.464556 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c30c82-2e01-47bf-b444-29e428ba66e5 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:45:47.464968 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c30c82-2e01-47bf-b444-29e428ba66e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:45:47.465288 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c30c82-2e01-47bf-b444-29e428ba66e5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:45:47.504259 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:45:47.553202 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c30c82-2e01-47bf-b444-29e428ba66e5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:45:47.555901 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c30c82-2e01-47bf-b444-29e428ba66e5 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:45:47.695430 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 596/1214] 10.222.0.15 () {58 vars in 1282 bytes} [Sun Oct 9 00:45:47 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 09 00:45:47.702315 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f4ed20-ed4f-494b-bcc6-d65b98f4c6fd None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:45:47.730454 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:45:47.844614 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f4ed20-ed4f-494b-bcc6-d65b98f4c6fd None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:45:47.901571 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3e1d49-cd94-4bc6-8fd6-3455f9b0a429 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:45:47.902648 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3e1d49-cd94-4bc6-8fd6-3455f9b0a429 None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:45:47.903095 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3e1d49-cd94-4bc6-8fd6-3455f9b0a429 None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:45:47.903533 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3e1d49-cd94-4bc6-8fd6-3455f9b0a429 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:45:47.919379 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3e1d49-cd94-4bc6-8fd6-3455f9b0a429 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:45:47.921512 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3e1d49-cd94-4bc6-8fd6-3455f9b0a429 None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:45:47.943926 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application [None req-5d3e1d49-cd94-4bc6-8fd6-3455f9b0a429 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:45:47.943926 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:45:47.943926 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:45:47.943926 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:45:47.943926 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:45:47.943926 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:45:47.943926 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:45:47.943926 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:45:47.943926 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:45:47.943926 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:45:47.943926 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:45:47.943926 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:45:47.943926 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 09 00:45:47.943926 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 09 00:45:47.943926 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 09 00:45:47.943926 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 09 00:45:47.945753 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:45:47.945753 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:45:47.945753 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:45:47.945753 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:45:47.945753 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:45:47.945753 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:45:47.945753 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:45:47.945753 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application with Lock( Oct 09 00:45:47.945753 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:45:47.945753 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:45:47.945753 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:45:47.945753 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:45:47.945753 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:45:47.945753 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:45:47.945753 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:45:47.945753 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:45:47.945753 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 09 00:45:47.948083 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 09 00:45:47.948083 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:45:47.948083 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Oct 09 00:45:47.948083 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 619/1215] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Oct 9 00:45:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:45:47.952990 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c30c82-2e01-47bf-b444-29e428ba66e5 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:45:48.038846 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:45:48.098927 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c30c82-2e01-47bf-b444-29e428ba66e5 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:45:48.159987 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ba4733-bd22-4839-9906-1e910c3dce8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:45:48.160871 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ba4733-bd22-4839-9906-1e910c3dce8a None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:45:48.161347 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ba4733-bd22-4839-9906-1e910c3dce8a None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:45:48.161857 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ba4733-bd22-4839-9906-1e910c3dce8a None admin] PATH_INFO: `/v3/domains` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:45:48.162891 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ba4733-bd22-4839-9906-1e910c3dce8a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:45:48.163242 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ba4733-bd22-4839-9906-1e910c3dce8a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:45:48.165493 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ba4733-bd22-4839-9906-1e910c3dce8a None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:45:48.183568 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 597/1216] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Oct 9 00:45:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:45:48.190106 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3e1d49-cd94-4bc6-8fd6-3455f9b0a429 None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:45:48.309944 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:45:48.356675 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3e1d49-cd94-4bc6-8fd6-3455f9b0a429 None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:45:48.406612 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2348f85-085e-4b2a-803c-9f2b4e9e70c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:45:48.407492 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2348f85-085e-4b2a-803c-9f2b4e9e70c3 None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:45:48.407854 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2348f85-085e-4b2a-803c-9f2b4e9e70c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:45:48.408216 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2348f85-085e-4b2a-803c-9f2b4e9e70c3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:45:48.417316 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2348f85-085e-4b2a-803c-9f2b4e9e70c3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:45:48.419181 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2348f85-085e-4b2a-803c-9f2b4e9e70c3 None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:45:48.439323 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application [None req-c2348f85-085e-4b2a-803c-9f2b4e9e70c3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 09 00:45:48.439323 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:45:48.439323 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:45:48.439323 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:45:48.439323 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:45:48.439323 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:45:48.439323 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:45:48.439323 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:45:48.439323 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:45:48.439323 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:45:48.439323 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:45:48.439323 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:45:48.439323 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 09 00:45:48.439323 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 09 00:45:48.439323 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 09 00:45:48.441254 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 09 00:45:48.441254 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:45:48.441254 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:45:48.441254 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:45:48.441254 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:45:48.441254 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:45:48.441254 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:45:48.441254 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:45:48.441254 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application with Lock( Oct 09 00:45:48.441254 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:45:48.441254 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:45:48.441254 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:45:48.441254 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:45:48.441254 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:45:48.441254 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:45:48.441254 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:45:48.441254 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:45:48.443289 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 09 00:45:48.443289 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 09 00:45:48.443289 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 09 00:45:48.443289 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 09 00:45:48.443289 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 09 00:45:48.443289 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 09 00:45:48.443289 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 09 00:45:48.443289 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Oct 09 00:45:48.443289 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 620/1217] 10.222.0.15 () {56 vars in 1111 bytes} [Sun Oct 9 00:45:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:45:48.449410 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ba4733-bd22-4839-9906-1e910c3dce8a None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:45:48.587368 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ba4733-bd22-4839-9906-1e910c3dce8a None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:45:48.621212 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:45:48.639685 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6a7cc3-9347-4f14-be02-81f87834f8d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:45:48.640693 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6a7cc3-9347-4f14-be02-81f87834f8d9 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:45:48.641155 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6a7cc3-9347-4f14-be02-81f87834f8d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:45:48.641624 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6a7cc3-9347-4f14-be02-81f87834f8d9 None admin] PATH_INFO: `/v3/projects` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:45:48.642867 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6a7cc3-9347-4f14-be02-81f87834f8d9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:45:48.643440 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6a7cc3-9347-4f14-be02-81f87834f8d9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:45:48.646090 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6a7cc3-9347-4f14-be02-81f87834f8d9 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:45:48.674011 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 598/1218] 10.222.0.15 () {56 vars in 1148 bytes} [Sun Oct 9 00:45:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:45:48.677250 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2348f85-085e-4b2a-803c-9f2b4e9e70c3 None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:45:48.800174 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2348f85-085e-4b2a-803c-9f2b4e9e70c3 None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:45:48.831672 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:45:48.839743 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0a52eb-4421-41cb-8c73-78caf3b8344c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:45:48.840368 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0a52eb-4421-41cb-8c73-78caf3b8344c None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:45:48.840747 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0a52eb-4421-41cb-8c73-78caf3b8344c None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:45:48.841152 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0a52eb-4421-41cb-8c73-78caf3b8344c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:45:48.842102 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0a52eb-4421-41cb-8c73-78caf3b8344c None admin] RBAC: Adding query filter params (role.id=6fe3faf520bd402f9bd78d3ed08eec34, scope.project.id=f148d39ced534860abfbe8fc3f98ace4, user.id=64be9d44437e4247a72334b9bab3cdd3) {{(pid=81525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:45:48.842612 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0a52eb-4421-41cb-8c73-78caf3b8344c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:45:48.844657 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0a52eb-4421-41cb-8c73-78caf3b8344c None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:45:48.855558 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 621/1219] 10.222.0.15 () {56 vars in 1374 bytes} [Sun Oct 9 00:45:48 2022] GET /identity/v3/role_assignments?user.id=64be9d44437e4247a72334b9bab3cdd3&scope.project.id=f148d39ced534860abfbe8fc3f98ace4&role.id=6fe3faf520bd402f9bd78d3ed08eec34 => generated 259 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:45:51.424294 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aae58a9-4063-426f-a02e-dd02d07433cd None None] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:45:51.425171 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aae58a9-4063-426f-a02e-dd02d07433cd None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:45:51.425171 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aae58a9-4063-426f-a02e-dd02d07433cd None None] PATH_INFO: `/` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:45:51.426688 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 599/1220] 10.222.0.15 () {54 vars in 927 bytes} [Sun Oct 9 00:45:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 09 00:45:51.433297 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3727a360-fcfd-40b1-9735-7ab4ef4bc2ae None None] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:45:51.433896 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3727a360-fcfd-40b1-9735-7ab4ef4bc2ae None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:45:51.433896 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3727a360-fcfd-40b1-9735-7ab4ef4bc2ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:45:51.457016 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.auth.core [None req-3727a360-fcfd-40b1-9735-7ab4ef4bc2ae None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:45:51.458973 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-3727a360-fcfd-40b1-9735-7ab4ef4bc2ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:45:51.555172 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 622/1221] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Oct 9 00:45:51 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 09 00:45:51.912605 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aae58a9-4063-426f-a02e-dd02d07433cd None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:45:52.054847 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aae58a9-4063-426f-a02e-dd02d07433cd None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:45:52.114019 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37cc430-e923-4b9f-9a9e-0b507b6981de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:45:52.115062 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37cc430-e923-4b9f-9a9e-0b507b6981de None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:45:52.115657 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37cc430-e923-4b9f-9a9e-0b507b6981de None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:45:52.116120 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37cc430-e923-4b9f-9a9e-0b507b6981de None admin] PATH_INFO: `/v3/roles/service` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:45:52.140559 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37cc430-e923-4b9f-9a9e-0b507b6981de None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 09 00:45:52.153093 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application [None req-c37cc430-e923-4b9f-9a9e-0b507b6981de None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 09 00:45:52.153093 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:45:52.153093 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:45:52.153093 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:45:52.153093 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:45:52.153093 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:45:52.153093 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:45:52.153093 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:45:52.153093 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:45:52.153093 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:45:52.153093 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:45:52.153093 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:45:52.153093 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 09 00:45:52.153093 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 09 00:45:52.153093 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 09 00:45:52.153093 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 09 00:45:52.154328 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 09 00:45:52.154328 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 09 00:45:52.154328 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 09 00:45:52.154328 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 09 00:45:52.154328 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:45:52.154328 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:45:52.154328 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:45:52.154328 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:45:52.154328 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:45:52.154328 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:45:52.154328 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:45:52.154328 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application with Lock( Oct 09 00:45:52.154328 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:45:52.154328 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:45:52.154328 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:45:52.154328 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:45:52.155405 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:45:52.155405 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:45:52.155405 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:45:52.155405 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:45:52.155405 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 09 00:45:52.155405 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 09 00:45:52.155405 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 09 00:45:52.155405 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 09 00:45:52.155405 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 09 00:45:52.155405 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 09 00:45:52.155405 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 09 00:45:52.155405 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application Oct 09 00:45:52.155405 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 600/1222] 10.222.0.15 () {56 vars in 1102 bytes} [Sun Oct 9 00:45:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:45:52.166962 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3727a360-fcfd-40b1-9735-7ab4ef4bc2ae None None] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:45:52.303361 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3727a360-fcfd-40b1-9735-7ab4ef4bc2ae None None] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:45:52.341109 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:45:52.357048 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b73434f-8b9c-4076-8cd9-707ab60bf573 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:45:52.357894 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b73434f-8b9c-4076-8cd9-707ab60bf573 None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:45:52.358343 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b73434f-8b9c-4076-8cd9-707ab60bf573 None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:45:52.358788 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b73434f-8b9c-4076-8cd9-707ab60bf573 None admin] PATH_INFO: `/v3/roles` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:45:52.359932 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b73434f-8b9c-4076-8cd9-707ab60bf573 None admin] RBAC: Adding query filter params (name=service) {{(pid=81525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:45:52.360460 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b73434f-8b9c-4076-8cd9-707ab60bf573 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:45:52.362403 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b73434f-8b9c-4076-8cd9-707ab60bf573 None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:45:52.375140 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 623/1223] 10.222.0.15 () {56 vars in 1103 bytes} [Sun Oct 9 00:45:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:45:52.383124 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37cc430-e923-4b9f-9a9e-0b507b6981de None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:45:52.450157 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:45:52.536964 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37cc430-e923-4b9f-9a9e-0b507b6981de None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:45:52.587407 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2a7e8b-9f31-43d4-8805-ece58ceac8c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:45:52.588365 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2a7e8b-9f31-43d4-8805-ece58ceac8c1 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:45:52.588704 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2a7e8b-9f31-43d4-8805-ece58ceac8c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:45:52.588999 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2a7e8b-9f31-43d4-8805-ece58ceac8c1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:45:52.604221 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2a7e8b-9f31-43d4-8805-ece58ceac8c1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:45:52.606088 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2a7e8b-9f31-43d4-8805-ece58ceac8c1 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:45:52.626673 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application [None req-3f2a7e8b-9f31-43d4-8805-ece58ceac8c1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:45:52.626673 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:45:52.626673 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:45:52.626673 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:45:52.626673 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:45:52.626673 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:45:52.626673 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:45:52.626673 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:45:52.626673 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:45:52.626673 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:45:52.626673 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:45:52.626673 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:45:52.626673 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 09 00:45:52.626673 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 09 00:45:52.626673 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 09 00:45:52.626673 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 09 00:45:52.628691 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:45:52.628691 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:45:52.628691 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:45:52.628691 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:45:52.628691 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:45:52.628691 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:45:52.628691 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:45:52.628691 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application with Lock( Oct 09 00:45:52.628691 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:45:52.628691 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:45:52.628691 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:45:52.628691 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:45:52.628691 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:45:52.628691 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:45:52.628691 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:45:52.628691 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:45:52.628691 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 09 00:45:52.630639 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 09 00:45:52.630639 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:45:52.630639 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application Oct 09 00:45:52.630639 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 601/1224] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Oct 9 00:45:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 09 00:45:52.637214 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b73434f-8b9c-4076-8cd9-707ab60bf573 None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:45:52.796149 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b73434f-8b9c-4076-8cd9-707ab60bf573 None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:45:52.847039 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f47361-6d4e-4776-8347-b227a175f3cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:45:52.848078 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f47361-6d4e-4776-8347-b227a175f3cc None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:45:52.848554 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f47361-6d4e-4776-8347-b227a175f3cc None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:45:52.849008 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f47361-6d4e-4776-8347-b227a175f3cc None admin] PATH_INFO: `/v3/domains` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:45:52.850110 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f47361-6d4e-4776-8347-b227a175f3cc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:45:52.850630 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f47361-6d4e-4776-8347-b227a175f3cc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:45:52.853197 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f47361-6d4e-4776-8347-b227a175f3cc None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:45:52.874778 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 624/1225] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Oct 9 00:45:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:45:52.883740 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2a7e8b-9f31-43d4-8805-ece58ceac8c1 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:45:53.032047 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:45:53.040858 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2a7e8b-9f31-43d4-8805-ece58ceac8c1 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:45:53.089138 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5888c7e2-7197-458c-b725-7b4e3951ea14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:45:53.089587 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5888c7e2-7197-458c-b725-7b4e3951ea14 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:45:53.089893 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5888c7e2-7197-458c-b725-7b4e3951ea14 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:45:53.090141 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5888c7e2-7197-458c-b725-7b4e3951ea14 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:45:53.103430 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5888c7e2-7197-458c-b725-7b4e3951ea14 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:45:53.105295 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5888c7e2-7197-458c-b725-7b4e3951ea14 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:45:53.122165 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application [None req-5888c7e2-7197-458c-b725-7b4e3951ea14 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 09 00:45:53.122165 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:45:53.122165 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:45:53.122165 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:45:53.122165 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:45:53.122165 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:45:53.122165 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:45:53.122165 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:45:53.122165 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:45:53.122165 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:45:53.122165 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:45:53.122165 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:45:53.122165 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 09 00:45:53.122165 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 09 00:45:53.122165 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 09 00:45:53.122165 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 09 00:45:53.124325 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:45:53.124325 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:45:53.124325 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 09 00:45:53.124325 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 09 00:45:53.124325 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 09 00:45:53.124325 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 09 00:45:53.124325 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:45:53.124325 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:45:53.124325 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:45:53.124325 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:45:53.124325 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:45:53.124325 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application with Lock( Oct 09 00:45:53.124325 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:45:53.124325 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:45:53.124325 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:45:53.124325 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:45:53.124325 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:45:53.124325 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:45:53.125637 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:45:53.125637 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:45:53.125637 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 09 00:45:53.125637 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 09 00:45:53.125637 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 09 00:45:53.125637 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 09 00:45:53.125637 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 09 00:45:53.125637 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 09 00:45:53.125637 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 09 00:45:53.125637 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application Oct 09 00:45:53.125637 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 602/1226] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Oct 9 00:45:52 2022] GET /identity/v3/users/placement => generated 87 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:45:53.133612 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f47361-6d4e-4776-8347-b227a175f3cc None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:45:53.207882 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:45:53.291438 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f47361-6d4e-4776-8347-b227a175f3cc None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:45:53.349988 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e1dbec-945f-481e-a1b6-02c8fb8677fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:45:53.350729 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e1dbec-945f-481e-a1b6-02c8fb8677fc None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:45:53.351184 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e1dbec-945f-481e-a1b6-02c8fb8677fc None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:45:53.351572 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e1dbec-945f-481e-a1b6-02c8fb8677fc None admin] PATH_INFO: `/v3/users` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:45:53.352474 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e1dbec-945f-481e-a1b6-02c8fb8677fc None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:45:53.352855 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e1dbec-945f-481e-a1b6-02c8fb8677fc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:45:53.354613 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e1dbec-945f-481e-a1b6-02c8fb8677fc None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:45:53.382918 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 625/1227] 10.222.0.15 () {56 vars in 1143 bytes} [Sun Oct 9 00:45:53 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:45:53.390752 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5888c7e2-7197-458c-b725-7b4e3951ea14 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:45:53.524053 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5888c7e2-7197-458c-b725-7b4e3951ea14 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:45:53.560678 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ccc0ec-f812-48ed-acd7-3867f2874a37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:45:53.561427 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ccc0ec-f812-48ed-acd7-3867f2874a37 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:45:53.561701 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ccc0ec-f812-48ed-acd7-3867f2874a37 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:45:53.561974 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ccc0ec-f812-48ed-acd7-3867f2874a37 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:45:53.579146 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ccc0ec-f812-48ed-acd7-3867f2874a37 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:45:53.581427 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ccc0ec-f812-48ed-acd7-3867f2874a37 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:45:53.600448 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application [None req-b5ccc0ec-f812-48ed-acd7-3867f2874a37 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:45:53.600448 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:45:53.600448 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:45:53.600448 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:45:53.600448 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:45:53.600448 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:45:53.600448 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:45:53.600448 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:45:53.600448 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:45:53.600448 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:45:53.600448 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:45:53.600448 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:45:53.600448 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 09 00:45:53.600448 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 09 00:45:53.600448 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 09 00:45:53.600448 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 09 00:45:53.602473 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:45:53.602473 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:45:53.602473 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:45:53.602473 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:45:53.602473 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:45:53.602473 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:45:53.602473 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:45:53.602473 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application with Lock( Oct 09 00:45:53.602473 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:45:53.602473 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:45:53.602473 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:45:53.602473 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:45:53.602473 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:45:53.602473 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:45:53.602473 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:45:53.602473 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:45:53.602473 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 09 00:45:53.603465 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 09 00:45:53.603465 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:45:53.603465 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application Oct 09 00:45:53.603465 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 603/1228] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Oct 9 00:45:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:45:53.611711 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e1dbec-945f-481e-a1b6-02c8fb8677fc None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:45:53.729092 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e1dbec-945f-481e-a1b6-02c8fb8677fc None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:45:53.732043 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:45:53.780581 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5466868-0194-4208-9184-ef459b5dd9c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:45:53.781201 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5466868-0194-4208-9184-ef459b5dd9c3 None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:45:53.781471 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5466868-0194-4208-9184-ef459b5dd9c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:45:53.781731 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5466868-0194-4208-9184-ef459b5dd9c3 None admin] PATH_INFO: `/v3/domains` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:45:53.782378 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5466868-0194-4208-9184-ef459b5dd9c3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:45:53.782675 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5466868-0194-4208-9184-ef459b5dd9c3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:45:53.784089 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5466868-0194-4208-9184-ef459b5dd9c3 None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:45:53.805195 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 626/1229] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Oct 9 00:45:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:45:53.807032 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ccc0ec-f812-48ed-acd7-3867f2874a37 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:45:53.822565 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:45:53.979013 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ccc0ec-f812-48ed-acd7-3867f2874a37 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:45:54.031176 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc8352b-7421-43f8-b270-76b1f39b3fd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:45:54.032102 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc8352b-7421-43f8-b270-76b1f39b3fd6 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:45:54.032572 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc8352b-7421-43f8-b270-76b1f39b3fd6 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:45:54.032995 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc8352b-7421-43f8-b270-76b1f39b3fd6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:45:54.045131 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc8352b-7421-43f8-b270-76b1f39b3fd6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:45:54.047883 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc8352b-7421-43f8-b270-76b1f39b3fd6 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:45:54.067690 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application [None req-dbc8352b-7421-43f8-b270-76b1f39b3fd6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 09 00:45:54.067690 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:45:54.067690 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:45:54.067690 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:45:54.067690 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:45:54.067690 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:45:54.067690 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:45:54.067690 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:45:54.067690 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:45:54.067690 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:45:54.067690 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:45:54.067690 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:45:54.067690 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 09 00:45:54.067690 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 09 00:45:54.067690 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 09 00:45:54.069613 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 09 00:45:54.069613 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:45:54.069613 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:45:54.069613 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:45:54.069613 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:45:54.069613 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:45:54.069613 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:45:54.069613 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:45:54.069613 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application with Lock( Oct 09 00:45:54.069613 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:45:54.069613 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:45:54.069613 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:45:54.069613 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:45:54.069613 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:45:54.069613 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:45:54.069613 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:45:54.069613 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:45:54.071196 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 09 00:45:54.071196 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 09 00:45:54.071196 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 09 00:45:54.071196 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 09 00:45:54.071196 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 09 00:45:54.071196 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 09 00:45:54.071196 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 09 00:45:54.071196 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application Oct 09 00:45:54.071196 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 604/1230] 10.222.0.15 () {56 vars in 1111 bytes} [Sun Oct 9 00:45:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:45:54.076670 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5466868-0194-4208-9184-ef459b5dd9c3 None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:45:54.232824 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5466868-0194-4208-9184-ef459b5dd9c3 None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:45:54.285774 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7dadfc-e075-4712-96e7-2d2a4eb3dd36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:45:54.286483 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7dadfc-e075-4712-96e7-2d2a4eb3dd36 None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:45:54.286895 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7dadfc-e075-4712-96e7-2d2a4eb3dd36 None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:45:54.287104 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7dadfc-e075-4712-96e7-2d2a4eb3dd36 None admin] PATH_INFO: `/v3/projects` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:45:54.287893 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7dadfc-e075-4712-96e7-2d2a4eb3dd36 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:45:54.288210 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7dadfc-e075-4712-96e7-2d2a4eb3dd36 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:45:54.290214 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7dadfc-e075-4712-96e7-2d2a4eb3dd36 None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:45:54.307785 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 627/1231] 10.222.0.15 () {56 vars in 1148 bytes} [Sun Oct 9 00:45:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:45:54.314630 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc8352b-7421-43f8-b270-76b1f39b3fd6 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:45:54.402415 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:45:54.450288 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc8352b-7421-43f8-b270-76b1f39b3fd6 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:45:54.496366 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2faf0f0-fa6c-4f58-8be4-ec4c5c1e646b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:45:54.497508 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2faf0f0-fa6c-4f58-8be4-ec4c5c1e646b None admin] REQUEST_METHOD: `PUT` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:45:54.497984 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2faf0f0-fa6c-4f58-8be4-ec4c5c1e646b None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:45:54.498547 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2faf0f0-fa6c-4f58-8be4-ec4c5c1e646b None admin] PATH_INFO: `/v3/projects/f148d39ced534860abfbe8fc3f98ace4/users/64be9d44437e4247a72334b9bab3cdd3/roles/6fe3faf520bd402f9bd78d3ed08eec34` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:45:54.520664 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2faf0f0-fa6c-4f58-8be4-ec4c5c1e646b None admin] RBAC: Authorizing `identity:create_grant(project_id=f148d39ced534860abfbe8fc3f98ace4, user_id=64be9d44437e4247a72334b9bab3cdd3, role_id=6fe3faf520bd402f9bd78d3ed08eec34)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:45:54.522864 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2faf0f0-fa6c-4f58-8be4-ec4c5c1e646b None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:45:54.544094 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 605/1232] 10.222.0.15 () {58 vars in 1439 bytes} [Sun Oct 9 00:45:54 2022] PUT /identity/v3/projects/f148d39ced534860abfbe8fc3f98ace4/users/64be9d44437e4247a72334b9bab3cdd3/roles/6fe3faf520bd402f9bd78d3ed08eec34 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 00:45:56.889486 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3363aa33-5007-4940-b57e-571300f88b14 None None] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:45:56.890351 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3363aa33-5007-4940-b57e-571300f88b14 None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:45:56.890351 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3363aa33-5007-4940-b57e-571300f88b14 None None] PATH_INFO: `/` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:45:56.892638 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 628/1233] 10.222.0.15 () {54 vars in 927 bytes} [Sun Oct 9 00:45:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:45:56.899147 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db318b9f-6aa1-4dbb-9a58-a4fa614616e9 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:45:56.899972 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db318b9f-6aa1-4dbb-9a58-a4fa614616e9 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:45:56.899972 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db318b9f-6aa1-4dbb-9a58-a4fa614616e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:45:56.922239 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-db318b9f-6aa1-4dbb-9a58-a4fa614616e9 None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:45:56.923631 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-db318b9f-6aa1-4dbb-9a58-a4fa614616e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:45:57.031353 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 606/1234] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Oct 9 00:45:56 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 09 00:45:57.302537 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3363aa33-5007-4940-b57e-571300f88b14 None None] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:45:57.333347 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:45:57.437835 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3363aa33-5007-4940-b57e-571300f88b14 None None] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:45:57.496546 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c04d486-5551-45c6-8535-eb9211213c20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:45:57.497850 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c04d486-5551-45c6-8535-eb9211213c20 None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:45:57.498260 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c04d486-5551-45c6-8535-eb9211213c20 None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:45:57.498828 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c04d486-5551-45c6-8535-eb9211213c20 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:45:57.520206 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c04d486-5551-45c6-8535-eb9211213c20 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 09 00:45:57.530008 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application [None req-4c04d486-5551-45c6-8535-eb9211213c20 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 09 00:45:57.530008 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:45:57.530008 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:45:57.530008 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:45:57.530008 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:45:57.530008 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:45:57.530008 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:45:57.530008 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:45:57.530008 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:45:57.530008 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:45:57.530008 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:45:57.530008 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:45:57.530008 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 09 00:45:57.530008 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 09 00:45:57.530008 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 09 00:45:57.530008 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 09 00:45:57.532124 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 09 00:45:57.532124 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 09 00:45:57.532124 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 09 00:45:57.532124 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 09 00:45:57.532124 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:45:57.532124 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:45:57.532124 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:45:57.532124 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:45:57.532124 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:45:57.532124 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:45:57.532124 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:45:57.532124 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application with Lock( Oct 09 00:45:57.532124 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:45:57.532124 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:45:57.532124 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:45:57.532124 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:45:57.533759 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:45:57.533759 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:45:57.533759 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:45:57.533759 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:45:57.533759 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 09 00:45:57.533759 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 09 00:45:57.533759 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 09 00:45:57.533759 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 09 00:45:57.533759 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 09 00:45:57.533759 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 09 00:45:57.533759 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 09 00:45:57.533759 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Oct 09 00:45:57.533759 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 629/1235] 10.222.0.15 () {56 vars in 1102 bytes} [Sun Oct 9 00:45:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 09 00:45:57.541095 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db318b9f-6aa1-4dbb-9a58-a4fa614616e9 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:45:57.597225 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:45:57.682788 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db318b9f-6aa1-4dbb-9a58-a4fa614616e9 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:45:57.747109 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0632776-c809-4038-af70-a31bec604e0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:45:57.747988 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0632776-c809-4038-af70-a31bec604e0e None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:45:57.748544 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0632776-c809-4038-af70-a31bec604e0e None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:45:57.749050 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0632776-c809-4038-af70-a31bec604e0e None admin] PATH_INFO: `/v3/roles` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:45:57.750040 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0632776-c809-4038-af70-a31bec604e0e None admin] RBAC: Adding query filter params (name=service) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:45:57.750518 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0632776-c809-4038-af70-a31bec604e0e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:45:57.752449 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0632776-c809-4038-af70-a31bec604e0e None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:45:57.774447 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 607/1236] 10.222.0.15 () {56 vars in 1103 bytes} [Sun Oct 9 00:45:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:45:57.777483 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c04d486-5551-45c6-8535-eb9211213c20 None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:45:57.927238 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:45:57.958086 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c04d486-5551-45c6-8535-eb9211213c20 None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:45:58.016395 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cbf08c-7159-475f-9dde-6f3d94bb8c10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:45:58.017726 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cbf08c-7159-475f-9dde-6f3d94bb8c10 None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:45:58.018196 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cbf08c-7159-475f-9dde-6f3d94bb8c10 None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:45:58.018648 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cbf08c-7159-475f-9dde-6f3d94bb8c10 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:45:58.034469 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cbf08c-7159-475f-9dde-6f3d94bb8c10 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:45:58.036618 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cbf08c-7159-475f-9dde-6f3d94bb8c10 None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:45:58.055143 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application [None req-20cbf08c-7159-475f-9dde-6f3d94bb8c10 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:45:58.055143 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:45:58.055143 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:45:58.055143 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:45:58.055143 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:45:58.055143 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:45:58.055143 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:45:58.055143 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:45:58.055143 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:45:58.055143 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:45:58.055143 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:45:58.055143 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:45:58.055143 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 09 00:45:58.055143 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 09 00:45:58.055143 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 09 00:45:58.055143 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 09 00:45:58.057309 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:45:58.057309 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:45:58.057309 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:45:58.057309 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:45:58.057309 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:45:58.057309 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:45:58.057309 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:45:58.057309 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application with Lock( Oct 09 00:45:58.057309 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:45:58.057309 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:45:58.057309 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:45:58.057309 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:45:58.057309 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:45:58.057309 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:45:58.057309 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:45:58.057309 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:45:58.057309 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 09 00:45:58.059331 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 09 00:45:58.059331 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:45:58.059331 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Oct 09 00:45:58.059331 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 630/1237] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Oct 9 00:45:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:45:58.064871 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0632776-c809-4038-af70-a31bec604e0e None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:45:58.218127 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0632776-c809-4038-af70-a31bec604e0e None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:45:58.231028 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:45:58.275091 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d9942c-dc06-4c89-ae29-4c4d7c5fea49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:45:58.276084 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d9942c-dc06-4c89-ae29-4c4d7c5fea49 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:45:58.276453 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d9942c-dc06-4c89-ae29-4c4d7c5fea49 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:45:58.276814 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d9942c-dc06-4c89-ae29-4c4d7c5fea49 None admin] PATH_INFO: `/v3/domains` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:45:58.277780 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d9942c-dc06-4c89-ae29-4c4d7c5fea49 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:45:58.278194 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d9942c-dc06-4c89-ae29-4c4d7c5fea49 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:45:58.280063 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d9942c-dc06-4c89-ae29-4c4d7c5fea49 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:45:58.298929 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 608/1238] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Oct 9 00:45:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:45:58.307408 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cbf08c-7159-475f-9dde-6f3d94bb8c10 None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:45:58.484731 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cbf08c-7159-475f-9dde-6f3d94bb8c10 None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:45:58.523855 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4ef485-2ae6-4e30-b05e-b0c0ff52550f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:45:58.524534 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4ef485-2ae6-4e30-b05e-b0c0ff52550f None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:45:58.524776 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4ef485-2ae6-4e30-b05e-b0c0ff52550f None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:45:58.525042 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4ef485-2ae6-4e30-b05e-b0c0ff52550f None admin] PATH_INFO: `/v3/users/placement` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:45:58.528362 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:45:58.534948 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4ef485-2ae6-4e30-b05e-b0c0ff52550f None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:45:58.537842 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4ef485-2ae6-4e30-b05e-b0c0ff52550f None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:45:58.552150 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application [None req-aa4ef485-2ae6-4e30-b05e-b0c0ff52550f None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 09 00:45:58.552150 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:45:58.552150 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:45:58.552150 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:45:58.552150 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:45:58.552150 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:45:58.552150 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:45:58.552150 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:45:58.552150 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:45:58.552150 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:45:58.552150 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:45:58.552150 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:45:58.552150 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 09 00:45:58.552150 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 09 00:45:58.552150 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 09 00:45:58.552150 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 09 00:45:58.554033 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:45:58.554033 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:45:58.554033 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 09 00:45:58.554033 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 09 00:45:58.554033 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 09 00:45:58.554033 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 09 00:45:58.554033 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:45:58.554033 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:45:58.554033 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:45:58.554033 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:45:58.554033 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:45:58.554033 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application with Lock( Oct 09 00:45:58.554033 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:45:58.554033 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:45:58.554033 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:45:58.554033 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:45:58.554033 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:45:58.554033 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:45:58.555152 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:45:58.555152 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:45:58.555152 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 09 00:45:58.555152 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 09 00:45:58.555152 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 09 00:45:58.555152 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 09 00:45:58.555152 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 09 00:45:58.555152 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 09 00:45:58.555152 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 09 00:45:58.555152 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Oct 09 00:45:58.555152 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 631/1239] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Oct 9 00:45:58 2022] GET /identity/v3/users/placement => generated 87 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:45:58.559615 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d9942c-dc06-4c89-ae29-4c4d7c5fea49 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:45:58.696535 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d9942c-dc06-4c89-ae29-4c4d7c5fea49 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:45:58.741604 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07603463-d7ee-4f3e-b18a-7096c1807c93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:45:58.742880 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07603463-d7ee-4f3e-b18a-7096c1807c93 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:45:58.743404 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07603463-d7ee-4f3e-b18a-7096c1807c93 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:45:58.743845 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07603463-d7ee-4f3e-b18a-7096c1807c93 None admin] PATH_INFO: `/v3/users` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:45:58.745322 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07603463-d7ee-4f3e-b18a-7096c1807c93 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:45:58.745958 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07603463-d7ee-4f3e-b18a-7096c1807c93 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:45:58.749104 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07603463-d7ee-4f3e-b18a-7096c1807c93 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:45:58.785500 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 609/1240] 10.222.0.15 () {56 vars in 1143 bytes} [Sun Oct 9 00:45:58 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 09 00:45:58.792524 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4ef485-2ae6-4e30-b05e-b0c0ff52550f None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:45:58.963796 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4ef485-2ae6-4e30-b05e-b0c0ff52550f None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:45:59.033138 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3c74b5-7ad4-4680-9cc3-9d728bf79d3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:45:59.034204 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3c74b5-7ad4-4680-9cc3-9d728bf79d3b None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:45:59.034779 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3c74b5-7ad4-4680-9cc3-9d728bf79d3b None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:45:59.035383 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3c74b5-7ad4-4680-9cc3-9d728bf79d3b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:45:59.156128 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:45:59.167465 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3c74b5-7ad4-4680-9cc3-9d728bf79d3b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:45:59.169603 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3c74b5-7ad4-4680-9cc3-9d728bf79d3b None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:45:59.346824 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 632/1241] 10.222.0.15 () {58 vars in 1282 bytes} [Sun Oct 9 00:45:58 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 547 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 09 00:45:59.348232 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07603463-d7ee-4f3e-b18a-7096c1807c93 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:45:59.399593 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:45:59.512103 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07603463-d7ee-4f3e-b18a-7096c1807c93 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:45:59.575357 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93da946-0e1b-4926-9422-dcca6d84caea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:45:59.576433 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93da946-0e1b-4926-9422-dcca6d84caea None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:45:59.576909 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93da946-0e1b-4926-9422-dcca6d84caea None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:45:59.577342 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93da946-0e1b-4926-9422-dcca6d84caea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:45:59.596264 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93da946-0e1b-4926-9422-dcca6d84caea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:45:59.599226 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93da946-0e1b-4926-9422-dcca6d84caea None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:45:59.626736 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application [None req-a93da946-0e1b-4926-9422-dcca6d84caea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:45:59.626736 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:45:59.626736 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:45:59.626736 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:45:59.626736 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:45:59.626736 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:45:59.626736 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:45:59.626736 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:45:59.626736 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:45:59.626736 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:45:59.626736 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:45:59.626736 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:45:59.626736 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 09 00:45:59.626736 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 09 00:45:59.626736 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 09 00:45:59.626736 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 09 00:45:59.628529 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:45:59.628529 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:45:59.628529 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:45:59.628529 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:45:59.628529 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:45:59.628529 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:45:59.628529 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:45:59.628529 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application with Lock( Oct 09 00:45:59.628529 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:45:59.628529 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:45:59.628529 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:45:59.628529 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:45:59.628529 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:45:59.628529 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:45:59.628529 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:45:59.628529 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:45:59.628529 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 09 00:45:59.630234 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 09 00:45:59.630234 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:45:59.630234 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application Oct 09 00:45:59.630234 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 610/1242] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Oct 9 00:45:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:45:59.635616 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3c74b5-7ad4-4680-9cc3-9d728bf79d3b None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:45:59.773822 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:45:59.784497 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3c74b5-7ad4-4680-9cc3-9d728bf79d3b None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:45:59.839336 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2806f6db-515c-4599-bad0-8fda6d0e0c4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:45:59.840138 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2806f6db-515c-4599-bad0-8fda6d0e0c4f None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:45:59.840469 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2806f6db-515c-4599-bad0-8fda6d0e0c4f None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:45:59.840814 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2806f6db-515c-4599-bad0-8fda6d0e0c4f None admin] PATH_INFO: `/v3/domains` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:45:59.841778 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2806f6db-515c-4599-bad0-8fda6d0e0c4f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:45:59.842191 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2806f6db-515c-4599-bad0-8fda6d0e0c4f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:45:59.844098 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2806f6db-515c-4599-bad0-8fda6d0e0c4f None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:45:59.862665 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 633/1243] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Oct 9 00:45:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:45:59.870016 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93da946-0e1b-4926-9422-dcca6d84caea None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:45:59.999307 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:46:00.037030 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93da946-0e1b-4926-9422-dcca6d84caea None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:46:00.090385 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1566535a-84b3-4dd6-8c48-6ec5fe161c73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:46:00.091600 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1566535a-84b3-4dd6-8c48-6ec5fe161c73 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:46:00.092143 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1566535a-84b3-4dd6-8c48-6ec5fe161c73 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:46:00.092585 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1566535a-84b3-4dd6-8c48-6ec5fe161c73 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:46:00.106541 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1566535a-84b3-4dd6-8c48-6ec5fe161c73 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:46:00.108516 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1566535a-84b3-4dd6-8c48-6ec5fe161c73 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:46:00.126263 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application [None req-1566535a-84b3-4dd6-8c48-6ec5fe161c73 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 09 00:46:00.126263 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:46:00.126263 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:46:00.126263 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:46:00.126263 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:46:00.126263 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:46:00.126263 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:46:00.126263 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:46:00.126263 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:46:00.126263 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:46:00.126263 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:46:00.126263 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:46:00.126263 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 09 00:46:00.126263 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 09 00:46:00.126263 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 09 00:46:00.127818 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 09 00:46:00.127818 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:46:00.127818 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:46:00.127818 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:46:00.127818 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:46:00.127818 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:46:00.127818 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:46:00.127818 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:46:00.127818 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application with Lock( Oct 09 00:46:00.127818 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:46:00.127818 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:46:00.127818 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:46:00.127818 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:46:00.127818 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:46:00.127818 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:46:00.127818 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:46:00.127818 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:46:00.129474 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 09 00:46:00.129474 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 09 00:46:00.129474 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 09 00:46:00.129474 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 09 00:46:00.129474 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 09 00:46:00.129474 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 09 00:46:00.129474 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 09 00:46:00.129474 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application Oct 09 00:46:00.129474 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 611/1244] 10.222.0.15 () {56 vars in 1111 bytes} [Sun Oct 9 00:45:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 09 00:46:00.137035 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2806f6db-515c-4599-bad0-8fda6d0e0c4f None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:46:00.303722 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2806f6db-515c-4599-bad0-8fda6d0e0c4f None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:46:00.364030 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b391dd4-af14-45ee-ab3b-6fed7302fe4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:46:00.364941 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b391dd4-af14-45ee-ab3b-6fed7302fe4e None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:46:00.365336 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b391dd4-af14-45ee-ab3b-6fed7302fe4e None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:46:00.365896 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b391dd4-af14-45ee-ab3b-6fed7302fe4e None admin] PATH_INFO: `/v3/projects` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:46:00.366967 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b391dd4-af14-45ee-ab3b-6fed7302fe4e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:46:00.368014 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b391dd4-af14-45ee-ab3b-6fed7302fe4e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:46:00.369878 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b391dd4-af14-45ee-ab3b-6fed7302fe4e None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:46:00.399611 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 634/1245] 10.222.0.15 () {56 vars in 1148 bytes} [Sun Oct 9 00:46:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:46:00.401139 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1566535a-84b3-4dd6-8c48-6ec5fe161c73 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:46:00.548155 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1566535a-84b3-4dd6-8c48-6ec5fe161c73 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:46:00.601669 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d751295-f4de-4fc4-b2e7-4d51e5fc36b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:46:00.602842 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d751295-f4de-4fc4-b2e7-4d51e5fc36b7 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:46:00.603386 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d751295-f4de-4fc4-b2e7-4d51e5fc36b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:46:00.603855 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d751295-f4de-4fc4-b2e7-4d51e5fc36b7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:46:00.604961 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d751295-f4de-4fc4-b2e7-4d51e5fc36b7 None admin] RBAC: Adding query filter params (role.id=6fe3faf520bd402f9bd78d3ed08eec34, scope.project.id=f148d39ced534860abfbe8fc3f98ace4, user.id=64be9d44437e4247a72334b9bab3cdd3) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:46:00.605435 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d751295-f4de-4fc4-b2e7-4d51e5fc36b7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:46:00.607247 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d751295-f4de-4fc4-b2e7-4d51e5fc36b7 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:46:00.616063 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 612/1246] 10.222.0.15 () {56 vars in 1374 bytes} [Sun Oct 9 00:46:00 2022] GET /identity/v3/role_assignments?user.id=64be9d44437e4247a72334b9bab3cdd3&scope.project.id=f148d39ced534860abfbe8fc3f98ace4&role.id=6fe3faf520bd402f9bd78d3ed08eec34 => generated 608 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:46:04.300812 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1507078-d4c4-444e-8457-991733f0c04d None None] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:46:04.301475 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1507078-d4c4-444e-8457-991733f0c04d None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:46:04.301630 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1507078-d4c4-444e-8457-991733f0c04d None None] PATH_INFO: `/` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:46:04.302986 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 635/1247] 10.222.0.15 () {54 vars in 927 bytes} [Sun Oct 9 00:46:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 09 00:46:04.310956 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748d9460-7ba1-4f14-a19b-9cb3efec8d26 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:46:04.311881 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748d9460-7ba1-4f14-a19b-9cb3efec8d26 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:46:04.312051 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748d9460-7ba1-4f14-a19b-9cb3efec8d26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:46:04.320366 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:46:04.337298 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-748d9460-7ba1-4f14-a19b-9cb3efec8d26 None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:46:04.339229 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-748d9460-7ba1-4f14-a19b-9cb3efec8d26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:46:04.445653 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 613/1248] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Oct 9 00:46:04 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 09 00:46:04.780393 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1507078-d4c4-444e-8457-991733f0c04d None None] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:46:04.803926 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:46:04.937871 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1507078-d4c4-444e-8457-991733f0c04d None None] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:46:04.997755 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef876dc-cbaa-45f5-aec7-b680015792fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:46:04.998821 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef876dc-cbaa-45f5-aec7-b680015792fc None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:46:04.999293 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef876dc-cbaa-45f5-aec7-b680015792fc None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:46:04.999735 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef876dc-cbaa-45f5-aec7-b680015792fc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:46:05.023018 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef876dc-cbaa-45f5-aec7-b680015792fc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 09 00:46:05.032706 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application [None req-9ef876dc-cbaa-45f5-aec7-b680015792fc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 09 00:46:05.032706 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:46:05.032706 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:46:05.032706 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:46:05.032706 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:46:05.032706 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:46:05.032706 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:46:05.032706 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:46:05.032706 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:46:05.032706 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:46:05.032706 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:46:05.032706 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:46:05.032706 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 09 00:46:05.032706 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 09 00:46:05.032706 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 09 00:46:05.032706 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 09 00:46:05.034299 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 09 00:46:05.034299 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 09 00:46:05.034299 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 09 00:46:05.034299 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 09 00:46:05.034299 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:46:05.034299 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:46:05.034299 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:46:05.034299 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:46:05.034299 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:46:05.034299 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:46:05.034299 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:46:05.034299 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application with Lock( Oct 09 00:46:05.034299 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:46:05.034299 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:46:05.034299 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:46:05.034299 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:46:05.035749 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:46:05.035749 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:46:05.035749 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:46:05.035749 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:46:05.035749 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 09 00:46:05.035749 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 09 00:46:05.035749 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 09 00:46:05.035749 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 09 00:46:05.035749 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 09 00:46:05.035749 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 09 00:46:05.035749 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 09 00:46:05.035749 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Oct 09 00:46:05.035749 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 636/1249] 10.222.0.15 () {56 vars in 1096 bytes} [Sun Oct 9 00:46:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:46:05.043808 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748d9460-7ba1-4f14-a19b-9cb3efec8d26 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:46:05.233672 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748d9460-7ba1-4f14-a19b-9cb3efec8d26 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:46:05.274475 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:46:05.284052 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac4a5fd-399f-49c1-ac83-6bbe8ba24692 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:46:05.284894 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac4a5fd-399f-49c1-ac83-6bbe8ba24692 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:46:05.285313 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac4a5fd-399f-49c1-ac83-6bbe8ba24692 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:46:05.285748 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac4a5fd-399f-49c1-ac83-6bbe8ba24692 None admin] PATH_INFO: `/v3/roles` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:46:05.286809 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac4a5fd-399f-49c1-ac83-6bbe8ba24692 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:46:05.287417 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac4a5fd-399f-49c1-ac83-6bbe8ba24692 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:46:05.290194 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac4a5fd-399f-49c1-ac83-6bbe8ba24692 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:46:05.306666 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 614/1250] 10.222.0.15 () {56 vars in 1099 bytes} [Sun Oct 9 00:46:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:46:05.316049 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef876dc-cbaa-45f5-aec7-b680015792fc None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:46:05.464327 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:46:05.501153 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef876dc-cbaa-45f5-aec7-b680015792fc None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:46:05.550918 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4311b4f8-ae10-4115-9526-0a2cbe2e842c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:46:05.551887 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4311b4f8-ae10-4115-9526-0a2cbe2e842c None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:46:05.552247 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4311b4f8-ae10-4115-9526-0a2cbe2e842c None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:46:05.552578 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4311b4f8-ae10-4115-9526-0a2cbe2e842c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:46:05.566511 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4311b4f8-ae10-4115-9526-0a2cbe2e842c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:46:05.568285 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4311b4f8-ae10-4115-9526-0a2cbe2e842c None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:46:05.587741 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application [None req-4311b4f8-ae10-4115-9526-0a2cbe2e842c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:46:05.587741 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:46:05.587741 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:46:05.587741 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:46:05.587741 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:46:05.587741 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:46:05.587741 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:46:05.587741 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:46:05.587741 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:46:05.587741 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:46:05.587741 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:46:05.587741 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:46:05.587741 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 09 00:46:05.587741 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 09 00:46:05.587741 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 09 00:46:05.587741 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 09 00:46:05.589702 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:46:05.589702 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:46:05.589702 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:46:05.589702 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:46:05.589702 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:46:05.589702 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:46:05.589702 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:46:05.589702 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application with Lock( Oct 09 00:46:05.589702 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:46:05.589702 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:46:05.589702 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:46:05.589702 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:46:05.589702 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:46:05.589702 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:46:05.589702 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:46:05.589702 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:46:05.589702 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 09 00:46:05.591629 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 09 00:46:05.591629 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:46:05.591629 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Oct 09 00:46:05.591629 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 637/1251] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Oct 9 00:46:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 09 00:46:05.596777 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac4a5fd-399f-49c1-ac83-6bbe8ba24692 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:46:05.745728 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac4a5fd-399f-49c1-ac83-6bbe8ba24692 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:46:05.803117 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b118965d-08f2-4254-bfdc-2d8da8e4e98d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:46:05.804017 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b118965d-08f2-4254-bfdc-2d8da8e4e98d None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:46:05.804423 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b118965d-08f2-4254-bfdc-2d8da8e4e98d None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:46:05.804825 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b118965d-08f2-4254-bfdc-2d8da8e4e98d None admin] PATH_INFO: `/v3/domains` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:46:05.805830 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b118965d-08f2-4254-bfdc-2d8da8e4e98d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:46:05.806271 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b118965d-08f2-4254-bfdc-2d8da8e4e98d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:46:05.808561 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b118965d-08f2-4254-bfdc-2d8da8e4e98d None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:46:05.829901 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 615/1252] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Oct 9 00:46:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:46:05.838677 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4311b4f8-ae10-4115-9526-0a2cbe2e842c None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:46:05.976598 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4311b4f8-ae10-4115-9526-0a2cbe2e842c None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:46:06.010389 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:46:06.021003 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a28e48-4650-4a08-b42e-3b39b181bb3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:46:06.021825 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a28e48-4650-4a08-b42e-3b39b181bb3d None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:46:06.022187 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a28e48-4650-4a08-b42e-3b39b181bb3d None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:46:06.022557 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a28e48-4650-4a08-b42e-3b39b181bb3d None admin] PATH_INFO: `/v3/users/placement` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:46:06.032977 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a28e48-4650-4a08-b42e-3b39b181bb3d None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:46:06.034815 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a28e48-4650-4a08-b42e-3b39b181bb3d None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:46:06.049592 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application [None req-21a28e48-4650-4a08-b42e-3b39b181bb3d None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 09 00:46:06.049592 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:46:06.049592 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:46:06.049592 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:46:06.049592 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:46:06.049592 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:46:06.049592 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:46:06.049592 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:46:06.049592 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:46:06.049592 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:46:06.049592 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:46:06.049592 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:46:06.049592 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 09 00:46:06.049592 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 09 00:46:06.049592 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 09 00:46:06.049592 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 09 00:46:06.050815 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:46:06.050815 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:46:06.050815 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 09 00:46:06.050815 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 09 00:46:06.050815 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 09 00:46:06.050815 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 09 00:46:06.050815 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:46:06.050815 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:46:06.050815 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:46:06.050815 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:46:06.050815 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:46:06.050815 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application with Lock( Oct 09 00:46:06.050815 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:46:06.050815 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:46:06.050815 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:46:06.050815 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:46:06.050815 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:46:06.050815 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:46:06.051921 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:46:06.051921 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:46:06.051921 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 09 00:46:06.051921 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 09 00:46:06.051921 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 09 00:46:06.051921 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 09 00:46:06.051921 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 09 00:46:06.051921 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 09 00:46:06.051921 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 09 00:46:06.051921 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Oct 09 00:46:06.055736 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 638/1253] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Oct 9 00:46:05 2022] GET /identity/v3/users/placement => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:46:06.057302 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b118965d-08f2-4254-bfdc-2d8da8e4e98d None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:46:06.130582 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:46:06.196426 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b118965d-08f2-4254-bfdc-2d8da8e4e98d None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:46:06.234361 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d652fbde-7250-4c9b-95d9-30864be45c82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:46:06.234990 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d652fbde-7250-4c9b-95d9-30864be45c82 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:46:06.235315 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d652fbde-7250-4c9b-95d9-30864be45c82 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:46:06.235593 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d652fbde-7250-4c9b-95d9-30864be45c82 None admin] PATH_INFO: `/v3/users` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:46:06.236332 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d652fbde-7250-4c9b-95d9-30864be45c82 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:46:06.236640 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d652fbde-7250-4c9b-95d9-30864be45c82 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:46:06.238131 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d652fbde-7250-4c9b-95d9-30864be45c82 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:46:06.260103 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 616/1254] 10.222.0.15 () {56 vars in 1143 bytes} [Sun Oct 9 00:46:06 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 09 00:46:06.267075 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a28e48-4650-4a08-b42e-3b39b181bb3d None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:46:06.389487 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a28e48-4650-4a08-b42e-3b39b181bb3d None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:46:06.429937 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c75de6-8bc1-42f1-8576-cb775b5a9ce0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:46:06.430585 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c75de6-8bc1-42f1-8576-cb775b5a9ce0 None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:46:06.430854 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c75de6-8bc1-42f1-8576-cb775b5a9ce0 None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:46:06.431122 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c75de6-8bc1-42f1-8576-cb775b5a9ce0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:46:06.494636 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:46:06.508897 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c75de6-8bc1-42f1-8576-cb775b5a9ce0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:46:06.510393 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c75de6-8bc1-42f1-8576-cb775b5a9ce0 None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:46:06.618908 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 639/1255] 10.222.0.15 () {58 vars in 1282 bytes} [Sun Oct 9 00:46:06 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 09 00:46:06.625143 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d652fbde-7250-4c9b-95d9-30864be45c82 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:46:06.729102 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d652fbde-7250-4c9b-95d9-30864be45c82 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:46:06.744158 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:46:06.768277 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0228a56-5121-4dc0-b977-f307fdcc40b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:46:06.768916 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0228a56-5121-4dc0-b977-f307fdcc40b6 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:46:06.769185 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0228a56-5121-4dc0-b977-f307fdcc40b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:46:06.769446 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0228a56-5121-4dc0-b977-f307fdcc40b6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:46:06.780276 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0228a56-5121-4dc0-b977-f307fdcc40b6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:46:06.781734 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0228a56-5121-4dc0-b977-f307fdcc40b6 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:46:06.798081 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application [None req-b0228a56-5121-4dc0-b977-f307fdcc40b6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:46:06.798081 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:46:06.798081 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:46:06.798081 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:46:06.798081 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:46:06.798081 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:46:06.798081 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:46:06.798081 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:46:06.798081 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:46:06.798081 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:46:06.798081 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:46:06.798081 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:46:06.798081 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 09 00:46:06.798081 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 09 00:46:06.798081 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 09 00:46:06.798081 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 09 00:46:06.799952 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:46:06.799952 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:46:06.799952 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:46:06.799952 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:46:06.799952 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:46:06.799952 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:46:06.799952 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:46:06.799952 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application with Lock( Oct 09 00:46:06.799952 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:46:06.799952 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:46:06.799952 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:46:06.799952 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:46:06.799952 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:46:06.799952 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:46:06.799952 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:46:06.799952 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:46:06.799952 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 09 00:46:06.801069 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 09 00:46:06.801069 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:46:06.801069 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application Oct 09 00:46:06.801069 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 617/1256] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Oct 9 00:46:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:46:06.808448 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c75de6-8bc1-42f1-8576-cb775b5a9ce0 None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:46:06.900814 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:46:06.914564 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c75de6-8bc1-42f1-8576-cb775b5a9ce0 None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:46:06.951395 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1116562-acef-40fa-b8dd-23769c363992 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:46:06.952015 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1116562-acef-40fa-b8dd-23769c363992 None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:46:06.952281 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1116562-acef-40fa-b8dd-23769c363992 None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:46:06.952547 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1116562-acef-40fa-b8dd-23769c363992 None admin] PATH_INFO: `/v3/domains` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:46:06.953187 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1116562-acef-40fa-b8dd-23769c363992 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:46:06.953485 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1116562-acef-40fa-b8dd-23769c363992 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:46:06.954868 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1116562-acef-40fa-b8dd-23769c363992 None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:46:06.966960 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 640/1257] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Oct 9 00:46:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:46:06.972994 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0228a56-5121-4dc0-b977-f307fdcc40b6 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:46:07.082225 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0228a56-5121-4dc0-b977-f307fdcc40b6 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:46:07.118303 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24833b8f-cc92-4be8-a117-a05421ef7746 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:46:07.118977 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24833b8f-cc92-4be8-a117-a05421ef7746 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:46:07.119251 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24833b8f-cc92-4be8-a117-a05421ef7746 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:46:07.119548 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24833b8f-cc92-4be8-a117-a05421ef7746 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:46:07.127617 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24833b8f-cc92-4be8-a117-a05421ef7746 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:46:07.129315 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24833b8f-cc92-4be8-a117-a05421ef7746 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:46:07.149325 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application [None req-24833b8f-cc92-4be8-a117-a05421ef7746 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 09 00:46:07.149325 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:46:07.149325 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:46:07.149325 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:46:07.149325 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:46:07.149325 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:46:07.149325 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:46:07.149325 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:46:07.149325 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:46:07.149325 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:46:07.149325 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:46:07.149325 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:46:07.149325 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 09 00:46:07.149325 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 09 00:46:07.149325 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 09 00:46:07.150795 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 09 00:46:07.150795 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:46:07.150795 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:46:07.150795 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:46:07.150795 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:46:07.150795 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:46:07.150795 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:46:07.150795 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:46:07.150795 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application with Lock( Oct 09 00:46:07.150795 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:46:07.150795 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:46:07.150795 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:46:07.150795 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:46:07.150795 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:46:07.150795 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:46:07.150795 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:46:07.150795 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:46:07.151879 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 09 00:46:07.151879 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 09 00:46:07.151879 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 09 00:46:07.151879 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 09 00:46:07.151879 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 09 00:46:07.151879 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 09 00:46:07.151879 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 09 00:46:07.151879 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application Oct 09 00:46:07.151879 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 618/1258] 10.222.0.15 () {56 vars in 1111 bytes} [Sun Oct 9 00:46:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:46:07.160628 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1116562-acef-40fa-b8dd-23769c363992 None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:46:07.281677 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1116562-acef-40fa-b8dd-23769c363992 None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:46:07.325305 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ec5f5a-5be3-489b-b462-650d65997ba0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:46:07.326027 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ec5f5a-5be3-489b-b462-650d65997ba0 None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:46:07.326302 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ec5f5a-5be3-489b-b462-650d65997ba0 None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:46:07.326569 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ec5f5a-5be3-489b-b462-650d65997ba0 None admin] PATH_INFO: `/v3/projects` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:46:07.327307 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ec5f5a-5be3-489b-b462-650d65997ba0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:46:07.327640 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ec5f5a-5be3-489b-b462-650d65997ba0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:46:07.329165 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ec5f5a-5be3-489b-b462-650d65997ba0 None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:46:07.343337 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 641/1259] 10.222.0.15 () {56 vars in 1148 bytes} [Sun Oct 9 00:46:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:46:07.349982 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24833b8f-cc92-4be8-a117-a05421ef7746 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:46:07.382065 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:46:07.476591 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24833b8f-cc92-4be8-a117-a05421ef7746 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:46:07.522610 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ce554f-24cc-4745-bcce-cbfe1bc1ff24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:46:07.523250 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ce554f-24cc-4745-bcce-cbfe1bc1ff24 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:46:07.523549 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ce554f-24cc-4745-bcce-cbfe1bc1ff24 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:46:07.523818 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ce554f-24cc-4745-bcce-cbfe1bc1ff24 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:46:07.524581 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ce554f-24cc-4745-bcce-cbfe1bc1ff24 None admin] RBAC: Adding query filter params (role.id=f69dddf26daf4dd79d4c962beb877af5, scope.project.id=f148d39ced534860abfbe8fc3f98ace4, user.id=64be9d44437e4247a72334b9bab3cdd3) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:46:07.524886 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ce554f-24cc-4745-bcce-cbfe1bc1ff24 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:46:07.526372 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ce554f-24cc-4745-bcce-cbfe1bc1ff24 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:46:07.533127 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 619/1260] 10.222.0.15 () {56 vars in 1374 bytes} [Sun Oct 9 00:46:07 2022] GET /identity/v3/role_assignments?user.id=64be9d44437e4247a72334b9bab3cdd3&scope.project.id=f148d39ced534860abfbe8fc3f98ace4&role.id=f69dddf26daf4dd79d4c962beb877af5 => generated 259 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:46:09.729290 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925e85f5-24de-4147-89aa-bee0947b87bb None None] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:46:09.729914 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925e85f5-24de-4147-89aa-bee0947b87bb None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:46:09.729914 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925e85f5-24de-4147-89aa-bee0947b87bb None None] PATH_INFO: `/` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:46:09.731048 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 642/1261] 10.222.0.15 () {54 vars in 927 bytes} [Sun Oct 9 00:46:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:46:09.737077 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100ebdf5-4edc-4378-9b92-94575c59f9bc None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:46:09.737732 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100ebdf5-4edc-4378-9b92-94575c59f9bc None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:46:09.737732 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100ebdf5-4edc-4378-9b92-94575c59f9bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:46:09.757806 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-100ebdf5-4edc-4378-9b92-94575c59f9bc None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:46:09.759103 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-100ebdf5-4edc-4378-9b92-94575c59f9bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:46:09.834155 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 620/1262] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Oct 9 00:46:09 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 09 00:46:10.099518 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925e85f5-24de-4147-89aa-bee0947b87bb None None] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:46:10.111821 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:46:10.244826 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925e85f5-24de-4147-89aa-bee0947b87bb None None] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:46:10.306004 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4102ddab-15f1-449e-8655-7dc1ccb3be54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:46:10.307056 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4102ddab-15f1-449e-8655-7dc1ccb3be54 None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:46:10.307562 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4102ddab-15f1-449e-8655-7dc1ccb3be54 None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:46:10.308050 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4102ddab-15f1-449e-8655-7dc1ccb3be54 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:46:10.326447 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4102ddab-15f1-449e-8655-7dc1ccb3be54 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 09 00:46:10.336221 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application [None req-4102ddab-15f1-449e-8655-7dc1ccb3be54 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 09 00:46:10.336221 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:46:10.336221 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:46:10.336221 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:46:10.336221 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:46:10.336221 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:46:10.336221 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:46:10.336221 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:46:10.336221 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:46:10.336221 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:46:10.336221 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:46:10.336221 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:46:10.336221 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 09 00:46:10.336221 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 09 00:46:10.336221 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 09 00:46:10.336221 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 09 00:46:10.337701 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 09 00:46:10.337701 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 09 00:46:10.337701 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 09 00:46:10.337701 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 09 00:46:10.337701 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:46:10.337701 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:46:10.337701 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:46:10.337701 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:46:10.337701 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:46:10.337701 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:46:10.337701 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:46:10.337701 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application with Lock( Oct 09 00:46:10.337701 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:46:10.337701 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:46:10.337701 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:46:10.337701 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:46:10.339549 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:46:10.339549 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:46:10.339549 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:46:10.339549 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:46:10.339549 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 09 00:46:10.339549 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 09 00:46:10.339549 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 09 00:46:10.339549 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 09 00:46:10.339549 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 09 00:46:10.339549 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 09 00:46:10.339549 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 09 00:46:10.339549 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Oct 09 00:46:10.339549 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 643/1263] 10.222.0.15 () {56 vars in 1096 bytes} [Sun Oct 9 00:46:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 09 00:46:10.344616 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100ebdf5-4edc-4378-9b92-94575c59f9bc None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:46:10.364706 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:46:10.453690 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100ebdf5-4edc-4378-9b92-94575c59f9bc None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:46:10.492248 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5882ec-35af-44f5-8faa-d96739642462 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:46:10.492975 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5882ec-35af-44f5-8faa-d96739642462 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:46:10.493285 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5882ec-35af-44f5-8faa-d96739642462 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:46:10.493600 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5882ec-35af-44f5-8faa-d96739642462 None admin] PATH_INFO: `/v3/roles` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:46:10.494350 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5882ec-35af-44f5-8faa-d96739642462 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:46:10.494706 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5882ec-35af-44f5-8faa-d96739642462 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:46:10.496268 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5882ec-35af-44f5-8faa-d96739642462 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:46:10.506279 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 621/1264] 10.222.0.15 () {56 vars in 1099 bytes} [Sun Oct 9 00:46:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:46:10.512727 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4102ddab-15f1-449e-8655-7dc1ccb3be54 None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:46:10.584709 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:46:10.620849 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4102ddab-15f1-449e-8655-7dc1ccb3be54 None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:46:10.656441 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cadcce6-2384-4ab9-af60-683bd73d2259 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:46:10.657127 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cadcce6-2384-4ab9-af60-683bd73d2259 None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:46:10.657468 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cadcce6-2384-4ab9-af60-683bd73d2259 None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:46:10.657783 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cadcce6-2384-4ab9-af60-683bd73d2259 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:46:10.668729 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cadcce6-2384-4ab9-af60-683bd73d2259 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:46:10.670292 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cadcce6-2384-4ab9-af60-683bd73d2259 None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:46:10.685828 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application [None req-5cadcce6-2384-4ab9-af60-683bd73d2259 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:46:10.685828 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:46:10.685828 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:46:10.685828 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:46:10.685828 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:46:10.685828 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:46:10.685828 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:46:10.685828 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:46:10.685828 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:46:10.685828 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:46:10.685828 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:46:10.685828 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:46:10.685828 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 09 00:46:10.685828 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 09 00:46:10.685828 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 09 00:46:10.685828 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 09 00:46:10.687798 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:46:10.687798 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:46:10.687798 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:46:10.687798 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:46:10.687798 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:46:10.687798 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:46:10.687798 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:46:10.687798 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application with Lock( Oct 09 00:46:10.687798 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:46:10.687798 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:46:10.687798 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:46:10.687798 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:46:10.687798 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:46:10.687798 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:46:10.687798 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:46:10.687798 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:46:10.687798 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 09 00:46:10.689075 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 09 00:46:10.689075 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:46:10.689075 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Oct 09 00:46:10.689075 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 644/1265] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Oct 9 00:46:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:46:10.694043 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5882ec-35af-44f5-8faa-d96739642462 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:46:10.782522 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:46:10.803159 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5882ec-35af-44f5-8faa-d96739642462 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:46:10.838027 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ca5ce5-6d76-43a6-9961-3a13096e4d0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:46:10.838685 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ca5ce5-6d76-43a6-9961-3a13096e4d0e None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:46:10.839022 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ca5ce5-6d76-43a6-9961-3a13096e4d0e None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:46:10.839333 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ca5ce5-6d76-43a6-9961-3a13096e4d0e None admin] PATH_INFO: `/v3/domains` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:46:10.840046 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ca5ce5-6d76-43a6-9961-3a13096e4d0e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:46:10.840386 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ca5ce5-6d76-43a6-9961-3a13096e4d0e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:46:10.841904 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ca5ce5-6d76-43a6-9961-3a13096e4d0e None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:46:10.854353 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 622/1266] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Oct 9 00:46:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 09 00:46:10.860546 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cadcce6-2384-4ab9-af60-683bd73d2259 None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:46:10.965859 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cadcce6-2384-4ab9-af60-683bd73d2259 None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:46:10.986960 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:46:11.002951 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75561721-890f-4fbd-b0f8-257bfacbe61b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:46:11.003641 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75561721-890f-4fbd-b0f8-257bfacbe61b None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:46:11.003916 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75561721-890f-4fbd-b0f8-257bfacbe61b None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:46:11.004183 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75561721-890f-4fbd-b0f8-257bfacbe61b None admin] PATH_INFO: `/v3/users/placement` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:46:11.012342 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75561721-890f-4fbd-b0f8-257bfacbe61b None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:46:11.013860 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75561721-890f-4fbd-b0f8-257bfacbe61b None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:46:11.025661 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application [None req-75561721-890f-4fbd-b0f8-257bfacbe61b None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 09 00:46:11.025661 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:46:11.025661 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:46:11.025661 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:46:11.025661 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:46:11.025661 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:46:11.025661 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:46:11.025661 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:46:11.025661 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:46:11.025661 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:46:11.025661 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:46:11.025661 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:46:11.025661 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 09 00:46:11.025661 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 09 00:46:11.025661 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 09 00:46:11.025661 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 09 00:46:11.027319 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:46:11.027319 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:46:11.027319 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 09 00:46:11.027319 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 09 00:46:11.027319 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 09 00:46:11.027319 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 09 00:46:11.027319 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:46:11.027319 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:46:11.027319 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:46:11.027319 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:46:11.027319 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:46:11.027319 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application with Lock( Oct 09 00:46:11.027319 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:46:11.027319 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:46:11.027319 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:46:11.027319 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:46:11.027319 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:46:11.027319 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:46:11.028293 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:46:11.028293 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:46:11.028293 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 09 00:46:11.028293 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 09 00:46:11.028293 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 09 00:46:11.028293 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 09 00:46:11.028293 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 09 00:46:11.028293 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 09 00:46:11.028293 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 09 00:46:11.028293 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Oct 09 00:46:11.028293 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 645/1267] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Oct 9 00:46:10 2022] GET /identity/v3/users/placement => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:46:11.037093 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ca5ce5-6d76-43a6-9961-3a13096e4d0e None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:46:11.172944 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ca5ce5-6d76-43a6-9961-3a13096e4d0e None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:46:11.209781 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae10bff-bdf8-4fe0-a97b-e54ab598fb45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:46:11.210453 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae10bff-bdf8-4fe0-a97b-e54ab598fb45 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:46:11.210768 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae10bff-bdf8-4fe0-a97b-e54ab598fb45 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:46:11.211072 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae10bff-bdf8-4fe0-a97b-e54ab598fb45 None admin] PATH_INFO: `/v3/users` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:46:11.211878 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae10bff-bdf8-4fe0-a97b-e54ab598fb45 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:46:11.212214 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae10bff-bdf8-4fe0-a97b-e54ab598fb45 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:46:11.213680 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae10bff-bdf8-4fe0-a97b-e54ab598fb45 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:46:11.223460 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:46:11.233435 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 623/1268] 10.222.0.15 () {56 vars in 1143 bytes} [Sun Oct 9 00:46:11 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:46:11.239947 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75561721-890f-4fbd-b0f8-257bfacbe61b None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:46:11.346710 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75561721-890f-4fbd-b0f8-257bfacbe61b None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:46:11.382542 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24eb6d46-6e80-4714-8af4-39700c355f5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:46:11.383227 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24eb6d46-6e80-4714-8af4-39700c355f5a None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:46:11.383593 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24eb6d46-6e80-4714-8af4-39700c355f5a None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:46:11.383903 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24eb6d46-6e80-4714-8af4-39700c355f5a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:46:11.395076 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24eb6d46-6e80-4714-8af4-39700c355f5a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:46:11.396637 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24eb6d46-6e80-4714-8af4-39700c355f5a None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:46:11.411391 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application [None req-24eb6d46-6e80-4714-8af4-39700c355f5a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:46:11.411391 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:46:11.411391 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:46:11.411391 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:46:11.411391 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:46:11.411391 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:46:11.411391 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:46:11.411391 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:46:11.411391 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:46:11.411391 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:46:11.411391 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:46:11.411391 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:46:11.411391 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 09 00:46:11.411391 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 09 00:46:11.411391 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 09 00:46:11.411391 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 09 00:46:11.413004 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:46:11.413004 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:46:11.413004 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:46:11.413004 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:46:11.413004 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:46:11.413004 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:46:11.413004 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:46:11.413004 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application with Lock( Oct 09 00:46:11.413004 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:46:11.413004 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:46:11.413004 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:46:11.413004 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:46:11.413004 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:46:11.413004 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:46:11.413004 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:46:11.413004 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:46:11.413004 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 09 00:46:11.413907 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 09 00:46:11.413907 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:46:11.413907 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Oct 09 00:46:11.413907 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 646/1269] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Oct 9 00:46:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:46:11.421642 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae10bff-bdf8-4fe0-a97b-e54ab598fb45 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:46:11.534034 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae10bff-bdf8-4fe0-a97b-e54ab598fb45 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:46:11.568171 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2676022-da22-47db-95b3-7901af106b66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:46:11.568841 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2676022-da22-47db-95b3-7901af106b66 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:46:11.569160 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2676022-da22-47db-95b3-7901af106b66 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:46:11.569486 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2676022-da22-47db-95b3-7901af106b66 None admin] PATH_INFO: `/v3/domains` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:46:11.570185 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2676022-da22-47db-95b3-7901af106b66 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:46:11.570526 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2676022-da22-47db-95b3-7901af106b66 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:46:11.571980 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2676022-da22-47db-95b3-7901af106b66 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:46:11.584348 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 624/1270] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Oct 9 00:46:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:46:11.590678 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24eb6d46-6e80-4714-8af4-39700c355f5a None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:46:11.629178 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:46:11.704373 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24eb6d46-6e80-4714-8af4-39700c355f5a None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:46:11.739627 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba486aa-a6b1-4c05-95bf-4f0c7c0fe38b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:46:11.740319 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba486aa-a6b1-4c05-95bf-4f0c7c0fe38b None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:46:11.740632 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba486aa-a6b1-4c05-95bf-4f0c7c0fe38b None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:46:11.740935 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba486aa-a6b1-4c05-95bf-4f0c7c0fe38b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:46:11.748681 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba486aa-a6b1-4c05-95bf-4f0c7c0fe38b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:46:11.750203 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba486aa-a6b1-4c05-95bf-4f0c7c0fe38b None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:46:11.762061 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application [None req-5ba486aa-a6b1-4c05-95bf-4f0c7c0fe38b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 09 00:46:11.762061 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:46:11.762061 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:46:11.762061 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:46:11.762061 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:46:11.762061 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:46:11.762061 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:46:11.762061 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:46:11.762061 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:46:11.762061 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:46:11.762061 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:46:11.762061 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:46:11.762061 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 09 00:46:11.762061 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 09 00:46:11.762061 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 09 00:46:11.763862 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 09 00:46:11.763862 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:46:11.763862 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:46:11.763862 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:46:11.763862 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:46:11.763862 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:46:11.763862 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:46:11.763862 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:46:11.763862 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application with Lock( Oct 09 00:46:11.763862 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:46:11.763862 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:46:11.763862 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:46:11.763862 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:46:11.763862 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:46:11.763862 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:46:11.763862 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:46:11.763862 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:46:11.765717 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 09 00:46:11.765717 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 09 00:46:11.765717 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 09 00:46:11.765717 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 09 00:46:11.765717 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 09 00:46:11.765717 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 09 00:46:11.765717 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 09 00:46:11.765717 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Oct 09 00:46:11.765717 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 647/1271] 10.222.0.15 () {56 vars in 1111 bytes} [Sun Oct 9 00:46:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 09 00:46:11.770642 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2676022-da22-47db-95b3-7901af106b66 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:46:11.837770 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:46:11.882965 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2676022-da22-47db-95b3-7901af106b66 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:46:11.922282 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ffaeea-199c-4235-b597-c9a197aa5607 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:46:11.922917 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ffaeea-199c-4235-b597-c9a197aa5607 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:46:11.923190 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ffaeea-199c-4235-b597-c9a197aa5607 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:46:11.923502 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ffaeea-199c-4235-b597-c9a197aa5607 None admin] PATH_INFO: `/v3/projects` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:46:11.924211 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ffaeea-199c-4235-b597-c9a197aa5607 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:46:11.924520 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ffaeea-199c-4235-b597-c9a197aa5607 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:46:11.925997 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ffaeea-199c-4235-b597-c9a197aa5607 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:46:11.939593 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 625/1272] 10.222.0.15 () {56 vars in 1148 bytes} [Sun Oct 9 00:46:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:46:11.946055 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba486aa-a6b1-4c05-95bf-4f0c7c0fe38b None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:46:12.044413 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:46:12.054882 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba486aa-a6b1-4c05-95bf-4f0c7c0fe38b None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:46:12.090351 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77af7e8b-8c81-44cb-998d-34448fbc2ce9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:46:12.090927 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77af7e8b-8c81-44cb-998d-34448fbc2ce9 None admin] REQUEST_METHOD: `PUT` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:46:12.091200 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77af7e8b-8c81-44cb-998d-34448fbc2ce9 None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:46:12.091494 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77af7e8b-8c81-44cb-998d-34448fbc2ce9 None admin] PATH_INFO: `/v3/projects/f148d39ced534860abfbe8fc3f98ace4/users/64be9d44437e4247a72334b9bab3cdd3/roles/f69dddf26daf4dd79d4c962beb877af5` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:46:12.093374 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77af7e8b-8c81-44cb-998d-34448fbc2ce9 None admin] RBAC: Authorizing `identity:create_grant(project_id=f148d39ced534860abfbe8fc3f98ace4, user_id=64be9d44437e4247a72334b9bab3cdd3, role_id=f69dddf26daf4dd79d4c962beb877af5)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:46:12.094818 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77af7e8b-8c81-44cb-998d-34448fbc2ce9 None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:46:12.110154 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 648/1273] 10.222.0.15 () {58 vars in 1439 bytes} [Sun Oct 9 00:46:11 2022] PUT /identity/v3/projects/f148d39ced534860abfbe8fc3f98ace4/users/64be9d44437e4247a72334b9bab3cdd3/roles/f69dddf26daf4dd79d4c962beb877af5 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 09 00:46:14.326051 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06210d6-e32d-40a1-a44f-207482386e3f None None] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:46:14.326617 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06210d6-e32d-40a1-a44f-207482386e3f None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:46:14.326617 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06210d6-e32d-40a1-a44f-207482386e3f None None] PATH_INFO: `/` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:46:14.327952 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 626/1274] 10.222.0.15 () {54 vars in 927 bytes} [Sun Oct 9 00:46:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:46:14.333899 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14284e6-1875-4708-9ccc-22ca57fe54d4 None None] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:46:14.334618 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14284e6-1875-4708-9ccc-22ca57fe54d4 None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:46:14.334618 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14284e6-1875-4708-9ccc-22ca57fe54d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:46:14.354301 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.auth.core [None req-d14284e6-1875-4708-9ccc-22ca57fe54d4 None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:46:14.355551 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-d14284e6-1875-4708-9ccc-22ca57fe54d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:46:14.428188 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 649/1275] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Oct 9 00:46:14 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 09 00:46:14.698155 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06210d6-e32d-40a1-a44f-207482386e3f None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:46:14.811322 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06210d6-e32d-40a1-a44f-207482386e3f None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:46:14.830386 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:46:14.849050 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0acd6b-efac-4d7a-9e6d-a1065b44edba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:46:14.849728 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0acd6b-efac-4d7a-9e6d-a1065b44edba None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:46:14.850044 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0acd6b-efac-4d7a-9e6d-a1065b44edba None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:46:14.850355 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0acd6b-efac-4d7a-9e6d-a1065b44edba None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:46:14.860924 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0acd6b-efac-4d7a-9e6d-a1065b44edba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 09 00:46:14.865802 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application [None req-dd0acd6b-efac-4d7a-9e6d-a1065b44edba None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 09 00:46:14.865802 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:46:14.865802 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:46:14.865802 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:46:14.865802 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:46:14.865802 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:46:14.865802 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:46:14.865802 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:46:14.865802 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:46:14.865802 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:46:14.865802 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:46:14.865802 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:46:14.865802 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 09 00:46:14.865802 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 09 00:46:14.865802 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 09 00:46:14.865802 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 09 00:46:14.867893 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 09 00:46:14.867893 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 09 00:46:14.867893 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 09 00:46:14.867893 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 09 00:46:14.867893 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:46:14.867893 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:46:14.867893 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:46:14.867893 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:46:14.867893 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:46:14.867893 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:46:14.867893 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:46:14.867893 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application with Lock( Oct 09 00:46:14.867893 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:46:14.867893 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:46:14.867893 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:46:14.867893 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:46:14.869490 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:46:14.869490 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:46:14.869490 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:46:14.869490 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:46:14.869490 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 09 00:46:14.869490 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 09 00:46:14.869490 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 09 00:46:14.869490 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 09 00:46:14.869490 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 09 00:46:14.869490 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 09 00:46:14.869490 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 09 00:46:14.869490 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application Oct 09 00:46:14.869490 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 627/1276] 10.222.0.15 () {56 vars in 1096 bytes} [Sun Oct 9 00:46:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:46:14.875066 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14284e6-1875-4708-9ccc-22ca57fe54d4 None None] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:46:14.960354 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:46:14.980657 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14284e6-1875-4708-9ccc-22ca57fe54d4 None None] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:46:15.016071 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533ec224-9b36-43eb-ae0a-939713c65ea4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:46:15.016682 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533ec224-9b36-43eb-ae0a-939713c65ea4 None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:46:15.016950 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533ec224-9b36-43eb-ae0a-939713c65ea4 None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:46:15.017209 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533ec224-9b36-43eb-ae0a-939713c65ea4 None admin] PATH_INFO: `/v3/roles` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:46:15.017882 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533ec224-9b36-43eb-ae0a-939713c65ea4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:46:15.018175 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533ec224-9b36-43eb-ae0a-939713c65ea4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:46:15.019576 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533ec224-9b36-43eb-ae0a-939713c65ea4 None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:46:15.028278 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 650/1277] 10.222.0.15 () {56 vars in 1099 bytes} [Sun Oct 9 00:46:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 09 00:46:15.034660 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0acd6b-efac-4d7a-9e6d-a1065b44edba None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:46:15.139216 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0acd6b-efac-4d7a-9e6d-a1065b44edba None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:46:15.186986 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c981eef-fbf8-4ed3-a13b-67b20826ca32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:46:15.187861 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c981eef-fbf8-4ed3-a13b-67b20826ca32 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:46:15.188249 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c981eef-fbf8-4ed3-a13b-67b20826ca32 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:46:15.188630 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c981eef-fbf8-4ed3-a13b-67b20826ca32 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:46:15.203768 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c981eef-fbf8-4ed3-a13b-67b20826ca32 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:46:15.205744 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c981eef-fbf8-4ed3-a13b-67b20826ca32 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:46:15.225054 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application [None req-4c981eef-fbf8-4ed3-a13b-67b20826ca32 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:46:15.225054 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:46:15.225054 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:46:15.225054 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:46:15.225054 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:46:15.225054 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:46:15.225054 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:46:15.225054 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:46:15.225054 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:46:15.225054 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:46:15.225054 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:46:15.225054 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:46:15.225054 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 09 00:46:15.225054 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 09 00:46:15.225054 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 09 00:46:15.225054 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 09 00:46:15.226776 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:46:15.226776 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:46:15.226776 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:46:15.226776 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:46:15.226776 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:46:15.226776 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:46:15.226776 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:46:15.226776 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application with Lock( Oct 09 00:46:15.226776 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:46:15.226776 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:46:15.226776 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:46:15.226776 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:46:15.226776 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:46:15.226776 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:46:15.226776 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:46:15.226776 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:46:15.226776 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 09 00:46:15.227873 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 09 00:46:15.227873 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:46:15.227873 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application Oct 09 00:46:15.227873 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 628/1278] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Oct 9 00:46:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:46:15.232925 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533ec224-9b36-43eb-ae0a-939713c65ea4 None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:46:15.338378 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533ec224-9b36-43eb-ae0a-939713c65ea4 None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:46:15.375614 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23648c04-dbf2-47e8-bb7e-86a3cb86a6d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:46:15.376236 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23648c04-dbf2-47e8-bb7e-86a3cb86a6d2 None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:46:15.376514 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23648c04-dbf2-47e8-bb7e-86a3cb86a6d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:46:15.376783 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23648c04-dbf2-47e8-bb7e-86a3cb86a6d2 None admin] PATH_INFO: `/v3/domains` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:46:15.377432 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23648c04-dbf2-47e8-bb7e-86a3cb86a6d2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:46:15.377732 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23648c04-dbf2-47e8-bb7e-86a3cb86a6d2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:46:15.379121 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23648c04-dbf2-47e8-bb7e-86a3cb86a6d2 None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:46:15.391522 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 651/1279] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Oct 9 00:46:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:46:15.400783 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c981eef-fbf8-4ed3-a13b-67b20826ca32 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:46:15.450975 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:46:15.572576 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c981eef-fbf8-4ed3-a13b-67b20826ca32 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:46:15.608559 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72820868-fc65-452f-92eb-4652d8bb7eee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:46:15.609213 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72820868-fc65-452f-92eb-4652d8bb7eee None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:46:15.609489 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72820868-fc65-452f-92eb-4652d8bb7eee None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:46:15.609759 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72820868-fc65-452f-92eb-4652d8bb7eee None admin] PATH_INFO: `/v3/users/placement` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:46:15.618316 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72820868-fc65-452f-92eb-4652d8bb7eee None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:46:15.619819 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72820868-fc65-452f-92eb-4652d8bb7eee None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:46:15.631689 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application [None req-72820868-fc65-452f-92eb-4652d8bb7eee None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 09 00:46:15.631689 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:46:15.631689 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:46:15.631689 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:46:15.631689 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:46:15.631689 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:46:15.631689 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:46:15.631689 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:46:15.631689 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:46:15.631689 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:46:15.631689 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:46:15.631689 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:46:15.631689 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 09 00:46:15.631689 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 09 00:46:15.631689 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 09 00:46:15.631689 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 09 00:46:15.633294 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:46:15.633294 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:46:15.633294 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 09 00:46:15.633294 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 09 00:46:15.633294 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 09 00:46:15.633294 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 09 00:46:15.633294 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:46:15.633294 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:46:15.633294 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:46:15.633294 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:46:15.633294 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:46:15.633294 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application with Lock( Oct 09 00:46:15.633294 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:46:15.633294 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:46:15.633294 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:46:15.633294 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:46:15.633294 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:46:15.633294 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:46:15.634321 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:46:15.634321 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:46:15.634321 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 09 00:46:15.634321 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 09 00:46:15.634321 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 09 00:46:15.634321 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 09 00:46:15.634321 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 09 00:46:15.634321 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 09 00:46:15.634321 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 09 00:46:15.634321 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application Oct 09 00:46:15.634321 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 629/1280] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Oct 9 00:46:15 2022] GET /identity/v3/users/placement => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:46:15.641910 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23648c04-dbf2-47e8-bb7e-86a3cb86a6d2 None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:46:15.646074 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:46:15.757069 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23648c04-dbf2-47e8-bb7e-86a3cb86a6d2 None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:46:15.794685 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8421ae-fd51-4274-86e6-72b162b9df75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:46:15.795419 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8421ae-fd51-4274-86e6-72b162b9df75 None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:46:15.795750 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8421ae-fd51-4274-86e6-72b162b9df75 None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:46:15.796066 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8421ae-fd51-4274-86e6-72b162b9df75 None admin] PATH_INFO: `/v3/users` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:46:15.796859 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8421ae-fd51-4274-86e6-72b162b9df75 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:46:15.797206 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8421ae-fd51-4274-86e6-72b162b9df75 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:46:15.798711 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8421ae-fd51-4274-86e6-72b162b9df75 None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:46:15.817781 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 652/1281] 10.222.0.15 () {56 vars in 1143 bytes} [Sun Oct 9 00:46:15 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 09 00:46:15.823995 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72820868-fc65-452f-92eb-4652d8bb7eee None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:46:15.922749 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:46:15.934572 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72820868-fc65-452f-92eb-4652d8bb7eee None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:46:15.972914 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7404a084-b1b1-42ec-b9b6-0beb2c7d1a0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:46:15.973556 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7404a084-b1b1-42ec-b9b6-0beb2c7d1a0a None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:46:15.973833 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7404a084-b1b1-42ec-b9b6-0beb2c7d1a0a None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:46:15.974107 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7404a084-b1b1-42ec-b9b6-0beb2c7d1a0a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:46:16.047652 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7404a084-b1b1-42ec-b9b6-0beb2c7d1a0a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:46:16.049213 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7404a084-b1b1-42ec-b9b6-0beb2c7d1a0a None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:46:16.145976 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:46:16.157623 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 630/1282] 10.222.0.15 () {58 vars in 1282 bytes} [Sun Oct 9 00:46:15 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 09 00:46:16.163936 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8421ae-fd51-4274-86e6-72b162b9df75 None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:46:16.230269 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:46:16.275716 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8421ae-fd51-4274-86e6-72b162b9df75 None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:46:16.313651 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f2f6f6-68e1-4d2c-a863-af57dee45884 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:46:16.314306 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f2f6f6-68e1-4d2c-a863-af57dee45884 None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:46:16.314587 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f2f6f6-68e1-4d2c-a863-af57dee45884 None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:46:16.314857 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f2f6f6-68e1-4d2c-a863-af57dee45884 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:46:16.326287 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f2f6f6-68e1-4d2c-a863-af57dee45884 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:46:16.327853 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f2f6f6-68e1-4d2c-a863-af57dee45884 None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:46:16.344230 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application [None req-72f2f6f6-68e1-4d2c-a863-af57dee45884 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:46:16.344230 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:46:16.344230 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:46:16.344230 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:46:16.344230 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:46:16.344230 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:46:16.344230 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:46:16.344230 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:46:16.344230 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:46:16.344230 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:46:16.344230 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:46:16.344230 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:46:16.344230 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 09 00:46:16.344230 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 09 00:46:16.344230 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 09 00:46:16.344230 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 09 00:46:16.346568 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:46:16.346568 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:46:16.346568 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:46:16.346568 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:46:16.346568 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:46:16.346568 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:46:16.346568 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:46:16.346568 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application with Lock( Oct 09 00:46:16.346568 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:46:16.346568 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:46:16.346568 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:46:16.346568 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:46:16.346568 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:46:16.346568 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:46:16.346568 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:46:16.346568 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:46:16.346568 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 09 00:46:16.348299 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 09 00:46:16.348299 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 09 00:46:16.348299 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Oct 09 00:46:16.348299 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 653/1283] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Oct 9 00:46:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:46:16.354332 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7404a084-b1b1-42ec-b9b6-0beb2c7d1a0a None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:46:16.473734 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7404a084-b1b1-42ec-b9b6-0beb2c7d1a0a None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:46:16.529253 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f480ef8-8c2a-46ea-a565-329af76a7019 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:46:16.530263 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f480ef8-8c2a-46ea-a565-329af76a7019 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:46:16.530736 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f480ef8-8c2a-46ea-a565-329af76a7019 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:46:16.531190 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f480ef8-8c2a-46ea-a565-329af76a7019 None admin] PATH_INFO: `/v3/domains` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:46:16.532220 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f480ef8-8c2a-46ea-a565-329af76a7019 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:46:16.532526 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f480ef8-8c2a-46ea-a565-329af76a7019 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:46:16.533918 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f480ef8-8c2a-46ea-a565-329af76a7019 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:46:16.546569 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 631/1284] 10.222.0.15 () {56 vars in 1109 bytes} [Sun Oct 9 00:46:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:46:16.552648 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f2f6f6-68e1-4d2c-a863-af57dee45884 None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:46:16.661456 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f2f6f6-68e1-4d2c-a863-af57dee45884 None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:46:16.677889 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:46:16.700504 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a70da3-03d6-4b42-9dea-1f20fe4ada0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:46:16.701110 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a70da3-03d6-4b42-9dea-1f20fe4ada0f None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:46:16.701427 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a70da3-03d6-4b42-9dea-1f20fe4ada0f None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:46:16.701738 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a70da3-03d6-4b42-9dea-1f20fe4ada0f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:46:16.709347 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a70da3-03d6-4b42-9dea-1f20fe4ada0f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:46:16.710975 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a70da3-03d6-4b42-9dea-1f20fe4ada0f None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:46:16.723415 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application [None req-a3a70da3-03d6-4b42-9dea-1f20fe4ada0f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 09 00:46:16.723415 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:46:16.723415 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:46:16.723415 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:46:16.723415 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:46:16.723415 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:46:16.723415 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:46:16.723415 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:46:16.723415 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:46:16.723415 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:46:16.723415 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:46:16.723415 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:46:16.723415 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 09 00:46:16.723415 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 09 00:46:16.723415 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 09 00:46:16.725343 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 09 00:46:16.725343 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:46:16.725343 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:46:16.725343 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:46:16.725343 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:46:16.725343 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:46:16.725343 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:46:16.725343 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:46:16.725343 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application with Lock( Oct 09 00:46:16.725343 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:46:16.725343 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:46:16.725343 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:46:16.725343 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:46:16.725343 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:46:16.725343 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:46:16.725343 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:46:16.725343 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:46:16.726408 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 09 00:46:16.726408 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 09 00:46:16.726408 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 09 00:46:16.726408 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 09 00:46:16.726408 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 09 00:46:16.726408 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 09 00:46:16.726408 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 09 00:46:16.726408 dv-cinder-master-3-smb devstack@keystone.service[81525]: ERROR keystone.server.flask.application Oct 09 00:46:16.726408 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 654/1285] 10.222.0.15 () {56 vars in 1111 bytes} [Sun Oct 9 00:46:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:46:16.731712 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f480ef8-8c2a-46ea-a565-329af76a7019 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:46:16.811655 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:46:16.899360 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f480ef8-8c2a-46ea-a565-329af76a7019 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:46:16.959033 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707cb192-5a6b-48d4-b2fa-b4503c00d4f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:46:16.960032 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707cb192-5a6b-48d4-b2fa-b4503c00d4f1 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:46:16.960520 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707cb192-5a6b-48d4-b2fa-b4503c00d4f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:46:16.961001 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707cb192-5a6b-48d4-b2fa-b4503c00d4f1 None admin] PATH_INFO: `/v3/projects` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:46:16.962352 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707cb192-5a6b-48d4-b2fa-b4503c00d4f1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:46:16.962861 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707cb192-5a6b-48d4-b2fa-b4503c00d4f1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:46:16.965730 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707cb192-5a6b-48d4-b2fa-b4503c00d4f1 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:46:16.989792 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 632/1286] 10.222.0.15 () {56 vars in 1148 bytes} [Sun Oct 9 00:46:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:46:16.997311 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a70da3-03d6-4b42-9dea-1f20fe4ada0f None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:46:17.156369 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a70da3-03d6-4b42-9dea-1f20fe4ada0f None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:46:17.193099 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc543c34-955c-402c-bd5b-b3559e3aa0a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:46:17.193716 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc543c34-955c-402c-bd5b-b3559e3aa0a5 None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:46:17.193984 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc543c34-955c-402c-bd5b-b3559e3aa0a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:46:17.194249 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc543c34-955c-402c-bd5b-b3559e3aa0a5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:46:17.194983 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc543c34-955c-402c-bd5b-b3559e3aa0a5 None admin] RBAC: Adding query filter params (role.id=f69dddf26daf4dd79d4c962beb877af5, scope.project.id=f148d39ced534860abfbe8fc3f98ace4, user.id=64be9d44437e4247a72334b9bab3cdd3) {{(pid=81525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:46:17.195290 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc543c34-955c-402c-bd5b-b3559e3aa0a5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:46:17.196740 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc543c34-955c-402c-bd5b-b3559e3aa0a5 None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:46:17.203687 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 655/1287] 10.222.0.15 () {56 vars in 1374 bytes} [Sun Oct 9 00:46:16 2022] GET /identity/v3/role_assignments?user.id=64be9d44437e4247a72334b9bab3cdd3&scope.project.id=f148d39ced534860abfbe8fc3f98ace4&role.id=f69dddf26daf4dd79d4c962beb877af5 => generated 608 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:46:19.418852 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9aec9a-5093-423a-a327-fba01da0c53f None None] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:46:19.419500 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9aec9a-5093-423a-a327-fba01da0c53f None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:46:19.419500 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9aec9a-5093-423a-a327-fba01da0c53f None None] PATH_INFO: `/` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:46:19.420772 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 633/1288] 10.222.0.15 () {54 vars in 927 bytes} [Sun Oct 9 00:46:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:46:19.426240 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85e19bc-c8b9-4ce2-b55f-3571d49bf9b8 None None] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:46:19.426701 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85e19bc-c8b9-4ce2-b55f-3571d49bf9b8 None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:46:19.426795 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85e19bc-c8b9-4ce2-b55f-3571d49bf9b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:46:19.446356 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.auth.core [None req-c85e19bc-c8b9-4ce2-b55f-3571d49bf9b8 None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:46:19.447613 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-c85e19bc-c8b9-4ce2-b55f-3571d49bf9b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:46:19.482848 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:46:19.527657 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 656/1289] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Oct 9 00:46:19 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 09 00:46:19.793249 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9aec9a-5093-423a-a327-fba01da0c53f None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:46:19.901827 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9aec9a-5093-423a-a327-fba01da0c53f None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:46:19.916019 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:46:19.942267 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26aefe2d-4bd7-4fcf-86b8-e5018b16f541 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:46:19.942905 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26aefe2d-4bd7-4fcf-86b8-e5018b16f541 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:46:19.943178 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26aefe2d-4bd7-4fcf-86b8-e5018b16f541 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:46:19.943520 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26aefe2d-4bd7-4fcf-86b8-e5018b16f541 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:46:19.944100 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26aefe2d-4bd7-4fcf-86b8-e5018b16f541 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:46:19.945474 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26aefe2d-4bd7-4fcf-86b8-e5018b16f541 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:46:19.955145 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application [None req-26aefe2d-4bd7-4fcf-86b8-e5018b16f541 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 09 00:46:19.955145 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:46:19.955145 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 09 00:46:19.955145 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 09 00:46:19.955145 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 09 00:46:19.955145 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 09 00:46:19.955145 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 09 00:46:19.955145 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 09 00:46:19.955145 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 09 00:46:19.955145 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application Oct 09 00:46:19.955145 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 09 00:46:19.955145 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application Oct 09 00:46:19.955145 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:46:19.955145 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:46:19.955145 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:46:19.955145 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:46:19.955145 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:46:19.956503 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:46:19.956503 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:46:19.956503 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:46:19.956503 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:46:19.956503 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:46:19.956503 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:46:19.956503 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 09 00:46:19.956503 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 09 00:46:19.956503 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 09 00:46:19.956503 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 09 00:46:19.956503 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:46:19.956503 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:46:19.956503 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:46:19.956503 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:46:19.956503 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:46:19.956503 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:46:19.957380 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:46:19.957380 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application with Lock( Oct 09 00:46:19.957380 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:46:19.957380 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:46:19.957380 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:46:19.957380 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:46:19.957380 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:46:19.957380 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:46:19.957380 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:46:19.957380 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:46:19.957380 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 09 00:46:19.957380 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 09 00:46:19.957380 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 09 00:46:19.957380 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application Oct 09 00:46:19.957380 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 634/1290] 10.222.0.15 () {56 vars in 1117 bytes} [Sun Oct 9 00:46:19 2022] GET /identity/v3/services/placement => generated 90 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:46:19.962723 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85e19bc-c8b9-4ce2-b55f-3571d49bf9b8 None None] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:46:20.076978 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85e19bc-c8b9-4ce2-b55f-3571d49bf9b8 None None] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:46:20.119505 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e061da2-94f8-42f8-b14a-8f14a854a631 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:46:20.120139 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e061da2-94f8-42f8-b14a-8f14a854a631 None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:46:20.120411 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e061da2-94f8-42f8-b14a-8f14a854a631 None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:46:20.120678 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e061da2-94f8-42f8-b14a-8f14a854a631 None admin] PATH_INFO: `/v3/services` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:46:20.121326 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e061da2-94f8-42f8-b14a-8f14a854a631 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:46:20.121626 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e061da2-94f8-42f8-b14a-8f14a854a631 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:46:20.123065 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e061da2-94f8-42f8-b14a-8f14a854a631 None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:46:20.129489 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 657/1291] 10.222.0.15 () {56 vars in 1116 bytes} [Sun Oct 9 00:46:19 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:46:20.140329 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26aefe2d-4bd7-4fcf-86b8-e5018b16f541 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:46:20.279729 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26aefe2d-4bd7-4fcf-86b8-e5018b16f541 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:46:20.314123 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387e2568-91bf-4dcb-b22a-eb87eb4188f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:46:20.314771 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387e2568-91bf-4dcb-b22a-eb87eb4188f6 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:46:20.315042 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387e2568-91bf-4dcb-b22a-eb87eb4188f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:46:20.315307 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387e2568-91bf-4dcb-b22a-eb87eb4188f6 None admin] PATH_INFO: `/v3/services` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:46:20.315981 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387e2568-91bf-4dcb-b22a-eb87eb4188f6 None admin] RBAC: Adding query filter params (type=placement) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:46:20.316276 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387e2568-91bf-4dcb-b22a-eb87eb4188f6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:46:20.317685 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387e2568-91bf-4dcb-b22a-eb87eb4188f6 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:46:20.322937 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 635/1292] 10.222.0.15 () {56 vars in 1116 bytes} [Sun Oct 9 00:46:20 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:46:22.506252 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b664eb-837a-4006-8b52-4fd8c858df87 None None] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:46:22.506829 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b664eb-837a-4006-8b52-4fd8c858df87 None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:46:22.506829 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b664eb-837a-4006-8b52-4fd8c858df87 None None] PATH_INFO: `/` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:46:22.508263 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 658/1293] 10.222.0.15 () {54 vars in 927 bytes} [Sun Oct 9 00:46:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:46:22.516528 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26282fcf-eb38-46a6-9420-058336b2cf91 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:46:22.517089 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26282fcf-eb38-46a6-9420-058336b2cf91 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:46:22.517089 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26282fcf-eb38-46a6-9420-058336b2cf91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:46:22.537346 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-26282fcf-eb38-46a6-9420-058336b2cf91 None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:46:22.538626 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-26282fcf-eb38-46a6-9420-058336b2cf91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:46:22.574704 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:46:22.618408 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 636/1294] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Oct 9 00:46:22 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 09 00:46:22.881990 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b664eb-837a-4006-8b52-4fd8c858df87 None None] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:46:22.916150 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:46:22.994491 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b664eb-837a-4006-8b52-4fd8c858df87 None None] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:46:23.032771 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c17580-89d3-43a3-970c-7f8794c9ce64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:46:23.033448 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c17580-89d3-43a3-970c-7f8794c9ce64 None admin] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:46:23.033766 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c17580-89d3-43a3-970c-7f8794c9ce64 None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:46:23.034077 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c17580-89d3-43a3-970c-7f8794c9ce64 None admin] PATH_INFO: `/v3/services` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:46:23.034789 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c17580-89d3-43a3-970c-7f8794c9ce64 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:46:23.036290 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c17580-89d3-43a3-970c-7f8794c9ce64 None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:46:23.054039 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 659/1295] 10.222.0.15 () {60 vars in 1141 bytes} [Sun Oct 9 00:46:22 2022] POST /identity/v3/services => generated 246 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 09 00:46:25.347574 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf065664-c25b-4a53-a61a-5797e19e738d None None] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:46:25.348134 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf065664-c25b-4a53-a61a-5797e19e738d None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:46:25.348134 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf065664-c25b-4a53-a61a-5797e19e738d None None] PATH_INFO: `/` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:46:25.349461 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 637/1296] 10.222.0.15 () {54 vars in 927 bytes} [Sun Oct 9 00:46:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:46:25.355184 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04c39e4-00c5-4a09-94e2-3be6d2fc3999 None None] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:46:25.355677 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04c39e4-00c5-4a09-94e2-3be6d2fc3999 None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:46:25.355755 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04c39e4-00c5-4a09-94e2-3be6d2fc3999 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:46:25.376953 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.auth.core [None req-d04c39e4-00c5-4a09-94e2-3be6d2fc3999 None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:46:25.378176 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-d04c39e4-00c5-4a09-94e2-3be6d2fc3999 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:46:25.460227 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 660/1297] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Oct 9 00:46:25 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 09 00:46:25.723253 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf065664-c25b-4a53-a61a-5797e19e738d None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:46:25.827005 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf065664-c25b-4a53-a61a-5797e19e738d None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:46:25.863984 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef6b0b0-91af-41cd-af3d-2f445ad744b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:46:25.864677 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef6b0b0-91af-41cd-af3d-2f445ad744b2 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:46:25.864992 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef6b0b0-91af-41cd-af3d-2f445ad744b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:46:25.865298 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef6b0b0-91af-41cd-af3d-2f445ad744b2 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:46:25.865930 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef6b0b0-91af-41cd-af3d-2f445ad744b2 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:46:25.867741 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef6b0b0-91af-41cd-af3d-2f445ad744b2 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:46:25.877148 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application [None req-cef6b0b0-91af-41cd-af3d-2f445ad744b2 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 09 00:46:25.877148 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:46:25.877148 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 09 00:46:25.877148 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 09 00:46:25.877148 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 09 00:46:25.877148 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 09 00:46:25.877148 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 09 00:46:25.877148 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 09 00:46:25.877148 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 09 00:46:25.877148 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application Oct 09 00:46:25.877148 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 09 00:46:25.877148 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application Oct 09 00:46:25.877148 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:46:25.877148 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:46:25.877148 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:46:25.877148 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:46:25.877148 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:46:25.878358 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:46:25.878358 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:46:25.878358 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:46:25.878358 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:46:25.878358 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:46:25.878358 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:46:25.878358 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 09 00:46:25.878358 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 09 00:46:25.878358 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 09 00:46:25.878358 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 09 00:46:25.878358 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:46:25.878358 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:46:25.878358 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:46:25.878358 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:46:25.878358 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:46:25.878358 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:46:25.879247 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:46:25.879247 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application with Lock( Oct 09 00:46:25.879247 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:46:25.879247 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:46:25.879247 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:46:25.879247 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:46:25.879247 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:46:25.879247 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:46:25.879247 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:46:25.879247 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:46:25.879247 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 09 00:46:25.879247 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 09 00:46:25.879247 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 09 00:46:25.879247 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application Oct 09 00:46:25.879247 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 638/1298] 10.222.0.15 () {56 vars in 1117 bytes} [Sun Oct 9 00:46:25 2022] GET /identity/v3/services/placement => generated 90 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:46:25.884635 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04c39e4-00c5-4a09-94e2-3be6d2fc3999 None None] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:46:25.903960 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:46:25.987682 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04c39e4-00c5-4a09-94e2-3be6d2fc3999 None None] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:46:26.023414 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6a7657-5bce-42b6-a390-47d1be8da33c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:46:26.024028 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6a7657-5bce-42b6-a390-47d1be8da33c None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:46:26.024298 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6a7657-5bce-42b6-a390-47d1be8da33c None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:46:26.024557 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6a7657-5bce-42b6-a390-47d1be8da33c None admin] PATH_INFO: `/v3/services` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:46:26.025185 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6a7657-5bce-42b6-a390-47d1be8da33c None admin] RBAC: Adding query filter params (name=placement) {{(pid=81525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:46:26.025481 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6a7657-5bce-42b6-a390-47d1be8da33c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:46:26.026860 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6a7657-5bce-42b6-a390-47d1be8da33c None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:46:26.032328 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 661/1299] 10.222.0.15 () {56 vars in 1116 bytes} [Sun Oct 9 00:46:25 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:46:26.038515 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef6b0b0-91af-41cd-af3d-2f445ad744b2 None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:46:26.070634 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:46:26.139197 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef6b0b0-91af-41cd-af3d-2f445ad744b2 None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:46:26.173671 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46fff2b-b7e5-4334-82e2-9904d5a65db5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:46:26.174279 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46fff2b-b7e5-4334-82e2-9904d5a65db5 None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:46:26.174546 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46fff2b-b7e5-4334-82e2-9904d5a65db5 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:46:26.174803 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46fff2b-b7e5-4334-82e2-9904d5a65db5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:46:26.175545 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46fff2b-b7e5-4334-82e2-9904d5a65db5 None admin] RBAC: Adding query filter params (interface=public, service_id=12661349da3742cea4adffb982eb06df, region_id=RegionOne) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:46:26.175846 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46fff2b-b7e5-4334-82e2-9904d5a65db5 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:46:26.177204 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46fff2b-b7e5-4334-82e2-9904d5a65db5 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:46:26.182525 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 639/1300] 10.222.0.15 () {56 vars in 1251 bytes} [Sun Oct 9 00:46:26 2022] GET /identity/v3/endpoints?service_id=12661349da3742cea4adffb982eb06df&interface=public®ion_id=RegionOne => generated 194 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:46:26.189895 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6a7657-5bce-42b6-a390-47d1be8da33c None admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:46:26.307367 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:46:26.339617 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6a7657-5bce-42b6-a390-47d1be8da33c None admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:46:26.401702 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351e2265-7469-47aa-b646-58381f712310 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:46:26.402800 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351e2265-7469-47aa-b646-58381f712310 None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:46:26.403322 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351e2265-7469-47aa-b646-58381f712310 None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:46:26.403751 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351e2265-7469-47aa-b646-58381f712310 None admin] PATH_INFO: `/v3/services` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:46:26.404875 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351e2265-7469-47aa-b646-58381f712310 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:46:26.407125 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351e2265-7469-47aa-b646-58381f712310 None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:46:26.420044 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 662/1301] 10.222.0.15 () {56 vars in 1087 bytes} [Sun Oct 9 00:46:26 2022] GET /identity/v3/services => generated 2191 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 09 00:46:28.639882 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f369a956-0e75-4bb5-adda-d0dc2cbf4607 None None] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:46:28.640709 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f369a956-0e75-4bb5-adda-d0dc2cbf4607 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:46:28.640896 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f369a956-0e75-4bb5-adda-d0dc2cbf4607 None None] PATH_INFO: `/` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:46:28.642304 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 640/1302] 10.222.0.15 () {54 vars in 927 bytes} [Sun Oct 9 00:46:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:46:28.648550 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707df0ec-378f-4995-b299-3f9d4fee94e2 None None] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:46:28.649160 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707df0ec-378f-4995-b299-3f9d4fee94e2 None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:46:28.649160 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707df0ec-378f-4995-b299-3f9d4fee94e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:46:28.668834 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.auth.core [None req-707df0ec-378f-4995-b299-3f9d4fee94e2 None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:46:28.670050 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-707df0ec-378f-4995-b299-3f9d4fee94e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:46:28.745602 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 663/1303] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Oct 9 00:46:28 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 09 00:46:29.018589 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f369a956-0e75-4bb5-adda-d0dc2cbf4607 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:46:29.162202 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:46:29.172698 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f369a956-0e75-4bb5-adda-d0dc2cbf4607 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:46:29.215826 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69edb3b-4ef1-4f63-b445-537bcd2b9fef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:46:29.216524 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69edb3b-4ef1-4f63-b445-537bcd2b9fef None admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:46:29.216802 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69edb3b-4ef1-4f63-b445-537bcd2b9fef None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:46:29.217074 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69edb3b-4ef1-4f63-b445-537bcd2b9fef None admin] PATH_INFO: `/v3/services/placement` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:46:29.217668 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69edb3b-4ef1-4f63-b445-537bcd2b9fef None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:46:29.219085 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69edb3b-4ef1-4f63-b445-537bcd2b9fef None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:46:29.229333 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application [None req-a69edb3b-4ef1-4f63-b445-537bcd2b9fef None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 09 00:46:29.229333 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:46:29.229333 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 09 00:46:29.229333 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 09 00:46:29.229333 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 09 00:46:29.229333 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 09 00:46:29.229333 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 09 00:46:29.229333 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 09 00:46:29.229333 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 09 00:46:29.229333 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application Oct 09 00:46:29.229333 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 09 00:46:29.229333 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application Oct 09 00:46:29.229333 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 09 00:46:29.229333 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 09 00:46:29.229333 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 09 00:46:29.229333 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 09 00:46:29.229333 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 09 00:46:29.231408 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 09 00:46:29.231408 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 09 00:46:29.231408 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 09 00:46:29.231408 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 09 00:46:29.231408 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 09 00:46:29.231408 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 09 00:46:29.231408 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 09 00:46:29.231408 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 09 00:46:29.231408 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 09 00:46:29.231408 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 09 00:46:29.231408 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 09 00:46:29.231408 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 09 00:46:29.231408 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 09 00:46:29.231408 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 09 00:46:29.231408 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 09 00:46:29.231408 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.get_or_create( Oct 09 00:46:29.233048 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 09 00:46:29.233048 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application with Lock( Oct 09 00:46:29.233048 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 09 00:46:29.233048 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self._enter() Oct 09 00:46:29.233048 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 09 00:46:29.233048 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 09 00:46:29.233048 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 09 00:46:29.233048 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application return self.creator() Oct 09 00:46:29.233048 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 09 00:46:29.233048 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application created_value = creator( Oct 09 00:46:29.233048 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 09 00:46:29.233048 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 09 00:46:29.233048 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 09 00:46:29.233048 dv-cinder-master-3-smb devstack@keystone.service[81524]: ERROR keystone.server.flask.application Oct 09 00:46:29.233048 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 641/1304] 10.222.0.15 () {56 vars in 1117 bytes} [Sun Oct 9 00:46:29 2022] GET /identity/v3/services/placement => generated 90 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 09 00:46:29.240629 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707df0ec-378f-4995-b299-3f9d4fee94e2 None None] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:46:29.332559 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:46:29.359609 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707df0ec-378f-4995-b299-3f9d4fee94e2 None None] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:46:29.398838 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0592afa0-0c4e-4ea3-bda6-b3e4d9311fa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:46:29.399486 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0592afa0-0c4e-4ea3-bda6-b3e4d9311fa9 None admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:46:29.399715 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0592afa0-0c4e-4ea3-bda6-b3e4d9311fa9 None admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:46:29.400020 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0592afa0-0c4e-4ea3-bda6-b3e4d9311fa9 None admin] PATH_INFO: `/v3/services` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:46:29.400681 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0592afa0-0c4e-4ea3-bda6-b3e4d9311fa9 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:46:29.401005 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0592afa0-0c4e-4ea3-bda6-b3e4d9311fa9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:46:29.402485 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0592afa0-0c4e-4ea3-bda6-b3e4d9311fa9 None admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:46:29.408318 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 664/1305] 10.222.0.15 () {56 vars in 1116 bytes} [Sun Oct 9 00:46:29 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:46:29.414724 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69edb3b-4ef1-4f63-b445-537bcd2b9fef None admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:46:29.523062 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69edb3b-4ef1-4f63-b445-537bcd2b9fef None admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:46:29.560420 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2870ecbd-a2c6-4e1c-bd11-d77eb35c4f77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:46:29.561041 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2870ecbd-a2c6-4e1c-bd11-d77eb35c4f77 None admin] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:46:29.561417 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2870ecbd-a2c6-4e1c-bd11-d77eb35c4f77 None admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:46:29.561691 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2870ecbd-a2c6-4e1c-bd11-d77eb35c4f77 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:46:29.562390 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2870ecbd-a2c6-4e1c-bd11-d77eb35c4f77 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:46:29.563897 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2870ecbd-a2c6-4e1c-bd11-d77eb35c4f77 None admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:46:29.586580 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 642/1306] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Oct 9 00:46:29 2022] POST /identity/v3/endpoints => generated 331 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 09 00:46:39.405107 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=30 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:46:39.582186 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:47:40.489073 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0c168f-1b58-4daa-a3d0-5476b71cf3c6 None None] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:47:40.489586 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0c168f-1b58-4daa-a3d0-5476b71cf3c6 None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:47:40.489683 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0c168f-1b58-4daa-a3d0-5476b71cf3c6 None None] PATH_INFO: `/` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:47:40.491125 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 665/1307] 10.222.0.15 () {54 vars in 927 bytes} [Sun Oct 9 00:47:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:47:40.497522 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c859311-9166-499a-9de5-6909c699db7b None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:47:40.497937 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c859311-9166-499a-9de5-6909c699db7b None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:47:40.497937 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c859311-9166-499a-9de5-6909c699db7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:47:40.600640 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-3c859311-9166-499a-9de5-6909c699db7b None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:47:40.601968 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-3c859311-9166-499a-9de5-6909c699db7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:47:40.747363 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 643/1308] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Oct 9 00:47:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:47:41.043029 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a452afa-218a-4560-9705-37e3f7665a71 None None] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:47:41.043548 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a452afa-218a-4560-9705-37e3f7665a71 None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:47:41.043828 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a452afa-218a-4560-9705-37e3f7665a71 None None] PATH_INFO: `/` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:47:41.045183 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 666/1309] 10.222.0.15 () {54 vars in 964 bytes} [Sun Oct 9 00:47:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:47:41.051430 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e381831f-5ca2-4988-b7de-4179ac8e85e8 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:47:41.051716 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e381831f-5ca2-4988-b7de-4179ac8e85e8 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:47:41.051987 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e381831f-5ca2-4988-b7de-4179ac8e85e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:47:41.140321 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-e381831f-5ca2-4988-b7de-4179ac8e85e8 None None] MFA Rules not processed for user `f4ef90d456d2483e8ddafbe2d4d4fb5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:47:41.141526 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-e381831f-5ca2-4988-b7de-4179ac8e85e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:47:41.164174 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:47:41.225733 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 644/1310] 10.222.0.15 () {58 vars in 1061 bytes} [Sun Oct 9 00:47:41 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 09 00:47:41.235557 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a452afa-218a-4560-9705-37e3f7665a71 None None] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:47:41.237416 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-9a452afa-218a-4560-9705-37e3f7665a71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:47:41.356159 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a452afa-218a-4560-9705-37e3f7665a71 None None] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:47:41.446166 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9cd675-2f3f-42cc-aa64-d86d515ad00c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4ef90d456d2483e8ddafbe2d4d4fb5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f148d39ced534860abfbe8fc3f98ace4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:47:41.446784 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9cd675-2f3f-42cc-aa64-d86d515ad00c service neutron] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:47:41.447055 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9cd675-2f3f-42cc-aa64-d86d515ad00c service neutron] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:47:41.447348 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9cd675-2f3f-42cc-aa64-d86d515ad00c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:47:41.448987 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-bb9cd675-2f3f-42cc-aa64-d86d515ad00c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:47:41.519682 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:47:41.577160 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9cd675-2f3f-42cc-aa64-d86d515ad00c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:47:41.578666 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9cd675-2f3f-42cc-aa64-d86d515ad00c service neutron] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:47:41.597488 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 667/1311] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Oct 9 00:47:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 09 00:47:44.085152 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e71f505-6595-4b78-8446-2188faedc3a3 None None] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:47:44.085800 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e71f505-6595-4b78-8446-2188faedc3a3 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:47:44.085800 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e71f505-6595-4b78-8446-2188faedc3a3 None None] PATH_INFO: `/` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:47:44.087195 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 645/1312] 10.222.0.15 () {54 vars in 927 bytes} [Sun Oct 9 00:47:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:47:44.092573 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c49ded-36b4-46d4-a301-c340ae4d555a None None] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:47:44.093075 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c49ded-36b4-46d4-a301-c340ae4d555a None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:47:44.093075 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c49ded-36b4-46d4-a301-c340ae4d555a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:47:44.167143 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.auth.core [None req-97c49ded-36b4-46d4-a301-c340ae4d555a None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:47:44.168412 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-97c49ded-36b4-46d4-a301-c340ae4d555a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:47:44.269899 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 668/1313] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Oct 9 00:47:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:47:44.548108 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e71f505-6595-4b78-8446-2188faedc3a3 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:47:44.549742 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-6e71f505-6595-4b78-8446-2188faedc3a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:47:44.656596 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e71f505-6595-4b78-8446-2188faedc3a3 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:47:44.731712 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:47:44.734047 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496e7ac8-7646-4ab7-8b86-8180f054e55d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4ef90d456d2483e8ddafbe2d4d4fb5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f148d39ced534860abfbe8fc3f98ace4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:47:44.734696 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496e7ac8-7646-4ab7-8b86-8180f054e55d service neutron] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:47:44.734971 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496e7ac8-7646-4ab7-8b86-8180f054e55d service neutron] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:47:44.735227 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496e7ac8-7646-4ab7-8b86-8180f054e55d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:47:44.737394 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-496e7ac8-7646-4ab7-8b86-8180f054e55d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:47:44.854050 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496e7ac8-7646-4ab7-8b86-8180f054e55d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:47:44.855529 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496e7ac8-7646-4ab7-8b86-8180f054e55d service neutron] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:47:44.874184 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 646/1314] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Oct 9 00:47:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 09 00:47:47.312468 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b35186-19e5-4a9b-92ae-12053c83b303 None None] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:47:47.313038 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b35186-19e5-4a9b-92ae-12053c83b303 None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:47:47.313038 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b35186-19e5-4a9b-92ae-12053c83b303 None None] PATH_INFO: `/` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:47:47.314355 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 669/1315] 10.222.0.15 () {54 vars in 927 bytes} [Sun Oct 9 00:47:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:47:47.320119 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e929d5-06f8-441b-8079-0548f952f629 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:47:47.320552 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e929d5-06f8-441b-8079-0548f952f629 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:47:47.320688 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e929d5-06f8-441b-8079-0548f952f629 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:47:47.388982 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-f5e929d5-06f8-441b-8079-0548f952f629 None None] MFA Rules not processed for user `52f47c8c5b524339a22bd58a6fa05fd5`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:47:47.390222 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-f5e929d5-06f8-441b-8079-0548f952f629 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:47:47.443442 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:47:47.489622 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 647/1316] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Oct 9 00:47:47 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:47:47.768044 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b35186-19e5-4a9b-92ae-12053c83b303 None None] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:47:47.769638 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-39b35186-19e5-4a9b-92ae-12053c83b303 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:47:47.782072 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:47:47.881900 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b35186-19e5-4a9b-92ae-12053c83b303 None None] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:47:47.956981 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfd95b1-e4ca-4ecb-bcfb-a08fb61a15d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4ef90d456d2483e8ddafbe2d4d4fb5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f148d39ced534860abfbe8fc3f98ace4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:47:47.957590 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfd95b1-e4ca-4ecb-bcfb-a08fb61a15d9 service neutron] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:47:47.957861 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfd95b1-e4ca-4ecb-bcfb-a08fb61a15d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:47:47.958124 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfd95b1-e4ca-4ecb-bcfb-a08fb61a15d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:47:47.959760 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-6cfd95b1-e4ca-4ecb-bcfb-a08fb61a15d9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:47:48.023533 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:47:48.071536 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfd95b1-e4ca-4ecb-bcfb-a08fb61a15d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:47:48.073002 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfd95b1-e4ca-4ecb-bcfb-a08fb61a15d9 service neutron] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:47:48.091516 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 670/1317] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Oct 9 00:47:47 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 09 00:47:50.780475 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb12116b-06c0-4d8b-8ee2-c1d4f2358e75 None None] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:47:50.781033 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb12116b-06c0-4d8b-8ee2-c1d4f2358e75 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:47:50.781033 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb12116b-06c0-4d8b-8ee2-c1d4f2358e75 None None] PATH_INFO: `/` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:47:50.782240 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 648/1318] 10.222.0.15 () {54 vars in 927 bytes} [Sun Oct 9 00:47:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:47:50.788101 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9383f4-2bd1-4630-8fea-0a10e3c87be0 None None] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:47:50.788525 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9383f4-2bd1-4630-8fea-0a10e3c87be0 None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:47:50.788619 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9383f4-2bd1-4630-8fea-0a10e3c87be0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:47:50.857820 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.auth.core [None req-4c9383f4-2bd1-4630-8fea-0a10e3c87be0 None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:47:50.859042 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-4c9383f4-2bd1-4630-8fea-0a10e3c87be0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:47:50.958529 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 671/1319] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Oct 9 00:47:50 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:47:51.240884 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb12116b-06c0-4d8b-8ee2-c1d4f2358e75 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:47:51.242540 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-eb12116b-06c0-4d8b-8ee2-c1d4f2358e75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:47:51.348383 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb12116b-06c0-4d8b-8ee2-c1d4f2358e75 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:47:51.426113 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca14ed2d-9446-4e0a-9006-53bb12fe9bd7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4ef90d456d2483e8ddafbe2d4d4fb5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f148d39ced534860abfbe8fc3f98ace4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:47:51.426725 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca14ed2d-9446-4e0a-9006-53bb12fe9bd7 service neutron] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:47:51.427005 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca14ed2d-9446-4e0a-9006-53bb12fe9bd7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:47:51.427304 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca14ed2d-9446-4e0a-9006-53bb12fe9bd7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:47:51.429031 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-ca14ed2d-9446-4e0a-9006-53bb12fe9bd7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:47:51.436365 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:47:51.546418 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca14ed2d-9446-4e0a-9006-53bb12fe9bd7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:47:51.547816 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca14ed2d-9446-4e0a-9006-53bb12fe9bd7 service neutron] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:47:51.566853 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 649/1320] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Oct 9 00:47:51 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 09 00:47:54.401205 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aeead68-8f22-43b7-bb93-767150f0812f None None] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:47:54.401810 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aeead68-8f22-43b7-bb93-767150f0812f None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:47:54.401810 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aeead68-8f22-43b7-bb93-767150f0812f None None] PATH_INFO: `/` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:47:54.403127 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 672/1321] 10.222.0.15 () {54 vars in 927 bytes} [Sun Oct 9 00:47:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:47:54.408670 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf97861c-5de9-4d52-ae44-98f438093da1 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:47:54.409116 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf97861c-5de9-4d52-ae44-98f438093da1 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:47:54.409226 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf97861c-5de9-4d52-ae44-98f438093da1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:47:54.483715 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-bf97861c-5de9-4d52-ae44-98f438093da1 None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:47:54.484989 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-bf97861c-5de9-4d52-ae44-98f438093da1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:47:54.553943 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:47:54.598538 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 650/1322] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Oct 9 00:47:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:47:54.878993 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aeead68-8f22-43b7-bb93-767150f0812f None None] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:47:54.880678 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-5aeead68-8f22-43b7-bb93-767150f0812f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:47:54.903176 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:47:54.993893 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aeead68-8f22-43b7-bb93-767150f0812f None None] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:47:55.071949 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b2216b-5dd4-44e6-b45f-f3fb3517da4e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4ef90d456d2483e8ddafbe2d4d4fb5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f148d39ced534860abfbe8fc3f98ace4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:47:55.072597 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b2216b-5dd4-44e6-b45f-f3fb3517da4e service neutron] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:47:55.072867 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b2216b-5dd4-44e6-b45f-f3fb3517da4e service neutron] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:47:55.073135 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b2216b-5dd4-44e6-b45f-f3fb3517da4e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:47:55.074753 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-38b2216b-5dd4-44e6-b45f-f3fb3517da4e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:47:55.151862 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:47:55.191354 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b2216b-5dd4-44e6-b45f-f3fb3517da4e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:47:55.192817 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b2216b-5dd4-44e6-b45f-f3fb3517da4e service neutron] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:47:55.210893 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 673/1323] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Oct 9 00:47:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 09 00:47:57.442058 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bfeba4-e455-4ed6-a67b-dd85104b17c7 None None] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:47:57.442507 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bfeba4-e455-4ed6-a67b-dd85104b17c7 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:47:57.442596 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bfeba4-e455-4ed6-a67b-dd85104b17c7 None None] PATH_INFO: `/` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:47:57.444094 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 651/1324] 10.222.0.15 () {54 vars in 927 bytes} [Sun Oct 9 00:47:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:47:57.450306 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2c6c39-639e-4b1b-bfe6-93d3f5c66163 None None] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:47:57.450889 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2c6c39-639e-4b1b-bfe6-93d3f5c66163 None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:47:57.450983 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2c6c39-639e-4b1b-bfe6-93d3f5c66163 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:47:57.520206 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.auth.core [None req-3f2c6c39-639e-4b1b-bfe6-93d3f5c66163 None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:47:57.521404 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-3f2c6c39-639e-4b1b-bfe6-93d3f5c66163 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:47:57.632635 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 674/1325] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Oct 9 00:47:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:47:57.929078 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234d2772-8ff0-46d6-8c13-4cfd991adcc5 None None] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:47:57.929341 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234d2772-8ff0-46d6-8c13-4cfd991adcc5 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:47:57.929624 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234d2772-8ff0-46d6-8c13-4cfd991adcc5 None None] PATH_INFO: `/` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:47:57.931138 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 652/1326] 10.222.0.15 () {54 vars in 964 bytes} [Sun Oct 9 00:47:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:47:57.937273 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fde41c-ca02-4cb5-865b-f698d9827efc None None] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:47:57.937634 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fde41c-ca02-4cb5-865b-f698d9827efc None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:47:57.938002 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fde41c-ca02-4cb5-865b-f698d9827efc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:47:57.972181 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:47:58.023322 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.auth.core [None req-c3fde41c-ca02-4cb5-865b-f698d9827efc None None] MFA Rules not processed for user `f4ef90d456d2483e8ddafbe2d4d4fb5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:47:58.024555 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-c3fde41c-ca02-4cb5-865b-f698d9827efc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:47:58.104910 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 675/1327] 10.222.0.15 () {58 vars in 1061 bytes} [Sun Oct 9 00:47:57 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:47:58.114325 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234d2772-8ff0-46d6-8c13-4cfd991adcc5 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:47:58.115952 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-234d2772-8ff0-46d6-8c13-4cfd991adcc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:47:58.228341 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234d2772-8ff0-46d6-8c13-4cfd991adcc5 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:47:58.307143 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76120067-ba10-44bd-ad17-53ccf316f926 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4ef90d456d2483e8ddafbe2d4d4fb5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f148d39ced534860abfbe8fc3f98ace4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:47:58.307794 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76120067-ba10-44bd-ad17-53ccf316f926 service neutron] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:47:58.308070 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76120067-ba10-44bd-ad17-53ccf316f926 service neutron] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:47:58.308344 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76120067-ba10-44bd-ad17-53ccf316f926 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:47:58.309971 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-76120067-ba10-44bd-ad17-53ccf316f926 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:47:58.329427 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:47:58.430544 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76120067-ba10-44bd-ad17-53ccf316f926 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:47:58.432041 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76120067-ba10-44bd-ad17-53ccf316f926 service neutron] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:47:58.456271 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 653/1328] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Oct 9 00:47:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 09 00:48:00.903189 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ef2f86-0cf6-475b-95cc-c1adeaf7fde7 None None] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:48:00.903772 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ef2f86-0cf6-475b-95cc-c1adeaf7fde7 None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:48:00.903772 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ef2f86-0cf6-475b-95cc-c1adeaf7fde7 None None] PATH_INFO: `/` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:48:00.905074 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 676/1329] 10.222.0.15 () {54 vars in 927 bytes} [Sun Oct 9 00:48:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:48:00.911129 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7dab1b-0ddc-4d67-965f-b2873a77b7c7 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:48:00.911666 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7dab1b-0ddc-4d67-965f-b2873a77b7c7 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:48:00.911759 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7dab1b-0ddc-4d67-965f-b2873a77b7c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:48:00.985334 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-df7dab1b-0ddc-4d67-965f-b2873a77b7c7 None None] MFA Rules not processed for user `52f47c8c5b524339a22bd58a6fa05fd5`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:48:00.986570 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-df7dab1b-0ddc-4d67-965f-b2873a77b7c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:48:01.057007 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:48:01.090469 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 654/1330] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Oct 9 00:48:00 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:48:01.369615 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ef2f86-0cf6-475b-95cc-c1adeaf7fde7 None None] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:48:01.371292 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-89ef2f86-0cf6-475b-95cc-c1adeaf7fde7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:48:01.484257 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ef2f86-0cf6-475b-95cc-c1adeaf7fde7 None None] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:48:01.505685 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:48:01.563392 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98406474-1752-47d3-9ad8-4f9982c2488d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4ef90d456d2483e8ddafbe2d4d4fb5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f148d39ced534860abfbe8fc3f98ace4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:48:01.564010 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98406474-1752-47d3-9ad8-4f9982c2488d service neutron] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:48:01.564282 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98406474-1752-47d3-9ad8-4f9982c2488d service neutron] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:48:01.564529 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98406474-1752-47d3-9ad8-4f9982c2488d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:48:01.566232 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-98406474-1752-47d3-9ad8-4f9982c2488d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:48:01.684466 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98406474-1752-47d3-9ad8-4f9982c2488d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:48:01.685843 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98406474-1752-47d3-9ad8-4f9982c2488d service neutron] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:48:01.706746 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 677/1331] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Oct 9 00:48:01 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 09 00:48:04.256771 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1bf7cd-a184-4577-a32d-592583e768c7 None None] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:48:04.257389 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1bf7cd-a184-4577-a32d-592583e768c7 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:48:04.257389 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1bf7cd-a184-4577-a32d-592583e768c7 None None] PATH_INFO: `/` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:48:04.258705 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 655/1332] 10.222.0.15 () {54 vars in 927 bytes} [Sun Oct 9 00:48:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:48:04.264103 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d513c31-ba40-4335-bd06-a98128ccd896 None None] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:48:04.264537 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d513c31-ba40-4335-bd06-a98128ccd896 None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:48:04.264643 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d513c31-ba40-4335-bd06-a98128ccd896 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:48:04.332404 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:48:04.336125 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.auth.core [None req-4d513c31-ba40-4335-bd06-a98128ccd896 None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:48:04.337703 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-4d513c31-ba40-4335-bd06-a98128ccd896 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:48:04.437148 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 678/1333] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Oct 9 00:48:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:48:04.716421 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1bf7cd-a184-4577-a32d-592583e768c7 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:48:04.718012 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-3c1bf7cd-a184-4577-a32d-592583e768c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:48:04.828542 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1bf7cd-a184-4577-a32d-592583e768c7 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:48:04.907159 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963f90ee-2b7d-4227-9af7-68103f672eed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4ef90d456d2483e8ddafbe2d4d4fb5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f148d39ced534860abfbe8fc3f98ace4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:48:04.907794 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963f90ee-2b7d-4227-9af7-68103f672eed service neutron] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:48:04.908085 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963f90ee-2b7d-4227-9af7-68103f672eed service neutron] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:48:04.908351 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963f90ee-2b7d-4227-9af7-68103f672eed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:48:04.909965 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-963f90ee-2b7d-4227-9af7-68103f672eed service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:48:04.938314 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:48:05.033179 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963f90ee-2b7d-4227-9af7-68103f672eed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:48:05.034690 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963f90ee-2b7d-4227-9af7-68103f672eed service neutron] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:48:05.054608 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 656/1334] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Oct 9 00:48:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 09 00:48:07.239373 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd89d1f-5bb7-4ee6-aa61-187f4ccf753b None None] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:48:07.240067 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd89d1f-5bb7-4ee6-aa61-187f4ccf753b None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:48:07.240067 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd89d1f-5bb7-4ee6-aa61-187f4ccf753b None None] PATH_INFO: `/` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:48:07.241312 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 679/1335] 10.222.0.15 () {54 vars in 927 bytes} [Sun Oct 9 00:48:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:48:07.247177 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7f5729-fed7-4706-aa61-4dd98f24f343 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:48:07.247658 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7f5729-fed7-4706-aa61-4dd98f24f343 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:48:07.247658 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7f5729-fed7-4706-aa61-4dd98f24f343 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:48:07.315931 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-0e7f5729-fed7-4706-aa61-4dd98f24f343 None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:48:07.317187 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-0e7f5729-fed7-4706-aa61-4dd98f24f343 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:48:07.397063 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:48:07.421176 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 657/1336] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Oct 9 00:48:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:48:07.701067 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd89d1f-5bb7-4ee6-aa61-187f4ccf753b None None] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:48:07.702620 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-6fd89d1f-5bb7-4ee6-aa61-187f4ccf753b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:48:07.809941 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd89d1f-5bb7-4ee6-aa61-187f4ccf753b None None] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:48:07.839465 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:48:07.887646 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af1aec1-d9cd-48c8-b7e7-612c8a737c24 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4ef90d456d2483e8ddafbe2d4d4fb5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f148d39ced534860abfbe8fc3f98ace4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:48:07.888260 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af1aec1-d9cd-48c8-b7e7-612c8a737c24 service neutron] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:48:07.888538 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af1aec1-d9cd-48c8-b7e7-612c8a737c24 service neutron] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:48:07.888803 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af1aec1-d9cd-48c8-b7e7-612c8a737c24 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:48:07.890406 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-6af1aec1-d9cd-48c8-b7e7-612c8a737c24 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:48:08.001396 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af1aec1-d9cd-48c8-b7e7-612c8a737c24 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:48:08.002741 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af1aec1-d9cd-48c8-b7e7-612c8a737c24 service neutron] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:48:08.020998 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 680/1337] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Oct 9 00:48:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 09 00:48:10.644729 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd5c682-01fa-44da-b19d-02fc81f6e740 None None] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:48:10.645292 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd5c682-01fa-44da-b19d-02fc81f6e740 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:48:10.645292 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd5c682-01fa-44da-b19d-02fc81f6e740 None None] PATH_INFO: `/` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:48:10.646733 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 658/1338] 10.222.0.15 () {54 vars in 927 bytes} [Sun Oct 9 00:48:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:48:10.652118 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7125eb-49c2-41cb-87e3-bcd6b99667e2 None None] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:48:10.652548 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7125eb-49c2-41cb-87e3-bcd6b99667e2 None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:48:10.652642 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7125eb-49c2-41cb-87e3-bcd6b99667e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:48:10.720790 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.auth.core [None req-3c7125eb-49c2-41cb-87e3-bcd6b99667e2 None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:48:10.721905 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-3c7125eb-49c2-41cb-87e3-bcd6b99667e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:48:10.730130 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:48:10.824472 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 681/1339] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Oct 9 00:48:10 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:48:11.101277 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd5c682-01fa-44da-b19d-02fc81f6e740 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:48:11.102829 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-1fd5c682-01fa-44da-b19d-02fc81f6e740 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:48:11.212645 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd5c682-01fa-44da-b19d-02fc81f6e740 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:48:11.294226 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cce008-020b-4462-8c1c-69579935391e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4ef90d456d2483e8ddafbe2d4d4fb5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f148d39ced534860abfbe8fc3f98ace4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:48:11.294840 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cce008-020b-4462-8c1c-69579935391e service neutron] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:48:11.295114 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cce008-020b-4462-8c1c-69579935391e service neutron] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:48:11.295410 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cce008-020b-4462-8c1c-69579935391e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:48:11.297016 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-81cce008-020b-4462-8c1c-69579935391e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:48:11.334327 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:48:11.414033 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cce008-020b-4462-8c1c-69579935391e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:48:11.415512 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cce008-020b-4462-8c1c-69579935391e service neutron] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:48:11.434741 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 659/1340] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Oct 9 00:48:11 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 09 00:48:15.601241 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2390e6f2-27dd-4297-b9e1-73bec6d5e5e9 None None] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:48:15.601880 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2390e6f2-27dd-4297-b9e1-73bec6d5e5e9 None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:48:15.601880 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2390e6f2-27dd-4297-b9e1-73bec6d5e5e9 None None] PATH_INFO: `/` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:48:15.603116 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 682/1341] 10.222.0.15 () {54 vars in 927 bytes} [Sun Oct 9 00:48:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 09 00:48:15.608768 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7288fc-256e-44d3-83aa-11fddd8cab41 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:48:15.609254 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7288fc-256e-44d3-83aa-11fddd8cab41 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:48:15.609422 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7288fc-256e-44d3-83aa-11fddd8cab41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:48:15.677664 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-ea7288fc-256e-44d3-83aa-11fddd8cab41 None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:48:15.678790 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-ea7288fc-256e-44d3-83aa-11fddd8cab41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:48:15.769653 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:48:15.783556 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 660/1342] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Oct 9 00:48:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:48:16.063017 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2390e6f2-27dd-4297-b9e1-73bec6d5e5e9 None None] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:48:16.064652 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-2390e6f2-27dd-4297-b9e1-73bec6d5e5e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:48:16.176848 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2390e6f2-27dd-4297-b9e1-73bec6d5e5e9 None None] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:48:16.217553 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:48:16.255433 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916e4fb7-51bf-4af3-bad0-1bb9d2854af3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4ef90d456d2483e8ddafbe2d4d4fb5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f148d39ced534860abfbe8fc3f98ace4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:48:16.256053 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916e4fb7-51bf-4af3-bad0-1bb9d2854af3 service neutron] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:48:16.256326 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916e4fb7-51bf-4af3-bad0-1bb9d2854af3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:48:16.256596 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916e4fb7-51bf-4af3-bad0-1bb9d2854af3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:48:16.258239 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-916e4fb7-51bf-4af3-bad0-1bb9d2854af3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:48:16.370597 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916e4fb7-51bf-4af3-bad0-1bb9d2854af3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:48:16.372038 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916e4fb7-51bf-4af3-bad0-1bb9d2854af3 service neutron] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:48:16.390708 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 683/1343] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Oct 9 00:48:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 09 00:48:19.202258 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a64a0e-4071-47f9-9d2e-3a8e3bd8f031 None None] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:48:19.202862 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a64a0e-4071-47f9-9d2e-3a8e3bd8f031 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:48:19.202862 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a64a0e-4071-47f9-9d2e-3a8e3bd8f031 None None] PATH_INFO: `/` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:48:19.204155 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 661/1344] 10.222.0.15 () {54 vars in 927 bytes} [Sun Oct 9 00:48:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 09 00:48:19.209602 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e54bb76-9995-4cfa-bc4f-05ac4f81153e None None] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:48:19.210034 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e54bb76-9995-4cfa-bc4f-05ac4f81153e None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:48:19.210128 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e54bb76-9995-4cfa-bc4f-05ac4f81153e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:48:19.283100 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.auth.core [None req-2e54bb76-9995-4cfa-bc4f-05ac4f81153e None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:48:19.284377 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-2e54bb76-9995-4cfa-bc4f-05ac4f81153e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:48:19.303497 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:48:19.388723 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 684/1345] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Oct 9 00:48:19 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:48:19.670530 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a64a0e-4071-47f9-9d2e-3a8e3bd8f031 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:48:19.672232 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-56a64a0e-4071-47f9-9d2e-3a8e3bd8f031 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:48:19.780947 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a64a0e-4071-47f9-9d2e-3a8e3bd8f031 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:48:19.865915 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce47a5f-4267-4695-9177-7a390b323dcf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4ef90d456d2483e8ddafbe2d4d4fb5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f148d39ced534860abfbe8fc3f98ace4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:48:19.866548 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce47a5f-4267-4695-9177-7a390b323dcf service neutron] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:48:19.866784 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce47a5f-4267-4695-9177-7a390b323dcf service neutron] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:48:19.867069 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce47a5f-4267-4695-9177-7a390b323dcf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:48:19.868689 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-bce47a5f-4267-4695-9177-7a390b323dcf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:48:19.913105 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:48:19.984110 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce47a5f-4267-4695-9177-7a390b323dcf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:48:19.985460 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce47a5f-4267-4695-9177-7a390b323dcf service neutron] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:48:20.006089 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 662/1346] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Oct 9 00:48:19 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 09 00:48:24.175342 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0df4239-c73a-4f55-bd92-9d159160de1f None None] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:48:24.175908 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0df4239-c73a-4f55-bd92-9d159160de1f None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:48:24.176055 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0df4239-c73a-4f55-bd92-9d159160de1f None None] PATH_INFO: `/` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:48:24.178020 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 685/1347] 10.222.0.15 () {54 vars in 927 bytes} [Sun Oct 9 00:48:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:48:24.185889 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645cb409-8d1c-44c9-bb4f-277232d0438d None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:48:24.186449 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645cb409-8d1c-44c9-bb4f-277232d0438d None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:48:24.186449 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645cb409-8d1c-44c9-bb4f-277232d0438d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:48:24.279943 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-645cb409-8d1c-44c9-bb4f-277232d0438d None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:48:24.281998 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-645cb409-8d1c-44c9-bb4f-277232d0438d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:48:24.396705 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:48:24.399197 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 663/1348] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Oct 9 00:48:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:48:24.682883 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0df4239-c73a-4f55-bd92-9d159160de1f None None] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:48:24.684563 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-b0df4239-c73a-4f55-bd92-9d159160de1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:48:24.800354 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0df4239-c73a-4f55-bd92-9d159160de1f None None] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:48:24.868466 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:48:24.899290 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbaa9d0b-cf96-4849-a00f-b90755744cb7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4ef90d456d2483e8ddafbe2d4d4fb5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f148d39ced534860abfbe8fc3f98ace4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:48:24.899915 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaa9d0b-cf96-4849-a00f-b90755744cb7 service neutron] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:48:24.900166 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaa9d0b-cf96-4849-a00f-b90755744cb7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:48:24.900456 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaa9d0b-cf96-4849-a00f-b90755744cb7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:48:24.902163 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-cbaa9d0b-cf96-4849-a00f-b90755744cb7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:48:25.029759 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbaa9d0b-cf96-4849-a00f-b90755744cb7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:48:25.032091 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbaa9d0b-cf96-4849-a00f-b90755744cb7 service neutron] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:48:25.059883 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 686/1349] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Oct 9 00:48:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 09 00:48:30.007739 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff945245-65d9-4a79-bd2c-072a1eefe3a3 None None] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:48:30.008226 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff945245-65d9-4a79-bd2c-072a1eefe3a3 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:48:30.008307 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff945245-65d9-4a79-bd2c-072a1eefe3a3 None None] PATH_INFO: `/` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:48:30.011366 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 664/1350] 10.222.0.15 () {54 vars in 921 bytes} [Sun Oct 9 00:48:30 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:48:30.017684 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d6bca7-1fe8-495e-beb5-69307de86396 None None] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:48:30.018664 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d6bca7-1fe8-495e-beb5-69307de86396 None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:48:30.019181 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d6bca7-1fe8-495e-beb5-69307de86396 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:48:30.131336 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.auth.core [None req-36d6bca7-1fe8-495e-beb5-69307de86396 None None] MFA Rules not processed for user `64be9d44437e4247a72334b9bab3cdd3`. Rule list: `[]` (Enabled: `True`). {{(pid=81525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:48:30.132591 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-36d6bca7-1fe8-495e-beb5-69307de86396 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:48:30.159936 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:48:30.305330 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 687/1351] 10.222.0.15 () {58 vars in 1018 bytes} [Sun Oct 9 00:48:30 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:48:34.732618 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547fcd2a-d7cb-4483-ba8e-865926cd53a6 None None] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:48:34.733154 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547fcd2a-d7cb-4483-ba8e-865926cd53a6 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:48:34.733154 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547fcd2a-d7cb-4483-ba8e-865926cd53a6 None None] PATH_INFO: `/` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:48:34.734846 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 665/1352] 10.222.0.15 () {54 vars in 921 bytes} [Sun Oct 9 00:48:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:48:34.740761 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046d7977-dec1-4d5b-8f9e-b574f1e0ba3d None None] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:48:34.741457 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046d7977-dec1-4d5b-8f9e-b574f1e0ba3d None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:48:34.741457 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046d7977-dec1-4d5b-8f9e-b574f1e0ba3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:48:34.828951 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.auth.core [None req-046d7977-dec1-4d5b-8f9e-b574f1e0ba3d None None] MFA Rules not processed for user `64be9d44437e4247a72334b9bab3cdd3`. Rule list: `[]` (Enabled: `True`). {{(pid=81525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:48:34.830157 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-046d7977-dec1-4d5b-8f9e-b574f1e0ba3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:48:34.918663 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:48:34.969481 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 688/1353] 10.222.0.15 () {58 vars in 1018 bytes} [Sun Oct 9 00:48:34 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:48:36.585703 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239ef935-2580-4ad0-a6d3-18b126f714da None None] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:48:36.586291 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239ef935-2580-4ad0-a6d3-18b126f714da None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:48:36.586291 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239ef935-2580-4ad0-a6d3-18b126f714da None None] PATH_INFO: `/` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:48:36.587592 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 666/1354] 10.222.0.15 () {54 vars in 921 bytes} [Sun Oct 9 00:48:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:48:36.593067 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d901e66-b2ac-401d-bb5d-31bd8deb3873 None None] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:48:36.593562 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d901e66-b2ac-401d-bb5d-31bd8deb3873 None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:48:36.593667 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d901e66-b2ac-401d-bb5d-31bd8deb3873 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:48:36.677120 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.auth.core [None req-9d901e66-b2ac-401d-bb5d-31bd8deb3873 None None] MFA Rules not processed for user `64be9d44437e4247a72334b9bab3cdd3`. Rule list: `[]` (Enabled: `True`). {{(pid=81525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:48:36.678432 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-9d901e66-b2ac-401d-bb5d-31bd8deb3873 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:48:36.791379 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 689/1355] 10.222.0.15 () {58 vars in 1018 bytes} [Sun Oct 9 00:48:36 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 09 00:48:40.493154 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355d552b-ea85-4109-9398-da5e2fb2505a None None] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:48:40.493996 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355d552b-ea85-4109-9398-da5e2fb2505a None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:48:40.494356 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355d552b-ea85-4109-9398-da5e2fb2505a None None] PATH_INFO: `/` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:48:40.499835 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 667/1356] 10.222.0.15 () {54 vars in 927 bytes} [Sun Oct 9 00:48:40 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:48:40.505890 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4952cb2-38bb-45d4-b86c-f802ff46547a None None] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:48:40.506432 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4952cb2-38bb-45d4-b86c-f802ff46547a None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:48:40.506432 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4952cb2-38bb-45d4-b86c-f802ff46547a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:48:40.565884 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:48:40.611674 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.auth.core [None req-b4952cb2-38bb-45d4-b86c-f802ff46547a None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:48:40.613992 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-b4952cb2-38bb-45d4-b86c-f802ff46547a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:48:40.730166 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 690/1357] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Oct 9 00:48:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 09 00:48:41.028950 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba242303-139e-4d50-a846-cfb434968334 None None] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:48:41.029954 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba242303-139e-4d50-a846-cfb434968334 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:48:41.030592 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba242303-139e-4d50-a846-cfb434968334 None None] PATH_INFO: `/` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:48:41.032460 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 668/1358] 10.222.0.15 () {54 vars in 961 bytes} [Sun Oct 9 00:48:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:48:41.040830 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560e3fa9-f8a2-46ad-9a15-0e8a2874772c None None] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:48:41.041210 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560e3fa9-f8a2-46ad-9a15-0e8a2874772c None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:48:41.041407 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560e3fa9-f8a2-46ad-9a15-0e8a2874772c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:48:41.120567 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.auth.core [None req-560e3fa9-f8a2-46ad-9a15-0e8a2874772c None None] MFA Rules not processed for user `4ac83d57fba841e0a666710732249c49`. Rule list: `[]` (Enabled: `True`). {{(pid=81525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:48:41.121769 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-560e3fa9-f8a2-46ad-9a15-0e8a2874772c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:48:41.174115 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:48:41.243850 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 691/1359] 10.222.0.15 () {58 vars in 1058 bytes} [Sun Oct 9 00:48:41 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:48:41.251543 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba242303-139e-4d50-a846-cfb434968334 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:48:41.253062 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-ba242303-139e-4d50-a846-cfb434968334 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:48:41.407770 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba242303-139e-4d50-a846-cfb434968334 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:48:41.490312 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:48:41.534728 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8503905-3714-4d43-b55a-22e725e391c6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ac83d57fba841e0a666710732249c49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f148d39ced534860abfbe8fc3f98ace4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:48:41.535628 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8503905-3714-4d43-b55a-22e725e391c6 service nova] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:48:41.536011 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8503905-3714-4d43-b55a-22e725e391c6 service nova] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:48:41.536379 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8503905-3714-4d43-b55a-22e725e391c6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:48:41.538252 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-d8503905-3714-4d43-b55a-22e725e391c6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:48:41.642865 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8503905-3714-4d43-b55a-22e725e391c6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:48:41.644730 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8503905-3714-4d43-b55a-22e725e391c6 service nova] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:48:41.665523 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 669/1360] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Oct 9 00:48:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 09 00:48:44.082108 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bae557-37c5-4302-bb0c-ead830328ad9 None None] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:48:44.082644 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bae557-37c5-4302-bb0c-ead830328ad9 None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:48:44.082644 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bae557-37c5-4302-bb0c-ead830328ad9 None None] PATH_INFO: `/` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:48:44.084760 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 692/1361] 10.222.0.15 () {54 vars in 927 bytes} [Sun Oct 9 00:48:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:48:44.090140 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bb3ab2-c224-4ef1-b76a-7bf38da314ab None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:48:44.090604 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bb3ab2-c224-4ef1-b76a-7bf38da314ab None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:48:44.090697 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bb3ab2-c224-4ef1-b76a-7bf38da314ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:48:44.166256 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-99bb3ab2-c224-4ef1-b76a-7bf38da314ab None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:48:44.167566 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-99bb3ab2-c224-4ef1-b76a-7bf38da314ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:48:44.228938 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:48:44.308235 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 670/1362] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Oct 9 00:48:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:48:44.604719 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bae557-37c5-4302-bb0c-ead830328ad9 None None] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:48:44.606257 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-e0bae557-37c5-4302-bb0c-ead830328ad9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:48:44.778829 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bae557-37c5-4302-bb0c-ead830328ad9 None None] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:48:44.790320 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:48:44.925790 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6d3ca2-4635-4f80-b83c-1317c1fc8396 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ac83d57fba841e0a666710732249c49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f148d39ced534860abfbe8fc3f98ace4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:48:44.926418 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6d3ca2-4635-4f80-b83c-1317c1fc8396 service nova] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:48:44.926697 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6d3ca2-4635-4f80-b83c-1317c1fc8396 service nova] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:48:44.926973 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6d3ca2-4635-4f80-b83c-1317c1fc8396 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:48:44.928937 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-fd6d3ca2-4635-4f80-b83c-1317c1fc8396 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:48:45.035549 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6d3ca2-4635-4f80-b83c-1317c1fc8396 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:48:45.037170 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6d3ca2-4635-4f80-b83c-1317c1fc8396 service nova] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:48:45.055897 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 693/1363] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Oct 9 00:48:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 452 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 09 00:48:47.560571 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61aed56-ce5e-4961-8a56-62c30474951e None None] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:48:47.561144 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61aed56-ce5e-4961-8a56-62c30474951e None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:48:47.561240 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61aed56-ce5e-4961-8a56-62c30474951e None None] PATH_INFO: `/` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:48:47.562752 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 671/1364] 10.222.0.15 () {54 vars in 927 bytes} [Sun Oct 9 00:48:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:48:47.568427 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6e8bde-7baf-41eb-9049-0e3e1c2b1423 None None] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:48:47.568933 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6e8bde-7baf-41eb-9049-0e3e1c2b1423 None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:48:47.568933 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6e8bde-7baf-41eb-9049-0e3e1c2b1423 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:48:47.585163 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:48:47.638015 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.auth.core [None req-1a6e8bde-7baf-41eb-9049-0e3e1c2b1423 None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:48:47.639243 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-1a6e8bde-7baf-41eb-9049-0e3e1c2b1423 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:48:47.741823 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 694/1365] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Oct 9 00:48:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:48:48.027543 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b57b0d-8ad0-4f18-8273-cde0e2c8b9f9 None None] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:48:48.027826 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b57b0d-8ad0-4f18-8273-cde0e2c8b9f9 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:48:48.028097 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b57b0d-8ad0-4f18-8273-cde0e2c8b9f9 None None] PATH_INFO: `/` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:48:48.029895 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 672/1366] 10.222.0.15 () {54 vars in 961 bytes} [Sun Oct 9 00:48:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:48:48.036068 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcce354-ceba-4d71-ad92-5fcd8f17038f None None] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:48:48.036501 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcce354-ceba-4d71-ad92-5fcd8f17038f None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:48:48.036902 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcce354-ceba-4d71-ad92-5fcd8f17038f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:48:48.122863 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.auth.core [None req-5dcce354-ceba-4d71-ad92-5fcd8f17038f None None] MFA Rules not processed for user `4ac83d57fba841e0a666710732249c49`. Rule list: `[]` (Enabled: `True`). {{(pid=81525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:48:48.124121 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-5dcce354-ceba-4d71-ad92-5fcd8f17038f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:48:48.161034 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:48:48.248011 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 695/1367] 10.222.0.15 () {58 vars in 1058 bytes} [Sun Oct 9 00:48:48 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:48:48.256630 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b57b0d-8ad0-4f18-8273-cde0e2c8b9f9 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:48:48.258301 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-c1b57b0d-8ad0-4f18-8273-cde0e2c8b9f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:48:48.415225 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b57b0d-8ad0-4f18-8273-cde0e2c8b9f9 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:48:48.448320 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:48:48.548754 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ee3256-7a87-4e73-a5df-97e86a92a632 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ac83d57fba841e0a666710732249c49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f148d39ced534860abfbe8fc3f98ace4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:48:48.549379 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ee3256-7a87-4e73-a5df-97e86a92a632 service nova] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:48:48.549611 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ee3256-7a87-4e73-a5df-97e86a92a632 service nova] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:48:48.550022 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ee3256-7a87-4e73-a5df-97e86a92a632 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:48:48.551757 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-33ee3256-7a87-4e73-a5df-97e86a92a632 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:48:48.663196 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ee3256-7a87-4e73-a5df-97e86a92a632 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:48:48.664891 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ee3256-7a87-4e73-a5df-97e86a92a632 service nova] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:48:48.687143 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 673/1368] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Oct 9 00:48:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 09 00:48:48.831134 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2844e9-c6e5-40bd-8b79-39ffd83eb1d5 None None] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:48:48.831816 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2844e9-c6e5-40bd-8b79-39ffd83eb1d5 None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:48:48.831816 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2844e9-c6e5-40bd-8b79-39ffd83eb1d5 None None] PATH_INFO: `/` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:48:48.833432 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 696/1369] 10.222.0.15 () {54 vars in 927 bytes} [Sun Oct 9 00:48:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:48:48.839475 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40af1ba-b3e8-40d5-8405-fb3cf075ab74 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:48:48.839973 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40af1ba-b3e8-40d5-8405-fb3cf075ab74 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:48:48.840338 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40af1ba-b3e8-40d5-8405-fb3cf075ab74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:48:48.880536 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:48:48.925134 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-e40af1ba-b3e8-40d5-8405-fb3cf075ab74 None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:48:48.926568 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-e40af1ba-b3e8-40d5-8405-fb3cf075ab74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:48:49.050880 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 674/1370] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Oct 9 00:48:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:48:49.371283 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92eb288-6e47-4573-b543-e0dbdbe48a3e None None] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:48:49.371527 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92eb288-6e47-4573-b543-e0dbdbe48a3e None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:48:49.371811 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92eb288-6e47-4573-b543-e0dbdbe48a3e None None] PATH_INFO: `/` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:48:49.375294 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 697/1371] 10.222.0.15 () {54 vars in 963 bytes} [Sun Oct 9 00:48:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:48:49.378805 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d296f22-6089-494a-82ef-7b12cd1674a2 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:48:49.379223 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d296f22-6089-494a-82ef-7b12cd1674a2 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:48:49.379614 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d296f22-6089-494a-82ef-7b12cd1674a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:48:49.470961 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-4d296f22-6089-494a-82ef-7b12cd1674a2 None None] MFA Rules not processed for user `ff7cb78bcd91467abe5c2e2b48aedd1b`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:48:49.472209 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-4d296f22-6089-494a-82ef-7b12cd1674a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:48:49.523729 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:48:49.560553 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 675/1372] 10.222.0.15 () {58 vars in 1060 bytes} [Sun Oct 9 00:48:49 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:48:49.568257 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92eb288-6e47-4573-b543-e0dbdbe48a3e None None] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:48:49.569839 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-e92eb288-6e47-4573-b543-e0dbdbe48a3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:48:49.681592 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92eb288-6e47-4573-b543-e0dbdbe48a3e None None] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:48:49.724654 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:48:49.763985 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72ef9da-17d1-4228-9488-8a77ab01bc0b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff7cb78bcd91467abe5c2e2b48aedd1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f148d39ced534860abfbe8fc3f98ace4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:48:49.764601 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72ef9da-17d1-4228-9488-8a77ab01bc0b service cinder] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:48:49.765074 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72ef9da-17d1-4228-9488-8a77ab01bc0b service cinder] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:48:49.765074 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72ef9da-17d1-4228-9488-8a77ab01bc0b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:48:49.766801 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-c72ef9da-17d1-4228-9488-8a77ab01bc0b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:48:49.906940 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72ef9da-17d1-4228-9488-8a77ab01bc0b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:48:49.908841 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72ef9da-17d1-4228-9488-8a77ab01bc0b service cinder] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:48:49.930193 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 698/1373] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Oct 9 00:48:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 09 00:48:50.949109 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1c0791-7363-4576-8e95-8a94d17c85e1 None None] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:48:50.949734 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1c0791-7363-4576-8e95-8a94d17c85e1 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:48:50.949734 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1c0791-7363-4576-8e95-8a94d17c85e1 None None] PATH_INFO: `/` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:48:50.950983 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 676/1374] 10.222.0.15 () {54 vars in 927 bytes} [Sun Oct 9 00:48:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:48:50.956623 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c23de96-a83f-4248-af35-12bd230ba6f9 None None] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:48:50.957091 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c23de96-a83f-4248-af35-12bd230ba6f9 None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:48:50.957200 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c23de96-a83f-4248-af35-12bd230ba6f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:48:51.024115 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.auth.core [None req-0c23de96-a83f-4248-af35-12bd230ba6f9 None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:48:51.025349 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-0c23de96-a83f-4248-af35-12bd230ba6f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:48:51.048850 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:48:51.135799 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 699/1375] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Oct 9 00:48:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:48:51.428896 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1c0791-7363-4576-8e95-8a94d17c85e1 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:48:51.430441 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-0a1c0791-7363-4576-8e95-8a94d17c85e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:48:51.597259 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1c0791-7363-4576-8e95-8a94d17c85e1 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:48:51.652930 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:48:51.721921 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17698a0d-1db3-4d7c-aa31-74bdc76d58b2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ac83d57fba841e0a666710732249c49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f148d39ced534860abfbe8fc3f98ace4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:48:51.722552 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17698a0d-1db3-4d7c-aa31-74bdc76d58b2 service nova] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:48:51.722827 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17698a0d-1db3-4d7c-aa31-74bdc76d58b2 service nova] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:48:51.723093 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17698a0d-1db3-4d7c-aa31-74bdc76d58b2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:48:51.724883 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-17698a0d-1db3-4d7c-aa31-74bdc76d58b2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:48:51.835233 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17698a0d-1db3-4d7c-aa31-74bdc76d58b2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:48:51.836948 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17698a0d-1db3-4d7c-aa31-74bdc76d58b2 service nova] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:48:51.858522 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 677/1376] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Oct 9 00:48:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 09 00:48:54.082567 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d31c57-9633-46e1-9154-3f86026addd0 None None] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:48:54.083107 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d31c57-9633-46e1-9154-3f86026addd0 None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:48:54.083107 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d31c57-9633-46e1-9154-3f86026addd0 None None] PATH_INFO: `/` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:48:54.084568 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 700/1377] 10.222.0.15 () {54 vars in 927 bytes} [Sun Oct 9 00:48:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:48:54.090086 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d5bee3-1f4a-49cf-a2c9-5cf637679907 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:48:54.090561 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d5bee3-1f4a-49cf-a2c9-5cf637679907 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:48:54.090561 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d5bee3-1f4a-49cf-a2c9-5cf637679907 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:48:54.160276 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-31d5bee3-1f4a-49cf-a2c9-5cf637679907 None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:48:54.161482 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-31d5bee3-1f4a-49cf-a2c9-5cf637679907 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:48:54.169052 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:48:54.271311 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 678/1378] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Oct 9 00:48:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:48:54.559767 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d31c57-9633-46e1-9154-3f86026addd0 None None] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:48:54.561299 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-a9d31c57-9633-46e1-9154-3f86026addd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:48:54.716931 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d31c57-9633-46e1-9154-3f86026addd0 None None] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:48:54.720925 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:48:54.835273 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c69350d-7ab4-4584-a588-12f35a6fc2e4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ac83d57fba841e0a666710732249c49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f148d39ced534860abfbe8fc3f98ace4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:48:54.835933 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c69350d-7ab4-4584-a588-12f35a6fc2e4 service nova] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:48:54.836207 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c69350d-7ab4-4584-a588-12f35a6fc2e4 service nova] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:48:54.836473 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c69350d-7ab4-4584-a588-12f35a6fc2e4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:48:54.838060 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-6c69350d-7ab4-4584-a588-12f35a6fc2e4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:48:54.933609 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c69350d-7ab4-4584-a588-12f35a6fc2e4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:48:54.935246 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c69350d-7ab4-4584-a588-12f35a6fc2e4 service nova] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:48:54.954570 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 701/1379] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Oct 9 00:48:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 09 00:48:57.178314 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fba01c-a606-4f7d-9772-a46464a4c53a None None] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:48:57.178920 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fba01c-a606-4f7d-9772-a46464a4c53a None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:48:57.178920 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fba01c-a606-4f7d-9772-a46464a4c53a None None] PATH_INFO: `/` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:48:57.180682 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 679/1380] 10.222.0.15 () {54 vars in 927 bytes} [Sun Oct 9 00:48:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:48:57.186340 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1fa5bd-0781-4696-b8db-d681eca332d3 None None] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:48:57.186770 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1fa5bd-0781-4696-b8db-d681eca332d3 None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:48:57.186952 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1fa5bd-0781-4696-b8db-d681eca332d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:48:57.198800 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:48:57.257949 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.auth.core [None req-2c1fa5bd-0781-4696-b8db-d681eca332d3 None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:48:57.259458 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-2c1fa5bd-0781-4696-b8db-d681eca332d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:48:57.405973 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 702/1381] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Oct 9 00:48:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:48:57.689948 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fba01c-a606-4f7d-9772-a46464a4c53a None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:48:57.691554 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-b3fba01c-a606-4f7d-9772-a46464a4c53a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:48:57.837905 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:48:57.850529 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fba01c-a606-4f7d-9772-a46464a4c53a None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:48:57.969373 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ca00d4-73d8-4d03-b56e-3e5e81c2599f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ac83d57fba841e0a666710732249c49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f148d39ced534860abfbe8fc3f98ace4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:48:57.969898 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ca00d4-73d8-4d03-b56e-3e5e81c2599f service nova] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:48:57.970173 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ca00d4-73d8-4d03-b56e-3e5e81c2599f service nova] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:48:57.970440 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ca00d4-73d8-4d03-b56e-3e5e81c2599f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:48:57.972098 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-90ca00d4-73d8-4d03-b56e-3e5e81c2599f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:48:58.061598 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ca00d4-73d8-4d03-b56e-3e5e81c2599f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:48:58.063227 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ca00d4-73d8-4d03-b56e-3e5e81c2599f service nova] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:48:58.073556 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:48:58.082083 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 680/1382] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Oct 9 00:48:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 09 00:49:00.376003 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db479875-bf19-4bac-9532-0bd809fee1bb None None] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:49:00.376607 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db479875-bf19-4bac-9532-0bd809fee1bb None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:49:00.376607 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db479875-bf19-4bac-9532-0bd809fee1bb None None] PATH_INFO: `/` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:49:00.377890 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 703/1383] 10.222.0.15 () {54 vars in 927 bytes} [Sun Oct 9 00:49:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:49:00.383471 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb1d7d8-9445-447d-ac52-2b0798057abd None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:49:00.383961 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb1d7d8-9445-447d-ac52-2b0798057abd None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:49:00.384057 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb1d7d8-9445-447d-ac52-2b0798057abd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:49:00.452712 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-5bb1d7d8-9445-447d-ac52-2b0798057abd None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:49:00.453958 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-5bb1d7d8-9445-447d-ac52-2b0798057abd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:49:00.572179 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 681/1384] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Oct 9 00:49:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:49:00.860608 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db479875-bf19-4bac-9532-0bd809fee1bb None None] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:49:00.862411 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-db479875-bf19-4bac-9532-0bd809fee1bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:49:00.972652 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:49:01.055273 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db479875-bf19-4bac-9532-0bd809fee1bb None None] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:49:01.222211 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cbe3f6-65f5-4b00-8bf7-030bf834562c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ac83d57fba841e0a666710732249c49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f148d39ced534860abfbe8fc3f98ace4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:49:01.222832 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cbe3f6-65f5-4b00-8bf7-030bf834562c service nova] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:49:01.223203 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cbe3f6-65f5-4b00-8bf7-030bf834562c service nova] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:49:01.223677 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cbe3f6-65f5-4b00-8bf7-030bf834562c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:49:01.226593 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-f7cbe3f6-65f5-4b00-8bf7-030bf834562c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:49:01.305332 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:49:01.362702 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cbe3f6-65f5-4b00-8bf7-030bf834562c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:49:01.364602 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cbe3f6-65f5-4b00-8bf7-030bf834562c service nova] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:49:01.384463 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 704/1385] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Oct 9 00:49:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 524 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 09 00:49:03.520153 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7c56ba-d940-4b08-ba44-1bc57cee27d3 None None] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:49:03.520969 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7c56ba-d940-4b08-ba44-1bc57cee27d3 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:49:03.520969 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7c56ba-d940-4b08-ba44-1bc57cee27d3 None None] PATH_INFO: `/` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:49:03.522169 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 682/1386] 10.222.0.15 () {54 vars in 927 bytes} [Sun Oct 9 00:49:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:49:03.528564 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ba3876-347a-44d3-bd30-60a3a2d803b1 None None] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:49:03.529489 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ba3876-347a-44d3-bd30-60a3a2d803b1 None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:49:03.529489 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ba3876-347a-44d3-bd30-60a3a2d803b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:49:03.616857 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.auth.core [None req-93ba3876-347a-44d3-bd30-60a3a2d803b1 None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:49:03.618175 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-93ba3876-347a-44d3-bd30-60a3a2d803b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:49:03.723414 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 705/1387] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Oct 9 00:49:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 09 00:49:04.004787 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7c56ba-d940-4b08-ba44-1bc57cee27d3 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:49:04.006320 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-df7c56ba-d940-4b08-ba44-1bc57cee27d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:49:04.096561 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:49:04.184568 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7c56ba-d940-4b08-ba44-1bc57cee27d3 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:49:04.324654 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef13dda-1834-426b-9c18-981ee9351ab7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ac83d57fba841e0a666710732249c49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f148d39ced534860abfbe8fc3f98ace4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:49:04.325197 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef13dda-1834-426b-9c18-981ee9351ab7 service nova] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:49:04.325474 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef13dda-1834-426b-9c18-981ee9351ab7 service nova] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:49:04.325742 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef13dda-1834-426b-9c18-981ee9351ab7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:49:04.327498 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-0ef13dda-1834-426b-9c18-981ee9351ab7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:49:04.374598 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:49:04.443818 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef13dda-1834-426b-9c18-981ee9351ab7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:49:04.445522 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef13dda-1834-426b-9c18-981ee9351ab7 service nova] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:49:04.466606 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 683/1388] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Oct 9 00:49:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 462 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 09 00:49:06.692492 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b10614-f5b3-41a5-915f-4892a64afdda None None] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:49:06.693193 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b10614-f5b3-41a5-915f-4892a64afdda None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:49:06.693193 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b10614-f5b3-41a5-915f-4892a64afdda None None] PATH_INFO: `/` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:49:06.694397 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 706/1389] 10.222.0.15 () {54 vars in 927 bytes} [Sun Oct 9 00:49:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:49:06.700242 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7521ddf-c6d1-4c1b-8d7d-8bc96b39306f None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:49:06.701026 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7521ddf-c6d1-4c1b-8d7d-8bc96b39306f None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:49:06.701026 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7521ddf-c6d1-4c1b-8d7d-8bc96b39306f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:49:06.791042 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-b7521ddf-c6d1-4c1b-8d7d-8bc96b39306f None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:49:06.792335 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-b7521ddf-c6d1-4c1b-8d7d-8bc96b39306f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:49:06.910752 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 684/1390] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Oct 9 00:49:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 09 00:49:07.217900 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b10614-f5b3-41a5-915f-4892a64afdda None None] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:49:07.222739 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-11b10614-f5b3-41a5-915f-4892a64afdda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:49:07.260472 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:49:07.388418 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b10614-f5b3-41a5-915f-4892a64afdda None None] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:49:07.500924 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:49:07.515902 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b5411e-1857-4bbc-a9b8-edfaa4853da4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ac83d57fba841e0a666710732249c49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f148d39ced534860abfbe8fc3f98ace4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:49:07.516450 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b5411e-1857-4bbc-a9b8-edfaa4853da4 service nova] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:49:07.517699 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b5411e-1857-4bbc-a9b8-edfaa4853da4 service nova] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:49:07.517998 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b5411e-1857-4bbc-a9b8-edfaa4853da4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:49:07.519794 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-54b5411e-1857-4bbc-a9b8-edfaa4853da4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:49:07.613784 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b5411e-1857-4bbc-a9b8-edfaa4853da4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:49:07.615739 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b5411e-1857-4bbc-a9b8-edfaa4853da4 service nova] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:49:07.634213 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 707/1391] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Oct 9 00:49:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 09 00:49:09.354842 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c16bcb-d4fc-45c6-8c1e-3c413cd169ac None None] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:49:09.355397 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c16bcb-d4fc-45c6-8c1e-3c413cd169ac None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:49:09.355397 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c16bcb-d4fc-45c6-8c1e-3c413cd169ac None None] PATH_INFO: `/` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:49:09.356700 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 685/1392] 10.222.0.15 () {54 vars in 927 bytes} [Sun Oct 9 00:49:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:49:09.362134 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522178e8-26a6-411d-90b7-85f2e801d667 None None] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:49:09.362575 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522178e8-26a6-411d-90b7-85f2e801d667 None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:49:09.362670 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522178e8-26a6-411d-90b7-85f2e801d667 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:49:09.434888 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.auth.core [None req-522178e8-26a6-411d-90b7-85f2e801d667 None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:49:09.439420 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-522178e8-26a6-411d-90b7-85f2e801d667 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:49:09.508047 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:49:09.548236 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 708/1393] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Oct 9 00:49:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:49:09.809411 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e379dfa3-ee74-4904-940e-ad70a75c1069 None None] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:49:09.809657 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e379dfa3-ee74-4904-940e-ad70a75c1069 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:49:09.809914 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e379dfa3-ee74-4904-940e-ad70a75c1069 None None] PATH_INFO: `/` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:49:09.811470 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 686/1394] 10.222.0.15 () {54 vars in 927 bytes} [Sun Oct 9 00:49:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:49:09.817476 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237ad018-c07c-4b72-ab14-fb8f58eabef9 None None] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:49:09.817476 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237ad018-c07c-4b72-ab14-fb8f58eabef9 None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:49:09.817476 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237ad018-c07c-4b72-ab14-fb8f58eabef9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:49:09.844203 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c4682c-e50b-4cc3-a5fd-b1a6a719f442 None None] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:49:09.844490 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c4682c-e50b-4cc3-a5fd-b1a6a719f442 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:49:09.844782 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c4682c-e50b-4cc3-a5fd-b1a6a719f442 None None] PATH_INFO: `/` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:49:09.846273 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 687/1395] 10.222.0.15 () {54 vars in 962 bytes} [Sun Oct 9 00:49:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 09 00:49:09.851934 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57094d96-9298-4af8-9e8d-035216eea13f None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:49:09.852220 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57094d96-9298-4af8-9e8d-035216eea13f None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:49:09.852493 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57094d96-9298-4af8-9e8d-035216eea13f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:49:09.868949 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:49:09.885821 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.auth.core [None req-237ad018-c07c-4b72-ab14-fb8f58eabef9 None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:49:09.887064 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-237ad018-c07c-4b72-ab14-fb8f58eabef9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:49:09.935178 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-57094d96-9298-4af8-9e8d-035216eea13f None None] MFA Rules not processed for user `d88a9f3d154c4cf98369972a0561b2b5`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:49:09.936460 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-57094d96-9298-4af8-9e8d-035216eea13f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:49:09.985998 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 709/1396] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Oct 9 00:49:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:49:10.013782 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 688/1397] 10.222.0.15 () {58 vars in 1059 bytes} [Sun Oct 9 00:49:09 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:49:10.023183 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237ad018-c07c-4b72-ab14-fb8f58eabef9 None None] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:49:10.024533 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-237ad018-c07c-4b72-ab14-fb8f58eabef9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:49:10.074484 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:49:10.120584 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237ad018-c07c-4b72-ab14-fb8f58eabef9 None None] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:49:10.197513 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a067698-eef3-4c6f-87ea-7de81bbad4b4 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd88a9f3d154c4cf98369972a0561b2b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f148d39ced534860abfbe8fc3f98ace4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:49:10.198133 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a067698-eef3-4c6f-87ea-7de81bbad4b4 service glance] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:49:10.198381 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a067698-eef3-4c6f-87ea-7de81bbad4b4 service glance] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:49:10.198664 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a067698-eef3-4c6f-87ea-7de81bbad4b4 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:49:10.200304 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-6a067698-eef3-4c6f-87ea-7de81bbad4b4 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:49:10.280291 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57094d96-9298-4af8-9e8d-035216eea13f None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:49:10.281657 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-57094d96-9298-4af8-9e8d-035216eea13f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:49:10.317028 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a067698-eef3-4c6f-87ea-7de81bbad4b4 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:49:10.318487 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a067698-eef3-4c6f-87ea-7de81bbad4b4 service glance] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:49:10.322782 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:49:10.339864 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 710/1398] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Oct 9 00:49:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 09 00:49:10.391803 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:49:10.405883 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57094d96-9298-4af8-9e8d-035216eea13f None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:49:10.525890 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af12d712-3be0-4002-86cf-fcaaf7c49137 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ac83d57fba841e0a666710732249c49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f148d39ced534860abfbe8fc3f98ace4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:49:10.526679 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af12d712-3be0-4002-86cf-fcaaf7c49137 service nova] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:49:10.526951 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af12d712-3be0-4002-86cf-fcaaf7c49137 service nova] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:49:10.527319 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af12d712-3be0-4002-86cf-fcaaf7c49137 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:49:10.529121 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-af12d712-3be0-4002-86cf-fcaaf7c49137 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:49:10.635098 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af12d712-3be0-4002-86cf-fcaaf7c49137 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:49:10.636639 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af12d712-3be0-4002-86cf-fcaaf7c49137 service nova] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:49:10.646871 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:49:10.658692 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 689/1399] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Oct 9 00:49:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 09 00:49:11.097146 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49137456-8ead-4b36-818d-0b4ac706ee10 None None] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:49:11.097636 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49137456-8ead-4b36-818d-0b4ac706ee10 None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:49:11.097747 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49137456-8ead-4b36-818d-0b4ac706ee10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:49:11.171994 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.auth.core [None req-49137456-8ead-4b36-818d-0b4ac706ee10 None None] MFA Rules not processed for user `3a6cfef106c84f759ce0874be77f7380`. Rule list: `[]` (Enabled: `True`). {{(pid=81525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:49:11.173212 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-49137456-8ead-4b36-818d-0b4ac706ee10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:49:11.261354 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 711/1400] 10.222.0.15 () {58 vars in 1009 bytes} [Sun Oct 9 00:49:11 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:49:11.307646 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992fbc06-b2f7-4d95-bd9b-359949d2bb7c None None] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:49:11.307928 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992fbc06-b2f7-4d95-bd9b-359949d2bb7c None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:49:11.308229 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992fbc06-b2f7-4d95-bd9b-359949d2bb7c None None] PATH_INFO: `/` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:49:11.309640 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 690/1401] 10.222.0.15 () {54 vars in 943 bytes} [Sun Oct 9 00:49:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:49:11.316020 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc43dfc-3b31-4598-9873-ceea5ddc666b None None] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:49:11.316379 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc43dfc-3b31-4598-9873-ceea5ddc666b None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:49:11.316713 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc43dfc-3b31-4598-9873-ceea5ddc666b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:49:11.404825 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.auth.core [None req-bdc43dfc-3b31-4598-9873-ceea5ddc666b None None] MFA Rules not processed for user `c4c467943b8f4d31a2f067ca6ed3b25c`. Rule list: `[]` (Enabled: `True`). {{(pid=81525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:49:11.406059 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-bdc43dfc-3b31-4598-9873-ceea5ddc666b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:49:11.431428 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:49:11.539969 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 712/1402] 10.222.0.15 () {58 vars in 1040 bytes} [Sun Oct 9 00:49:11 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:49:11.549241 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992fbc06-b2f7-4d95-bd9b-359949d2bb7c None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:49:11.550803 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-992fbc06-b2f7-4d95-bd9b-359949d2bb7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:49:11.693343 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992fbc06-b2f7-4d95-bd9b-359949d2bb7c None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:49:11.779984 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:49:11.803690 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4e71ad-63ed-4bd1-b7a2-347ad39ead48 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4c467943b8f4d31a2f067ca6ed3b25c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f148d39ced534860abfbe8fc3f98ace4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:49:11.804440 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4e71ad-63ed-4bd1-b7a2-347ad39ead48 service swift] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:49:11.804759 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4e71ad-63ed-4bd1-b7a2-347ad39ead48 service swift] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:49:11.805029 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4e71ad-63ed-4bd1-b7a2-347ad39ead48 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:49:11.806700 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-3f4e71ad-63ed-4bd1-b7a2-347ad39ead48 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:49:11.896987 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4e71ad-63ed-4bd1-b7a2-347ad39ead48 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:49:11.898687 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4e71ad-63ed-4bd1-b7a2-347ad39ead48 service swift] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:49:11.908209 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 691/1403] 10.222.0.15 () {60 vars in 1384 bytes} [Sun Oct 9 00:49:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 09 00:49:12.904655 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab83b5bf-7447-46f2-a110-dceedc0646b8 None None] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:49:12.905256 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab83b5bf-7447-46f2-a110-dceedc0646b8 None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:49:12.905256 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab83b5bf-7447-46f2-a110-dceedc0646b8 None None] PATH_INFO: `/` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:49:12.909391 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 713/1404] 10.222.0.15 () {54 vars in 927 bytes} [Sun Oct 9 00:49:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:49:12.912962 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bba6e6-3683-41d5-9aeb-1ee441c0426c None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:49:12.913460 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bba6e6-3683-41d5-9aeb-1ee441c0426c None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:49:12.913575 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bba6e6-3683-41d5-9aeb-1ee441c0426c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:49:13.002815 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-75bba6e6-3683-41d5-9aeb-1ee441c0426c None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:49:13.004370 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-75bba6e6-3683-41d5-9aeb-1ee441c0426c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:49:13.094728 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:49:13.135114 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 692/1405] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Oct 9 00:49:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:49:13.424059 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab83b5bf-7447-46f2-a110-dceedc0646b8 None None] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:49:13.425605 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-ab83b5bf-7447-46f2-a110-dceedc0646b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:49:13.593989 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:49:13.601491 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab83b5bf-7447-46f2-a110-dceedc0646b8 None None] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:49:13.779453 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d0c250-8ab4-4a40-aa61-0f5f99e697c2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ac83d57fba841e0a666710732249c49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f148d39ced534860abfbe8fc3f98ace4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:49:13.780124 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d0c250-8ab4-4a40-aa61-0f5f99e697c2 service nova] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:49:13.780500 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d0c250-8ab4-4a40-aa61-0f5f99e697c2 service nova] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:49:13.780853 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d0c250-8ab4-4a40-aa61-0f5f99e697c2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:49:13.783518 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-52d0c250-8ab4-4a40-aa61-0f5f99e697c2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:49:13.885043 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d0c250-8ab4-4a40-aa61-0f5f99e697c2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:49:13.886663 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d0c250-8ab4-4a40-aa61-0f5f99e697c2 service nova] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:49:13.901030 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:49:13.905385 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 714/1406] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Oct 9 00:49:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 482 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 09 00:49:16.092884 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076b7dc3-8009-4b7d-bf93-f278219be56c None None] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:49:16.093468 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076b7dc3-8009-4b7d-bf93-f278219be56c None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:49:16.093468 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076b7dc3-8009-4b7d-bf93-f278219be56c None None] PATH_INFO: `/` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:49:16.094941 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 693/1407] 10.222.0.15 () {54 vars in 927 bytes} [Sun Oct 9 00:49:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:49:16.100354 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12582be-55e1-4494-8416-a60fd9875aa2 None None] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:49:16.100938 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12582be-55e1-4494-8416-a60fd9875aa2 None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:49:16.101028 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12582be-55e1-4494-8416-a60fd9875aa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:49:16.188569 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.auth.core [None req-e12582be-55e1-4494-8416-a60fd9875aa2 None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:49:16.190133 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-e12582be-55e1-4494-8416-a60fd9875aa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:49:16.312534 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 715/1408] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Oct 9 00:49:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:49:16.600202 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076b7dc3-8009-4b7d-bf93-f278219be56c None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:49:16.602069 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-076b7dc3-8009-4b7d-bf93-f278219be56c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:49:16.776511 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076b7dc3-8009-4b7d-bf93-f278219be56c None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:49:16.830581 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:49:16.897610 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6003bd41-257b-4576-a9f4-92cb8bb6a1eb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ac83d57fba841e0a666710732249c49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f148d39ced534860abfbe8fc3f98ace4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:49:16.898229 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6003bd41-257b-4576-a9f4-92cb8bb6a1eb service nova] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:49:16.898507 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6003bd41-257b-4576-a9f4-92cb8bb6a1eb service nova] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:49:16.898844 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6003bd41-257b-4576-a9f4-92cb8bb6a1eb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:49:16.900491 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-6003bd41-257b-4576-a9f4-92cb8bb6a1eb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:49:16.996698 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6003bd41-257b-4576-a9f4-92cb8bb6a1eb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:49:16.998315 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6003bd41-257b-4576-a9f4-92cb8bb6a1eb service nova] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:49:17.019083 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 694/1409] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Oct 9 00:49:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 09 00:49:26.311310 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=66 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:49:27.016260 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=74 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:49:35.727009 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2516ef-0ceb-4a44-a031-a0275b08536b None None] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:49:35.727687 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2516ef-0ceb-4a44-a031-a0275b08536b None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:49:35.727687 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2516ef-0ceb-4a44-a031-a0275b08536b None None] PATH_INFO: `/` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:49:35.728960 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 716/1410] 10.222.0.15 () {54 vars in 918 bytes} [Sun Oct 9 00:49:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:49:35.734455 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e18572b-4530-4987-ba68-aaefbb5c7b34 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:49:35.734987 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e18572b-4530-4987-ba68-aaefbb5c7b34 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:49:35.734987 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e18572b-4530-4987-ba68-aaefbb5c7b34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:49:35.814144 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-5e18572b-4530-4987-ba68-aaefbb5c7b34 None None] MFA Rules not processed for user `64be9d44437e4247a72334b9bab3cdd3`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:49:35.815402 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-5e18572b-4530-4987-ba68-aaefbb5c7b34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:49:35.936926 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 695/1411] 10.222.0.15 () {58 vars in 1015 bytes} [Sun Oct 9 00:49:35 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:49:35.951852 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e189052a-954f-4e30-8ec6-a39e2b433e05 None None] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:49:35.952137 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e189052a-954f-4e30-8ec6-a39e2b433e05 None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:49:35.952412 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e189052a-954f-4e30-8ec6-a39e2b433e05 None None] PATH_INFO: `/` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:49:35.953768 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 717/1412] 10.222.0.15 () {54 vars in 918 bytes} [Sun Oct 9 00:49:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:49:35.959309 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d144f4-1a7c-454a-acbb-47ad4a04c0f6 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:49:35.959788 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d144f4-1a7c-454a-acbb-47ad4a04c0f6 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:49:35.960071 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d144f4-1a7c-454a-acbb-47ad4a04c0f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:49:36.044868 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:49:36.048184 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-10d144f4-1a7c-454a-acbb-47ad4a04c0f6 None None] MFA Rules not processed for user `4ac83d57fba841e0a666710732249c49`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:49:36.049963 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-10d144f4-1a7c-454a-acbb-47ad4a04c0f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:49:36.190995 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 696/1413] 10.222.0.15 () {58 vars in 1015 bytes} [Sun Oct 9 00:49:35 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:49:38.926848 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15be97b-5795-4fb3-af7f-7269ac9a51b7 None None] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:49:38.927550 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15be97b-5795-4fb3-af7f-7269ac9a51b7 None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:49:38.927550 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15be97b-5795-4fb3-af7f-7269ac9a51b7 None None] PATH_INFO: `/` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:49:38.928946 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 718/1414] 127.0.0.1 () {54 vars in 917 bytes} [Sun Oct 9 00:49:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:49:38.936342 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356df1f7-d6ef-467b-b371-99eebed02cdc None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:49:38.936886 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356df1f7-d6ef-467b-b371-99eebed02cdc None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:49:38.937009 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356df1f7-d6ef-467b-b371-99eebed02cdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:49:39.011974 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-356df1f7-d6ef-467b-b371-99eebed02cdc None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:49:39.013206 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-356df1f7-d6ef-467b-b371-99eebed02cdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:49:39.077721 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:49:39.127331 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 697/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Oct 9 00:49:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 09 00:49:39.429106 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15be97b-5795-4fb3-af7f-7269ac9a51b7 None None] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:49:39.430634 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-a15be97b-5795-4fb3-af7f-7269ac9a51b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:49:39.596343 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15be97b-5795-4fb3-af7f-7269ac9a51b7 None None] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:49:39.676048 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:49:39.721115 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2effddb9-1786-4c3f-a25c-ab2f59077c12 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ac83d57fba841e0a666710732249c49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f148d39ced534860abfbe8fc3f98ace4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:49:39.721736 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2effddb9-1786-4c3f-a25c-ab2f59077c12 service nova] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:49:39.722024 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2effddb9-1786-4c3f-a25c-ab2f59077c12 service nova] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:49:39.722368 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2effddb9-1786-4c3f-a25c-ab2f59077c12 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:49:39.723927 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-2effddb9-1786-4c3f-a25c-ab2f59077c12 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:49:39.819161 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2effddb9-1786-4c3f-a25c-ab2f59077c12 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:49:39.820854 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2effddb9-1786-4c3f-a25c-ab2f59077c12 service nova] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:49:39.840702 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 719/1416] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Oct 9 00:49:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 09 00:49:41.049734 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa19f977-d4a4-453e-95a2-2e633045e6aa None None] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:49:41.050315 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa19f977-d4a4-453e-95a2-2e633045e6aa None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:49:41.050512 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa19f977-d4a4-453e-95a2-2e633045e6aa None None] PATH_INFO: `/` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:49:41.052451 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 698/1417] 127.0.0.1 () {54 vars in 901 bytes} [Sun Oct 9 00:49:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:49:41.059773 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e4fd37-aa74-47d6-a94a-49e6d903a9d5 None None] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:49:41.060324 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e4fd37-aa74-47d6-a94a-49e6d903a9d5 None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:49:41.060324 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e4fd37-aa74-47d6-a94a-49e6d903a9d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:49:41.146785 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.auth.core [None req-a7e4fd37-aa74-47d6-a94a-49e6d903a9d5 None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:49:41.148031 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-a7e4fd37-aa74-47d6-a94a-49e6d903a9d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:49:41.185305 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:49:41.281786 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 720/1418] 127.0.0.1 () {58 vars in 998 bytes} [Sun Oct 9 00:49:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:49:41.449323 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa19f977-d4a4-453e-95a2-2e633045e6aa None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:49:41.451109 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-aa19f977-d4a4-453e-95a2-2e633045e6aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:49:41.625393 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa19f977-d4a4-453e-95a2-2e633045e6aa None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:49:41.669215 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:49:41.757181 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6c156a-9445-4026-9e52-d35fabd4caca service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ac83d57fba841e0a666710732249c49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f148d39ced534860abfbe8fc3f98ace4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:49:41.758385 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6c156a-9445-4026-9e52-d35fabd4caca service nova] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:49:41.758774 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6c156a-9445-4026-9e52-d35fabd4caca service nova] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:49:41.759430 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6c156a-9445-4026-9e52-d35fabd4caca service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:49:41.762857 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-bf6c156a-9445-4026-9e52-d35fabd4caca service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:49:41.871765 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6c156a-9445-4026-9e52-d35fabd4caca service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:49:41.873422 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6c156a-9445-4026-9e52-d35fabd4caca service nova] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:49:41.895866 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 699/1419] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Oct 9 00:49:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 447 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 09 00:49:43.185941 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7588c4fb-6260-4c0d-b0e3-af6b396d28f4 None None] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:49:43.186516 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7588c4fb-6260-4c0d-b0e3-af6b396d28f4 None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:49:43.186668 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7588c4fb-6260-4c0d-b0e3-af6b396d28f4 None None] PATH_INFO: `/` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:49:43.188324 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 721/1420] 127.0.0.1 () {54 vars in 901 bytes} [Sun Oct 9 00:49:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:49:43.195912 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43f6bda-fb35-43f1-b486-e82e2b4e9b05 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:49:43.196680 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43f6bda-fb35-43f1-b486-e82e2b4e9b05 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:49:43.196680 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43f6bda-fb35-43f1-b486-e82e2b4e9b05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:49:43.257063 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:49:43.282541 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-e43f6bda-fb35-43f1-b486-e82e2b4e9b05 None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:49:43.283811 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-e43f6bda-fb35-43f1-b486-e82e2b4e9b05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:49:43.399063 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 700/1421] 127.0.0.1 () {58 vars in 998 bytes} [Sun Oct 9 00:49:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:49:43.557499 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7588c4fb-6260-4c0d-b0e3-af6b396d28f4 None None] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:49:43.559704 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-7588c4fb-6260-4c0d-b0e3-af6b396d28f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:49:43.722072 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7588c4fb-6260-4c0d-b0e3-af6b396d28f4 None None] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:49:43.734275 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:49:43.853127 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63340491-0b5e-483a-88e3-609db957b150 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ac83d57fba841e0a666710732249c49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f148d39ced534860abfbe8fc3f98ace4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:49:43.853724 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63340491-0b5e-483a-88e3-609db957b150 service nova] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:49:43.853997 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63340491-0b5e-483a-88e3-609db957b150 service nova] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:49:43.854262 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63340491-0b5e-483a-88e3-609db957b150 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:49:43.855963 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-63340491-0b5e-483a-88e3-609db957b150 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:49:43.965140 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63340491-0b5e-483a-88e3-609db957b150 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:49:43.966860 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63340491-0b5e-483a-88e3-609db957b150 service nova] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:49:43.987795 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 722/1422] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Oct 9 00:49:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 09 00:49:45.203675 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccb0c51-68a3-40ab-94f9-8af4ae786529 None None] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:49:45.204335 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccb0c51-68a3-40ab-94f9-8af4ae786529 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:49:45.204335 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccb0c51-68a3-40ab-94f9-8af4ae786529 None None] PATH_INFO: `/` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:49:45.205798 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 701/1423] 127.0.0.1 () {54 vars in 901 bytes} [Sun Oct 9 00:49:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:49:45.212996 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dff328-c80f-4e25-b536-20a95e683c1f None None] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:49:45.213617 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dff328-c80f-4e25-b536-20a95e683c1f None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:49:45.213617 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dff328-c80f-4e25-b536-20a95e683c1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:49:45.234934 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:49:45.308536 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.auth.core [None req-68dff328-c80f-4e25-b536-20a95e683c1f None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:49:45.310061 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-68dff328-c80f-4e25-b536-20a95e683c1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:49:45.420805 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 723/1424] 127.0.0.1 () {58 vars in 998 bytes} [Sun Oct 9 00:49:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:49:45.572424 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccb0c51-68a3-40ab-94f9-8af4ae786529 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:49:45.573913 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-fccb0c51-68a3-40ab-94f9-8af4ae786529 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:49:45.705393 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:49:45.751125 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccb0c51-68a3-40ab-94f9-8af4ae786529 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:49:45.899221 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3626b9ee-ff6e-4a24-81e3-16a4aa45c489 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ac83d57fba841e0a666710732249c49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f148d39ced534860abfbe8fc3f98ace4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:49:45.899920 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3626b9ee-ff6e-4a24-81e3-16a4aa45c489 service nova] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:49:45.900184 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3626b9ee-ff6e-4a24-81e3-16a4aa45c489 service nova] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:49:45.900446 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3626b9ee-ff6e-4a24-81e3-16a4aa45c489 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:49:45.902053 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-3626b9ee-ff6e-4a24-81e3-16a4aa45c489 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:49:45.983834 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:49:46.000106 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3626b9ee-ff6e-4a24-81e3-16a4aa45c489 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:49:46.001731 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3626b9ee-ff6e-4a24-81e3-16a4aa45c489 service nova] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:49:46.022204 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 702/1425] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Oct 9 00:49:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 450 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 09 00:49:47.174010 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1b22bd-6e7a-4332-8656-5463413fdcb9 None None] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:49:47.174866 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1b22bd-6e7a-4332-8656-5463413fdcb9 None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:49:47.175117 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1b22bd-6e7a-4332-8656-5463413fdcb9 None None] PATH_INFO: `/` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:49:47.177594 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 724/1426] 127.0.0.1 () {54 vars in 901 bytes} [Sun Oct 9 00:49:47 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:49:47.189085 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51d133b-4b91-4267-bf8c-2aa600acf8ef None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:49:47.189758 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51d133b-4b91-4267-bf8c-2aa600acf8ef None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:49:47.189758 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51d133b-4b91-4267-bf8c-2aa600acf8ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:49:47.284619 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-d51d133b-4b91-4267-bf8c-2aa600acf8ef None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:49:47.285895 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-d51d133b-4b91-4267-bf8c-2aa600acf8ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:49:47.424947 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 703/1427] 127.0.0.1 () {58 vars in 998 bytes} [Sun Oct 9 00:49:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:49:47.580534 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1b22bd-6e7a-4332-8656-5463413fdcb9 None None] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:49:47.582175 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-4d1b22bd-6e7a-4332-8656-5463413fdcb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:49:47.802488 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:49:47.910704 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1b22bd-6e7a-4332-8656-5463413fdcb9 None None] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:49:48.087771 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406c45a0-6011-4839-aec4-699b89e55fd0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ac83d57fba841e0a666710732249c49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f148d39ced534860abfbe8fc3f98ace4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:49:48.088317 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406c45a0-6011-4839-aec4-699b89e55fd0 service nova] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:49:48.088586 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406c45a0-6011-4839-aec4-699b89e55fd0 service nova] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:49:48.088851 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406c45a0-6011-4839-aec4-699b89e55fd0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:49:48.091295 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-406c45a0-6011-4839-aec4-699b89e55fd0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:49:48.148806 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:49:48.199053 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406c45a0-6011-4839-aec4-699b89e55fd0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:49:48.201182 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406c45a0-6011-4839-aec4-699b89e55fd0 service nova] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:49:48.226224 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 725/1428] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Oct 9 00:49:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 646 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 09 00:49:49.344935 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05acb06a-db2f-4155-a8ec-b852aac3202c None None] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:49:49.345496 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05acb06a-db2f-4155-a8ec-b852aac3202c None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:49:49.345496 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05acb06a-db2f-4155-a8ec-b852aac3202c None None] PATH_INFO: `/` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:49:49.346872 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 704/1429] 127.0.0.1 () {54 vars in 901 bytes} [Sun Oct 9 00:49:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:49:49.354178 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f00b84-d30a-42bd-af8f-22da9a7e1c58 None None] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:49:49.354766 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f00b84-d30a-42bd-af8f-22da9a7e1c58 None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:49:49.354766 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f00b84-d30a-42bd-af8f-22da9a7e1c58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:49:49.445513 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.auth.core [None req-87f00b84-d30a-42bd-af8f-22da9a7e1c58 None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:49:49.447484 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-87f00b84-d30a-42bd-af8f-22da9a7e1c58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:49:49.568728 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 726/1430] 127.0.0.1 () {58 vars in 998 bytes} [Sun Oct 9 00:49:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:49:49.718481 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05acb06a-db2f-4155-a8ec-b852aac3202c None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:49:49.720059 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-05acb06a-db2f-4155-a8ec-b852aac3202c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:49:49.772667 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:49:49.879282 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05acb06a-db2f-4155-a8ec-b852aac3202c None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:49:49.996834 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4daed3d4-9078-40e7-92f7-33ee5c37f852 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ac83d57fba841e0a666710732249c49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f148d39ced534860abfbe8fc3f98ace4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:49:49.997347 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daed3d4-9078-40e7-92f7-33ee5c37f852 service nova] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:49:49.997622 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daed3d4-9078-40e7-92f7-33ee5c37f852 service nova] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:49:49.997894 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daed3d4-9078-40e7-92f7-33ee5c37f852 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:49:49.999516 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-4daed3d4-9078-40e7-92f7-33ee5c37f852 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:49:50.006703 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:49:50.092013 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4daed3d4-9078-40e7-92f7-33ee5c37f852 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:49:50.093631 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4daed3d4-9078-40e7-92f7-33ee5c37f852 service nova] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:49:50.112034 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 705/1431] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Oct 9 00:49:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 09 00:49:51.176369 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb70a65-d1f5-4bcf-8149-3b459b1e2048 None None] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:49:51.177199 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb70a65-d1f5-4bcf-8149-3b459b1e2048 None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:49:51.177199 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb70a65-d1f5-4bcf-8149-3b459b1e2048 None None] PATH_INFO: `/` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:49:51.179073 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 727/1432] 127.0.0.1 () {54 vars in 901 bytes} [Sun Oct 9 00:49:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:49:51.186052 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18479aac-e1f7-4906-95e6-5095de1ef096 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:49:51.186513 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18479aac-e1f7-4906-95e6-5095de1ef096 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:49:51.186606 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18479aac-e1f7-4906-95e6-5095de1ef096 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:49:51.268583 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-18479aac-e1f7-4906-95e6-5095de1ef096 None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:49:51.269818 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-18479aac-e1f7-4906-95e6-5095de1ef096 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:49:51.344562 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:49:51.377182 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 706/1433] 127.0.0.1 () {58 vars in 998 bytes} [Sun Oct 9 00:49:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:49:51.528414 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb70a65-d1f5-4bcf-8149-3b459b1e2048 None None] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:49:51.530182 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-dcb70a65-d1f5-4bcf-8149-3b459b1e2048 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:49:51.551942 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:49:51.689437 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb70a65-d1f5-4bcf-8149-3b459b1e2048 None None] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:49:51.781648 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:49:51.812341 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed87131-9643-44d7-8868-091e9feded84 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ac83d57fba841e0a666710732249c49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f148d39ced534860abfbe8fc3f98ace4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:49:51.812938 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed87131-9643-44d7-8868-091e9feded84 service nova] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:49:51.813217 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed87131-9643-44d7-8868-091e9feded84 service nova] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:49:51.813487 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed87131-9643-44d7-8868-091e9feded84 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:49:51.815156 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-5ed87131-9643-44d7-8868-091e9feded84 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:49:51.916124 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed87131-9643-44d7-8868-091e9feded84 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:49:51.917755 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed87131-9643-44d7-8868-091e9feded84 service nova] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:49:51.937936 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 728/1434] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Oct 9 00:49:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 09 00:49:53.001634 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91399123-c587-4de1-af8d-a9bc40c416cb None None] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:49:53.002258 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91399123-c587-4de1-af8d-a9bc40c416cb None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:49:53.002258 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91399123-c587-4de1-af8d-a9bc40c416cb None None] PATH_INFO: `/` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:49:53.003539 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 707/1435] 127.0.0.1 () {54 vars in 901 bytes} [Sun Oct 9 00:49:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:49:53.010718 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ec48df-7ee3-4812-8ef1-df815c5b5dd7 None None] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:49:53.011218 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ec48df-7ee3-4812-8ef1-df815c5b5dd7 None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:49:53.011218 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ec48df-7ee3-4812-8ef1-df815c5b5dd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:49:53.108685 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.auth.core [None req-97ec48df-7ee3-4812-8ef1-df815c5b5dd7 None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:49:53.109960 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-97ec48df-7ee3-4812-8ef1-df815c5b5dd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:49:53.159552 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:49:53.219398 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 729/1436] 127.0.0.1 () {58 vars in 998 bytes} [Sun Oct 9 00:49:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:49:53.372156 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91399123-c587-4de1-af8d-a9bc40c416cb None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:49:53.373603 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-91399123-c587-4de1-af8d-a9bc40c416cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:49:53.531037 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91399123-c587-4de1-af8d-a9bc40c416cb None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:49:53.587356 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:49:53.649599 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a0aae5-a093-47f0-b6bb-868e84e3b3fa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ac83d57fba841e0a666710732249c49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f148d39ced534860abfbe8fc3f98ace4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:49:53.650336 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a0aae5-a093-47f0-b6bb-868e84e3b3fa service nova] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:49:53.650636 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a0aae5-a093-47f0-b6bb-868e84e3b3fa service nova] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:49:53.650906 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a0aae5-a093-47f0-b6bb-868e84e3b3fa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:49:53.652589 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-40a0aae5-a093-47f0-b6bb-868e84e3b3fa service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:49:53.745309 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a0aae5-a093-47f0-b6bb-868e84e3b3fa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:49:53.746913 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a0aae5-a093-47f0-b6bb-868e84e3b3fa service nova] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:49:53.765754 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 708/1437] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Oct 9 00:49:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 09 00:49:54.818584 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7817a9-5acf-40d8-ac24-7333a7a4a1db None None] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:49:54.819132 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7817a9-5acf-40d8-ac24-7333a7a4a1db None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:49:54.819132 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7817a9-5acf-40d8-ac24-7333a7a4a1db None None] PATH_INFO: `/` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:49:54.820408 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 730/1438] 127.0.0.1 () {54 vars in 901 bytes} [Sun Oct 9 00:49:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:49:54.827519 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee72e3b-54f4-4315-b051-015e089dc010 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:49:54.828078 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee72e3b-54f4-4315-b051-015e089dc010 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:49:54.828078 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee72e3b-54f4-4315-b051-015e089dc010 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:49:54.907968 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-eee72e3b-54f4-4315-b051-015e089dc010 None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:49:54.909216 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-eee72e3b-54f4-4315-b051-015e089dc010 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:49:54.911316 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:49:55.011774 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 709/1439] 127.0.0.1 () {58 vars in 998 bytes} [Sun Oct 9 00:49:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:49:55.161423 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7817a9-5acf-40d8-ac24-7333a7a4a1db None None] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:49:55.163071 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-eb7817a9-5acf-40d8-ac24-7333a7a4a1db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:49:55.320227 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7817a9-5acf-40d8-ac24-7333a7a4a1db None None] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:49:55.347674 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:49:55.436582 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf844608-a9f8-47b4-8dbf-a622bf8946fd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ac83d57fba841e0a666710732249c49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f148d39ced534860abfbe8fc3f98ace4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:49:55.437118 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf844608-a9f8-47b4-8dbf-a622bf8946fd service nova] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:49:55.437373 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf844608-a9f8-47b4-8dbf-a622bf8946fd service nova] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:49:55.437632 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf844608-a9f8-47b4-8dbf-a622bf8946fd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:49:55.439330 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-cf844608-a9f8-47b4-8dbf-a622bf8946fd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:49:55.533697 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf844608-a9f8-47b4-8dbf-a622bf8946fd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:49:55.535333 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf844608-a9f8-47b4-8dbf-a622bf8946fd service nova] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:49:55.554006 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 731/1440] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Oct 9 00:49:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 09 00:49:57.627216 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3df238-6d1d-4343-88ca-db690a915018 None None] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:49:57.627853 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3df238-6d1d-4343-88ca-db690a915018 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:49:57.627853 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3df238-6d1d-4343-88ca-db690a915018 None None] PATH_INFO: `/` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:49:57.629130 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 710/1441] 127.0.0.1 () {54 vars in 917 bytes} [Sun Oct 9 00:49:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:49:57.634837 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09533d0-03d5-4e37-842a-0cc7ce34a1fe None None] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:49:57.635327 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09533d0-03d5-4e37-842a-0cc7ce34a1fe None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:49:57.635427 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09533d0-03d5-4e37-842a-0cc7ce34a1fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:49:57.677046 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:49:57.705353 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.auth.core [None req-b09533d0-03d5-4e37-842a-0cc7ce34a1fe None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:49:57.706479 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-b09533d0-03d5-4e37-842a-0cc7ce34a1fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:49:57.815519 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 732/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Oct 9 00:49:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:49:58.098938 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3df238-6d1d-4343-88ca-db690a915018 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:49:58.100569 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-2f3df238-6d1d-4343-88ca-db690a915018 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:49:58.337432 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3df238-6d1d-4343-88ca-db690a915018 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:49:58.370514 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:49:58.414923 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62721ef9-c78c-468c-ac42-7809807a913c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4ef90d456d2483e8ddafbe2d4d4fb5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f148d39ced534860abfbe8fc3f98ace4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:49:58.415561 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62721ef9-c78c-468c-ac42-7809807a913c service neutron] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:49:58.415901 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62721ef9-c78c-468c-ac42-7809807a913c service neutron] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:49:58.416165 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62721ef9-c78c-468c-ac42-7809807a913c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:49:58.417758 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-62721ef9-c78c-468c-ac42-7809807a913c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:49:58.532676 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62721ef9-c78c-468c-ac42-7809807a913c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:49:58.534119 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62721ef9-c78c-468c-ac42-7809807a913c service neutron] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:49:58.552366 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 711/1443] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Oct 9 00:49:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 454 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 09 00:50:00.867093 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf07a34-397e-43dc-94f1-e7c0aa649084 None None] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:50:00.867700 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf07a34-397e-43dc-94f1-e7c0aa649084 None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:50:00.867700 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf07a34-397e-43dc-94f1-e7c0aa649084 None None] PATH_INFO: `/` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:50:00.869445 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 733/1444] 127.0.0.1 () {54 vars in 917 bytes} [Sun Oct 9 00:50:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:50:00.875807 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe5d44d-aef0-482a-9c28-797a7736ab1e None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:50:00.876417 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe5d44d-aef0-482a-9c28-797a7736ab1e None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:50:00.876417 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe5d44d-aef0-482a-9c28-797a7736ab1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:50:00.949831 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-ffe5d44d-aef0-482a-9c28-797a7736ab1e None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:50:00.951077 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-ffe5d44d-aef0-482a-9c28-797a7736ab1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:50:00.964538 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:50:01.054309 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 712/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Oct 9 00:50:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:50:01.340659 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf07a34-397e-43dc-94f1-e7c0aa649084 None None] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:50:01.342212 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-cbf07a34-397e-43dc-94f1-e7c0aa649084 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:50:01.457308 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf07a34-397e-43dc-94f1-e7c0aa649084 None None] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:50:01.470718 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:50:01.535422 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb11537-d915-43ae-ad41-d6016e647c33 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4ef90d456d2483e8ddafbe2d4d4fb5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f148d39ced534860abfbe8fc3f98ace4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:50:01.536043 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb11537-d915-43ae-ad41-d6016e647c33 service neutron] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:50:01.536367 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb11537-d915-43ae-ad41-d6016e647c33 service neutron] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:50:01.536631 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb11537-d915-43ae-ad41-d6016e647c33 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:50:01.538233 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-1fb11537-d915-43ae-ad41-d6016e647c33 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:50:01.651901 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb11537-d915-43ae-ad41-d6016e647c33 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:50:01.653471 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb11537-d915-43ae-ad41-d6016e647c33 service neutron] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:50:01.671741 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 734/1446] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Oct 9 00:50:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 09 00:50:04.153210 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4634e5-106c-460b-b1f1-126d721f6786 None None] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:50:04.153825 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4634e5-106c-460b-b1f1-126d721f6786 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:50:04.153825 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4634e5-106c-460b-b1f1-126d721f6786 None None] PATH_INFO: `/` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:50:04.155418 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 713/1447] 127.0.0.1 () {54 vars in 917 bytes} [Sun Oct 9 00:50:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:50:04.161315 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5322308-679e-4409-a879-2681353f9931 None None] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:50:04.161817 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5322308-679e-4409-a879-2681353f9931 None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:50:04.161817 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5322308-679e-4409-a879-2681353f9931 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:50:04.213227 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:50:04.232438 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.auth.core [None req-e5322308-679e-4409-a879-2681353f9931 None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:50:04.233661 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-e5322308-679e-4409-a879-2681353f9931 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:50:04.335950 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 735/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Oct 9 00:50:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:50:04.615868 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4634e5-106c-460b-b1f1-126d721f6786 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:50:04.617468 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-ad4634e5-106c-460b-b1f1-126d721f6786 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:50:04.726213 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4634e5-106c-460b-b1f1-126d721f6786 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:50:04.768391 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:50:04.802786 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b7c9c8-1df7-4100-b2ae-01bc05353e13 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4ef90d456d2483e8ddafbe2d4d4fb5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f148d39ced534860abfbe8fc3f98ace4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:50:04.803423 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b7c9c8-1df7-4100-b2ae-01bc05353e13 service neutron] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:50:04.803692 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b7c9c8-1df7-4100-b2ae-01bc05353e13 service neutron] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:50:04.803954 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b7c9c8-1df7-4100-b2ae-01bc05353e13 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:50:04.805551 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-06b7c9c8-1df7-4100-b2ae-01bc05353e13 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:50:04.916185 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b7c9c8-1df7-4100-b2ae-01bc05353e13 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:50:04.917630 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b7c9c8-1df7-4100-b2ae-01bc05353e13 service neutron] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:50:04.935651 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 714/1449] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Oct 9 00:50:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 09 00:50:07.212932 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80894e2-d2e3-4e75-8193-8bfb8fd00abf None None] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:50:07.213549 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80894e2-d2e3-4e75-8193-8bfb8fd00abf None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:50:07.213549 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80894e2-d2e3-4e75-8193-8bfb8fd00abf None None] PATH_INFO: `/` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:50:07.214844 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 736/1450] 127.0.0.1 () {54 vars in 917 bytes} [Sun Oct 9 00:50:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:50:07.220492 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21852927-767d-4c8f-afdc-bb1ce7ef5270 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:50:07.220976 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21852927-767d-4c8f-afdc-bb1ce7ef5270 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:50:07.220976 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21852927-767d-4c8f-afdc-bb1ce7ef5270 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:50:07.291327 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-21852927-767d-4c8f-afdc-bb1ce7ef5270 None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:50:07.292408 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-21852927-767d-4c8f-afdc-bb1ce7ef5270 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:50:07.314582 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:50:07.394767 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 715/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Oct 9 00:50:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:50:07.675447 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80894e2-d2e3-4e75-8193-8bfb8fd00abf None None] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:50:07.676985 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-e80894e2-d2e3-4e75-8193-8bfb8fd00abf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:50:07.786165 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80894e2-d2e3-4e75-8193-8bfb8fd00abf None None] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:50:07.808190 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:50:07.867614 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf51c48-6567-4cf4-b287-13faa76d9d6a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4ef90d456d2483e8ddafbe2d4d4fb5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f148d39ced534860abfbe8fc3f98ace4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:50:07.868233 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf51c48-6567-4cf4-b287-13faa76d9d6a service neutron] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:50:07.868510 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf51c48-6567-4cf4-b287-13faa76d9d6a service neutron] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:50:07.868777 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf51c48-6567-4cf4-b287-13faa76d9d6a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:50:07.870865 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-2bf51c48-6567-4cf4-b287-13faa76d9d6a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:50:07.982028 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf51c48-6567-4cf4-b287-13faa76d9d6a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:50:07.983411 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf51c48-6567-4cf4-b287-13faa76d9d6a service neutron] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:50:08.002360 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 737/1452] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Oct 9 00:50:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 09 00:50:10.258479 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b79fa9-f164-47e8-b36c-18722cd92179 None None] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:50:10.259087 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b79fa9-f164-47e8-b36c-18722cd92179 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:50:10.259087 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b79fa9-f164-47e8-b36c-18722cd92179 None None] PATH_INFO: `/` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:50:10.260519 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 716/1453] 127.0.0.1 () {54 vars in 917 bytes} [Sun Oct 9 00:50:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:50:10.268362 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40690f2f-54bc-4026-9105-2cbc6256b811 None None] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:50:10.269070 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40690f2f-54bc-4026-9105-2cbc6256b811 None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:50:10.269210 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40690f2f-54bc-4026-9105-2cbc6256b811 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:50:10.344276 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:50:10.346961 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.auth.core [None req-40690f2f-54bc-4026-9105-2cbc6256b811 None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:50:10.348302 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-40690f2f-54bc-4026-9105-2cbc6256b811 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:50:10.461913 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 738/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Oct 9 00:50:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:50:10.740104 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b79fa9-f164-47e8-b36c-18722cd92179 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:50:10.741741 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-b3b79fa9-f164-47e8-b36c-18722cd92179 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:50:10.851615 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b79fa9-f164-47e8-b36c-18722cd92179 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:50:10.903091 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:50:10.929446 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe539a62-c9b1-46d4-826f-ede9db75ffd4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4ef90d456d2483e8ddafbe2d4d4fb5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f148d39ced534860abfbe8fc3f98ace4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:50:10.930024 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe539a62-c9b1-46d4-826f-ede9db75ffd4 service neutron] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:50:10.930296 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe539a62-c9b1-46d4-826f-ede9db75ffd4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:50:10.930575 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe539a62-c9b1-46d4-826f-ede9db75ffd4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:50:10.932317 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-fe539a62-c9b1-46d4-826f-ede9db75ffd4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:50:11.050360 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe539a62-c9b1-46d4-826f-ede9db75ffd4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:50:11.051757 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe539a62-c9b1-46d4-826f-ede9db75ffd4 service neutron] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:50:11.070975 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 717/1455] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Oct 9 00:50:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 09 00:50:13.411390 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83f50ac-57d0-4086-9129-74f8554ebca9 None None] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:50:13.411991 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83f50ac-57d0-4086-9129-74f8554ebca9 None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:50:13.411991 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83f50ac-57d0-4086-9129-74f8554ebca9 None None] PATH_INFO: `/` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:50:13.413311 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 739/1456] 127.0.0.1 () {54 vars in 917 bytes} [Sun Oct 9 00:50:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:50:13.419461 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5646ba-f461-433f-910b-98fa1e2cb82c None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:50:13.420033 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5646ba-f461-433f-910b-98fa1e2cb82c None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:50:13.420033 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5646ba-f461-433f-910b-98fa1e2cb82c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:50:13.495150 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-ce5646ba-f461-433f-910b-98fa1e2cb82c None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:50:13.496460 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-ce5646ba-f461-433f-910b-98fa1e2cb82c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:50:13.528947 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:50:13.603960 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 718/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Oct 9 00:50:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:50:13.885097 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83f50ac-57d0-4086-9129-74f8554ebca9 None None] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:50:13.886667 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-e83f50ac-57d0-4086-9129-74f8554ebca9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:50:14.000968 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83f50ac-57d0-4086-9129-74f8554ebca9 None None] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:50:14.031509 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:50:14.080641 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d766ae-927e-40a8-8b5a-0a26095f7336 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4ef90d456d2483e8ddafbe2d4d4fb5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f148d39ced534860abfbe8fc3f98ace4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:50:14.081461 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d766ae-927e-40a8-8b5a-0a26095f7336 service neutron] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:50:14.081830 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d766ae-927e-40a8-8b5a-0a26095f7336 service neutron] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:50:14.082195 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d766ae-927e-40a8-8b5a-0a26095f7336 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:50:14.084103 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-c2d766ae-927e-40a8-8b5a-0a26095f7336 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:50:14.211701 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d766ae-927e-40a8-8b5a-0a26095f7336 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:50:14.213285 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d766ae-927e-40a8-8b5a-0a26095f7336 service neutron] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:50:14.235062 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 740/1458] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Oct 9 00:50:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 09 00:50:16.610964 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ca3e71-a9c6-43ac-b5b7-ffbf9c704221 None None] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:50:16.611624 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ca3e71-a9c6-43ac-b5b7-ffbf9c704221 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:50:16.611624 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ca3e71-a9c6-43ac-b5b7-ffbf9c704221 None None] PATH_INFO: `/` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:50:16.612993 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 719/1459] 127.0.0.1 () {54 vars in 917 bytes} [Sun Oct 9 00:50:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:50:16.620219 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0147710-2df7-4f0d-9c55-fa7e036fb59e None None] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:50:16.620952 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0147710-2df7-4f0d-9c55-fa7e036fb59e None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:50:16.620952 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0147710-2df7-4f0d-9c55-fa7e036fb59e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:50:16.699622 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.auth.core [None req-b0147710-2df7-4f0d-9c55-fa7e036fb59e None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:50:16.700782 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-b0147710-2df7-4f0d-9c55-fa7e036fb59e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:50:16.710536 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:50:16.819085 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 741/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Oct 9 00:50:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:50:17.133268 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ca3e71-a9c6-43ac-b5b7-ffbf9c704221 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:50:17.135407 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-33ca3e71-a9c6-43ac-b5b7-ffbf9c704221 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:50:17.259383 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ca3e71-a9c6-43ac-b5b7-ffbf9c704221 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:50:17.330314 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:50:17.356048 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389e8149-0617-46ec-8f28-9760d8a85f23 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4ef90d456d2483e8ddafbe2d4d4fb5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f148d39ced534860abfbe8fc3f98ace4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:50:17.356688 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389e8149-0617-46ec-8f28-9760d8a85f23 service neutron] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:50:17.357017 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389e8149-0617-46ec-8f28-9760d8a85f23 service neutron] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:50:17.357308 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389e8149-0617-46ec-8f28-9760d8a85f23 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:50:17.359029 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-389e8149-0617-46ec-8f28-9760d8a85f23 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:50:17.502188 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389e8149-0617-46ec-8f28-9760d8a85f23 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:50:17.503717 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389e8149-0617-46ec-8f28-9760d8a85f23 service neutron] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:50:17.524118 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 720/1461] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Oct 9 00:50:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 09 00:50:19.859295 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e300aa-b482-4fd1-9fea-368fef43aadf None None] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:50:19.859821 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e300aa-b482-4fd1-9fea-368fef43aadf None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:50:19.859821 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e300aa-b482-4fd1-9fea-368fef43aadf None None] PATH_INFO: `/` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:50:19.861151 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 742/1462] 127.0.0.1 () {54 vars in 917 bytes} [Sun Oct 9 00:50:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 09 00:50:19.868070 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b6321e-16ff-4e73-b7d3-f46e1d809640 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:50:19.868859 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b6321e-16ff-4e73-b7d3-f46e1d809640 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:50:19.869050 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b6321e-16ff-4e73-b7d3-f46e1d809640 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:50:19.968149 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-15b6321e-16ff-4e73-b7d3-f46e1d809640 None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:50:19.969877 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-15b6321e-16ff-4e73-b7d3-f46e1d809640 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:50:20.026798 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:50:20.105593 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 721/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Oct 9 00:50:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:50:20.403322 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e300aa-b482-4fd1-9fea-368fef43aadf None None] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:50:20.404913 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-56e300aa-b482-4fd1-9fea-368fef43aadf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:50:20.533722 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e300aa-b482-4fd1-9fea-368fef43aadf None None] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:50:20.586032 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:50:20.640944 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e704db2e-cf82-4686-a674-c2627c382052 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4ef90d456d2483e8ddafbe2d4d4fb5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f148d39ced534860abfbe8fc3f98ace4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:50:20.641655 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e704db2e-cf82-4686-a674-c2627c382052 service neutron] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:50:20.642036 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e704db2e-cf82-4686-a674-c2627c382052 service neutron] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:50:20.642509 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e704db2e-cf82-4686-a674-c2627c382052 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:50:20.645083 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-e704db2e-cf82-4686-a674-c2627c382052 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:50:20.782227 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e704db2e-cf82-4686-a674-c2627c382052 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:50:20.783728 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e704db2e-cf82-4686-a674-c2627c382052 service neutron] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:50:20.803409 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 743/1464] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Oct 9 00:50:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 09 00:50:23.126200 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c17358e-630b-4bcc-bc7a-1a63dece5389 None None] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:50:23.126805 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c17358e-630b-4bcc-bc7a-1a63dece5389 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:50:23.126805 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c17358e-630b-4bcc-bc7a-1a63dece5389 None None] PATH_INFO: `/` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:50:23.128238 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 722/1465] 127.0.0.1 () {54 vars in 917 bytes} [Sun Oct 9 00:50:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:50:23.134413 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb79d02-9a93-49c7-8827-7a1d90015dcd None None] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:50:23.134990 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb79d02-9a93-49c7-8827-7a1d90015dcd None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:50:23.134990 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb79d02-9a93-49c7-8827-7a1d90015dcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:50:23.218525 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.auth.core [None req-edb79d02-9a93-49c7-8827-7a1d90015dcd None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:50:23.219878 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-edb79d02-9a93-49c7-8827-7a1d90015dcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:50:23.242260 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:50:23.338416 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 744/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Oct 9 00:50:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:50:23.624593 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c17358e-630b-4bcc-bc7a-1a63dece5389 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:50:23.626258 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-4c17358e-630b-4bcc-bc7a-1a63dece5389 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:50:23.741623 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c17358e-630b-4bcc-bc7a-1a63dece5389 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:50:23.819605 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:50:23.828520 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fead3869-0ea5-444d-ae1e-ed756d4d6197 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4ef90d456d2483e8ddafbe2d4d4fb5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f148d39ced534860abfbe8fc3f98ace4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:50:23.829130 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fead3869-0ea5-444d-ae1e-ed756d4d6197 service neutron] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:50:23.829396 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fead3869-0ea5-444d-ae1e-ed756d4d6197 service neutron] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:50:23.829661 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fead3869-0ea5-444d-ae1e-ed756d4d6197 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:50:23.831317 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-fead3869-0ea5-444d-ae1e-ed756d4d6197 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:50:23.957242 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fead3869-0ea5-444d-ae1e-ed756d4d6197 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:50:23.958681 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fead3869-0ea5-444d-ae1e-ed756d4d6197 service neutron] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:50:23.979812 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 723/1467] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Oct 9 00:50:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 09 00:50:26.154391 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10db914b-5170-418d-8535-101324fdf839 None None] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:50:26.154995 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10db914b-5170-418d-8535-101324fdf839 None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:50:26.154995 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10db914b-5170-418d-8535-101324fdf839 None None] PATH_INFO: `/` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:50:26.156310 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 745/1468] 127.0.0.1 () {54 vars in 917 bytes} [Sun Oct 9 00:50:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:50:26.162314 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927ad887-39fa-4aab-a180-3474eafa3311 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:50:26.162775 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927ad887-39fa-4aab-a180-3474eafa3311 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:50:26.162895 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927ad887-39fa-4aab-a180-3474eafa3311 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:50:26.231227 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-927ad887-39fa-4aab-a180-3474eafa3311 None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:50:26.232501 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-927ad887-39fa-4aab-a180-3474eafa3311 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:50:26.283045 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:50:26.335985 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 724/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Oct 9 00:50:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:50:26.617241 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10db914b-5170-418d-8535-101324fdf839 None None] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:50:26.618788 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-10db914b-5170-418d-8535-101324fdf839 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:50:26.726816 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10db914b-5170-418d-8535-101324fdf839 None None] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:50:26.779037 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:50:26.805746 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ae604b-86ee-4d45-9625-61203f0a97c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4ef90d456d2483e8ddafbe2d4d4fb5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f148d39ced534860abfbe8fc3f98ace4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:50:26.806360 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ae604b-86ee-4d45-9625-61203f0a97c4 service neutron] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:50:26.806634 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ae604b-86ee-4d45-9625-61203f0a97c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:50:26.806902 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ae604b-86ee-4d45-9625-61203f0a97c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:50:26.808632 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-60ae604b-86ee-4d45-9625-61203f0a97c4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:50:26.923761 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ae604b-86ee-4d45-9625-61203f0a97c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:50:26.925236 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ae604b-86ee-4d45-9625-61203f0a97c4 service neutron] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:50:26.943385 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 746/1470] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Oct 9 00:50:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 09 00:50:36.334184 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=22 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:50:36.941026 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=66 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:50:46.820099 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2423b4c-c609-4046-a326-d45db458a69a None None] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:50:46.820684 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2423b4c-c609-4046-a326-d45db458a69a None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:50:46.820684 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2423b4c-c609-4046-a326-d45db458a69a None None] PATH_INFO: `/` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:50:46.822128 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 725/1471] 10.222.0.15 () {54 vars in 927 bytes} [Sun Oct 9 00:50:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:50:46.828099 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5448eb74-bb10-4ac8-a204-f9ce01d073be None None] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:50:46.828616 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5448eb74-bb10-4ac8-a204-f9ce01d073be None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:50:46.828718 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5448eb74-bb10-4ac8-a204-f9ce01d073be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:50:46.898610 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.auth.core [None req-5448eb74-bb10-4ac8-a204-f9ce01d073be None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:50:46.899869 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-5448eb74-bb10-4ac8-a204-f9ce01d073be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:50:47.006546 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 747/1472] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Oct 9 00:50:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:50:47.298093 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55308a04-f86f-4c77-87b6-9c10248ab4ee None None] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:50:47.298376 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55308a04-f86f-4c77-87b6-9c10248ab4ee None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:50:47.298657 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55308a04-f86f-4c77-87b6-9c10248ab4ee None None] PATH_INFO: `/` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:50:47.300057 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 726/1473] 10.222.0.15 () {54 vars in 962 bytes} [Sun Oct 9 00:50:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:50:47.305237 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d7aafc-e490-432d-b142-680dd49e7e8c None None] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:50:47.305522 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d7aafc-e490-432d-b142-680dd49e7e8c None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:50:47.305789 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d7aafc-e490-432d-b142-680dd49e7e8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:50:47.387206 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.auth.core [None req-30d7aafc-e490-432d-b142-680dd49e7e8c None None] MFA Rules not processed for user `d88a9f3d154c4cf98369972a0561b2b5`. Rule list: `[]` (Enabled: `True`). {{(pid=81525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:50:47.388475 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-30d7aafc-e490-432d-b142-680dd49e7e8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:50:47.409824 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:50:47.470658 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 748/1474] 10.222.0.15 () {58 vars in 1059 bytes} [Sun Oct 9 00:50:47 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:50:47.478626 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55308a04-f86f-4c77-87b6-9c10248ab4ee None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:50:47.480210 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-55308a04-f86f-4c77-87b6-9c10248ab4ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:50:47.589058 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55308a04-f86f-4c77-87b6-9c10248ab4ee None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:50:47.669192 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f80478-1d93-41bb-bcff-0b9552ca367b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd88a9f3d154c4cf98369972a0561b2b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f148d39ced534860abfbe8fc3f98ace4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:50:47.669799 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f80478-1d93-41bb-bcff-0b9552ca367b service glance] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:50:47.670073 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f80478-1d93-41bb-bcff-0b9552ca367b service glance] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:50:47.670352 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f80478-1d93-41bb-bcff-0b9552ca367b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:50:47.672002 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-07f80478-1d93-41bb-bcff-0b9552ca367b service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:50:47.728875 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:50:47.784540 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f80478-1d93-41bb-bcff-0b9552ca367b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:50:47.785982 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f80478-1d93-41bb-bcff-0b9552ca367b service glance] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:50:47.804716 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 727/1475] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Oct 9 00:50:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 09 00:50:50.043095 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591104da-9f2c-42dc-8309-9eec63ba83e1 None None] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:50:50.043721 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591104da-9f2c-42dc-8309-9eec63ba83e1 None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:50:50.043721 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591104da-9f2c-42dc-8309-9eec63ba83e1 None None] PATH_INFO: `/` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:50:50.045053 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 749/1476] 10.222.0.15 () {54 vars in 927 bytes} [Sun Oct 9 00:50:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:50:50.050850 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0054413-c380-4a2e-818b-fb2b95f7c11e None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:50:50.051292 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0054413-c380-4a2e-818b-fb2b95f7c11e None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:50:50.051545 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0054413-c380-4a2e-818b-fb2b95f7c11e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:50:50.117831 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-f0054413-c380-4a2e-818b-fb2b95f7c11e None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:50:50.119076 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-f0054413-c380-4a2e-818b-fb2b95f7c11e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:50:50.221460 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 728/1477] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Oct 9 00:50:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:50:50.486888 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591104da-9f2c-42dc-8309-9eec63ba83e1 None None] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:50:50.488388 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-591104da-9f2c-42dc-8309-9eec63ba83e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:50:50.616214 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591104da-9f2c-42dc-8309-9eec63ba83e1 None None] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:50:50.668950 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:50:50.717369 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38191c53-060f-4424-a6b8-e5eda74d2f6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:50:50.717988 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38191c53-060f-4424-a6b8-e5eda74d2f6b admin admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:50:50.718260 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38191c53-060f-4424-a6b8-e5eda74d2f6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:50:50.718529 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38191c53-060f-4424-a6b8-e5eda74d2f6b admin admin] PATH_INFO: `/v3/projects` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:50:50.719172 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38191c53-060f-4424-a6b8-e5eda74d2f6b admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:50:50.720978 dv-cinder-master-3-smb devstack@keystone.service[81525]: WARNING py.warnings [None req-38191c53-060f-4424-a6b8-e5eda74d2f6b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 09 00:50:50.720978 dv-cinder-master-3-smb devstack@keystone.service[81525]: warnings.warn(msg) Oct 09 00:50:50.720978 dv-cinder-master-3-smb devstack@keystone.service[81525]: Oct 09 00:50:50.722115 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38191c53-060f-4424-a6b8-e5eda74d2f6b admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:50:50.742570 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 750/1478] 10.222.0.15 () {56 vars in 1108 bytes} [Sun Oct 9 00:50:50 2022] GET /identity/v3/projects => generated 2553 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 09 00:50:52.938731 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e840c54-ab1e-43c0-86f2-7fda5ba2f037 None None] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:50:52.939362 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e840c54-ab1e-43c0-86f2-7fda5ba2f037 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:50:52.939362 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e840c54-ab1e-43c0-86f2-7fda5ba2f037 None None] PATH_INFO: `/` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:50:52.940658 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 729/1479] 10.222.0.15 () {54 vars in 927 bytes} [Sun Oct 9 00:50:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:50:52.946348 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92997eb-1ed3-453a-9f2b-750fd2d0f0ac None None] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:50:52.946853 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92997eb-1ed3-453a-9f2b-750fd2d0f0ac None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:50:52.946853 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92997eb-1ed3-453a-9f2b-750fd2d0f0ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:50:53.018623 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.auth.core [None req-f92997eb-1ed3-453a-9f2b-750fd2d0f0ac None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:50:53.019915 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-f92997eb-1ed3-453a-9f2b-750fd2d0f0ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:50:53.134067 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 751/1480] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Oct 9 00:50:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:50:53.432326 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e840c54-ab1e-43c0-86f2-7fda5ba2f037 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:50:53.434426 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-4e840c54-ab1e-43c0-86f2-7fda5ba2f037 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:50:53.446121 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:50:53.607890 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e840c54-ab1e-43c0-86f2-7fda5ba2f037 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:50:53.691703 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:50:53.726246 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f18a18-3585-410e-bcb7-9c1b37919b91 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ac83d57fba841e0a666710732249c49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f148d39ced534860abfbe8fc3f98ace4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:50:53.726859 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f18a18-3585-410e-bcb7-9c1b37919b91 service nova] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:50:53.727133 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f18a18-3585-410e-bcb7-9c1b37919b91 service nova] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:50:53.727438 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f18a18-3585-410e-bcb7-9c1b37919b91 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:50:53.729035 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-d6f18a18-3585-410e-bcb7-9c1b37919b91 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:50:53.825843 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f18a18-3585-410e-bcb7-9c1b37919b91 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:50:53.827234 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f18a18-3585-410e-bcb7-9c1b37919b91 service nova] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:50:53.847036 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 730/1481] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Oct 9 00:50:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 09 00:50:56.182363 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d8a5f7-8a86-455a-9e7e-aeae89b12f8a None None] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:50:56.182922 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d8a5f7-8a86-455a-9e7e-aeae89b12f8a None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:50:56.182922 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d8a5f7-8a86-455a-9e7e-aeae89b12f8a None None] PATH_INFO: `/` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:50:56.184148 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 752/1482] 10.222.0.15 () {54 vars in 927 bytes} [Sun Oct 9 00:50:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:50:56.190288 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01822f87-dd47-4544-9232-3b2223c1fc00 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:50:56.190972 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01822f87-dd47-4544-9232-3b2223c1fc00 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:50:56.190972 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01822f87-dd47-4544-9232-3b2223c1fc00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:50:56.265658 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-01822f87-dd47-4544-9232-3b2223c1fc00 None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:50:56.266889 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-01822f87-dd47-4544-9232-3b2223c1fc00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:50:56.314063 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:50:56.364634 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 731/1483] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Oct 9 00:50:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:50:56.645790 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d8a5f7-8a86-455a-9e7e-aeae89b12f8a None None] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:50:56.647383 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-03d8a5f7-8a86-455a-9e7e-aeae89b12f8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:50:56.672621 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:50:56.754651 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d8a5f7-8a86-455a-9e7e-aeae89b12f8a None None] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:50:56.834970 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdce92d0-3591-4a47-99c3-e8db498799af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4ef90d456d2483e8ddafbe2d4d4fb5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f148d39ced534860abfbe8fc3f98ace4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:50:56.835646 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdce92d0-3591-4a47-99c3-e8db498799af service neutron] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:50:56.835920 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdce92d0-3591-4a47-99c3-e8db498799af service neutron] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:50:56.836189 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdce92d0-3591-4a47-99c3-e8db498799af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:50:56.837806 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-fdce92d0-3591-4a47-99c3-e8db498799af service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:50:56.914179 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:50:56.949189 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdce92d0-3591-4a47-99c3-e8db498799af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:50:56.950649 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdce92d0-3591-4a47-99c3-e8db498799af service neutron] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:50:56.969862 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 753/1484] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Oct 9 00:50:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 09 00:50:59.165555 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb87b9f3-dad5-4410-8ab9-c632d1d278df None None] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:50:59.166166 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb87b9f3-dad5-4410-8ab9-c632d1d278df None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:50:59.166166 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb87b9f3-dad5-4410-8ab9-c632d1d278df None None] PATH_INFO: `/` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:50:59.167570 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 732/1485] 10.222.0.15 () {54 vars in 927 bytes} [Sun Oct 9 00:50:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:50:59.173584 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d68d3b-5746-4f0e-ba7c-a927147127d5 None None] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:50:59.174071 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d68d3b-5746-4f0e-ba7c-a927147127d5 None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:50:59.174655 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d68d3b-5746-4f0e-ba7c-a927147127d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:50:59.244648 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.auth.core [None req-76d68d3b-5746-4f0e-ba7c-a927147127d5 None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:50:59.246192 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-76d68d3b-5746-4f0e-ba7c-a927147127d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:50:59.341942 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 754/1486] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Oct 9 00:50:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:50:59.630216 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb87b9f3-dad5-4410-8ab9-c632d1d278df None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:50:59.632027 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-bb87b9f3-dad5-4410-8ab9-c632d1d278df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:50:59.743974 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb87b9f3-dad5-4410-8ab9-c632d1d278df None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:50:59.829923 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:50:59.831650 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f6e0ca-aa95-430b-9884-5e479b8f9c46 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4ef90d456d2483e8ddafbe2d4d4fb5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f148d39ced534860abfbe8fc3f98ace4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:50:59.832277 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f6e0ca-aa95-430b-9884-5e479b8f9c46 service neutron] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:50:59.832604 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f6e0ca-aa95-430b-9884-5e479b8f9c46 service neutron] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:50:59.832985 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f6e0ca-aa95-430b-9884-5e479b8f9c46 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:50:59.835144 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-28f6e0ca-aa95-430b-9884-5e479b8f9c46 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:50:59.952474 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f6e0ca-aa95-430b-9884-5e479b8f9c46 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:50:59.953922 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f6e0ca-aa95-430b-9884-5e479b8f9c46 service neutron] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:50:59.973024 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 733/1487] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Oct 9 00:50:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 09 00:51:02.239383 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597e98ce-9a10-4ee7-b2c9-7f8659ef26f4 None None] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:51:02.240017 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597e98ce-9a10-4ee7-b2c9-7f8659ef26f4 None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:51:02.240017 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597e98ce-9a10-4ee7-b2c9-7f8659ef26f4 None None] PATH_INFO: `/` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:51:02.241382 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 755/1488] 10.222.0.15 () {54 vars in 927 bytes} [Sun Oct 9 00:51:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:51:02.247477 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a03c8d9-389d-47c8-9c9c-7fd9104acde4 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:51:02.247951 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a03c8d9-389d-47c8-9c9c-7fd9104acde4 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:51:02.247951 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a03c8d9-389d-47c8-9c9c-7fd9104acde4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:51:02.313213 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-9a03c8d9-389d-47c8-9c9c-7fd9104acde4 None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:51:02.314429 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-9a03c8d9-389d-47c8-9c9c-7fd9104acde4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:51:02.367092 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:51:02.413631 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 734/1489] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Oct 9 00:51:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:51:02.700201 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597e98ce-9a10-4ee7-b2c9-7f8659ef26f4 None None] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:51:02.701738 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-597e98ce-9a10-4ee7-b2c9-7f8659ef26f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:51:02.741589 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:51:02.813319 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597e98ce-9a10-4ee7-b2c9-7f8659ef26f4 None None] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:51:02.891731 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a99877d-7af2-404d-bd2f-315c2eeac066 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4ef90d456d2483e8ddafbe2d4d4fb5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f148d39ced534860abfbe8fc3f98ace4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:51:02.892347 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a99877d-7af2-404d-bd2f-315c2eeac066 service neutron] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:51:02.892623 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a99877d-7af2-404d-bd2f-315c2eeac066 service neutron] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:51:02.892876 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a99877d-7af2-404d-bd2f-315c2eeac066 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:51:02.894495 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-0a99877d-7af2-404d-bd2f-315c2eeac066 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:51:02.979630 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:51:03.013347 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a99877d-7af2-404d-bd2f-315c2eeac066 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:51:03.014817 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a99877d-7af2-404d-bd2f-315c2eeac066 service neutron] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:51:03.034624 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 756/1490] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Oct 9 00:51:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 09 00:51:05.467127 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526ceef3-bcb5-4da8-82b5-78b22e82497d None None] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:51:05.467713 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526ceef3-bcb5-4da8-82b5-78b22e82497d None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:51:05.467713 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526ceef3-bcb5-4da8-82b5-78b22e82497d None None] PATH_INFO: `/` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:51:05.469041 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 735/1491] 10.222.0.15 () {54 vars in 927 bytes} [Sun Oct 9 00:51:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:51:05.474470 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0464deac-a905-4818-9652-9b9f9c4dc207 None None] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:51:05.474913 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0464deac-a905-4818-9652-9b9f9c4dc207 None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:51:05.475013 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0464deac-a905-4818-9652-9b9f9c4dc207 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:51:05.547629 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.auth.core [None req-0464deac-a905-4818-9652-9b9f9c4dc207 None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:51:05.548859 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-0464deac-a905-4818-9652-9b9f9c4dc207 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:51:05.653036 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 757/1492] 10.222.0.15 () {58 vars in 1024 bytes} [Sun Oct 9 00:51:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:51:05.933697 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526ceef3-bcb5-4da8-82b5-78b22e82497d None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:51:05.935252 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-526ceef3-bcb5-4da8-82b5-78b22e82497d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:51:06.045800 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526ceef3-bcb5-4da8-82b5-78b22e82497d None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:51:06.124837 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c26ab0-2d83-42b4-8e4e-63b721411cd5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4ef90d456d2483e8ddafbe2d4d4fb5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f148d39ced534860abfbe8fc3f98ace4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:51:06.125353 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c26ab0-2d83-42b4-8e4e-63b721411cd5 service neutron] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:51:06.125630 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c26ab0-2d83-42b4-8e4e-63b721411cd5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:51:06.125897 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c26ab0-2d83-42b4-8e4e-63b721411cd5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:51:06.127563 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-41c26ab0-2d83-42b4-8e4e-63b721411cd5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:51:06.138349 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:51:06.258064 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c26ab0-2d83-42b4-8e4e-63b721411cd5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:51:06.259559 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c26ab0-2d83-42b4-8e4e-63b721411cd5 service neutron] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:51:06.279379 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 736/1493] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Oct 9 00:51:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 09 00:51:15.650928 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=82 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:51:16.276635 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=50 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:52:20.480078 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4d05c9-6926-40c3-b557-b45b1642caf8 None None] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:52:20.480814 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4d05c9-6926-40c3-b557-b45b1642caf8 None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:52:20.480814 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4d05c9-6926-40c3-b557-b45b1642caf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:52:20.575813 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.auth.core [None req-fc4d05c9-6926-40c3-b557-b45b1642caf8 None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:52:20.577061 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-fc4d05c9-6926-40c3-b557-b45b1642caf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:52:20.698124 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 758/1494] 10.222.0.15 () {58 vars in 958 bytes} [Sun Oct 9 00:52:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:52:20.706247 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ddc942-4c08-444d-9a67-ac7f37bb26ac None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:52:20.706755 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ddc942-4c08-444d-9a67-ac7f37bb26ac None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:52:20.706880 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ddc942-4c08-444d-9a67-ac7f37bb26ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:52:20.791129 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-b5ddc942-4c08-444d-9a67-ac7f37bb26ac None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:52:20.792397 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-b5ddc942-4c08-444d-9a67-ac7f37bb26ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:52:20.893369 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 737/1495] 10.222.0.15 () {58 vars in 958 bytes} [Sun Oct 9 00:52:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:52:20.898207 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4d05c9-6926-40c3-b557-b45b1642caf8 None None] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:52:20.899456 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-fc4d05c9-6926-40c3-b557-b45b1642caf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:52:20.910979 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4d05c9-6926-40c3-b557-b45b1642caf8 None None] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:52:20.978424 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:52:21.031856 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945b50ab-d04d-4768-b406-9b5a6bf2f2a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:52:21.032765 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945b50ab-d04d-4768-b406-9b5a6bf2f2a8 admin admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:52:21.033163 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945b50ab-d04d-4768-b406-9b5a6bf2f2a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:52:21.033547 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945b50ab-d04d-4768-b406-9b5a6bf2f2a8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:52:21.034656 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945b50ab-d04d-4768-b406-9b5a6bf2f2a8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:52:21.034972 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945b50ab-d04d-4768-b406-9b5a6bf2f2a8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:52:21.036516 dv-cinder-master-3-smb devstack@keystone.service[81525]: WARNING py.warnings [None req-945b50ab-d04d-4768-b406-9b5a6bf2f2a8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 09 00:52:21.036516 dv-cinder-master-3-smb devstack@keystone.service[81525]: warnings.warn(msg) Oct 09 00:52:21.036516 dv-cinder-master-3-smb devstack@keystone.service[81525]: Oct 09 00:52:21.037876 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945b50ab-d04d-4768-b406-9b5a6bf2f2a8 admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:52:21.055343 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 759/1496] 10.222.0.15 () {58 vars in 1153 bytes} [Sun Oct 9 00:52:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:52:21.067046 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ddc942-4c08-444d-9a67-ac7f37bb26ac None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:52:21.077162 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ddc942-4c08-444d-9a67-ac7f37bb26ac None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:52:21.147847 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:52:21.191315 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37da50d1-6923-41bb-98cf-585ea209b820 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:52:21.191933 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37da50d1-6923-41bb-98cf-585ea209b820 admin admin] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:52:21.192595 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37da50d1-6923-41bb-98cf-585ea209b820 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:52:21.192595 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37da50d1-6923-41bb-98cf-585ea209b820 admin admin] PATH_INFO: `/v3/projects` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:52:21.193083 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37da50d1-6923-41bb-98cf-585ea209b820 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:52:21.194858 dv-cinder-master-3-smb devstack@keystone.service[81524]: WARNING py.warnings [None req-37da50d1-6923-41bb-98cf-585ea209b820 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 09 00:52:21.194858 dv-cinder-master-3-smb devstack@keystone.service[81524]: warnings.warn(msg) Oct 09 00:52:21.194858 dv-cinder-master-3-smb devstack@keystone.service[81524]: Oct 09 00:52:21.196089 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37da50d1-6923-41bb-98cf-585ea209b820 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:52:21.265893 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 738/1497] 10.222.0.15 () {60 vars in 1153 bytes} [Sun Oct 9 00:52:21 2022] POST /identity/v3/projects => generated 379 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 09 00:52:21.274000 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945b50ab-d04d-4768-b406-9b5a6bf2f2a8 admin admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:52:21.276769 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-945b50ab-d04d-4768-b406-9b5a6bf2f2a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:52:21.320898 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945b50ab-d04d-4768-b406-9b5a6bf2f2a8 admin admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:52:21.423111 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9192e022-f090-47b7-8d32-659a9ff46e1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:52:21.423873 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9192e022-f090-47b7-8d32-659a9ff46e1f admin admin] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:52:21.424157 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9192e022-f090-47b7-8d32-659a9ff46e1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:52:21.424443 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9192e022-f090-47b7-8d32-659a9ff46e1f admin admin] PATH_INFO: `/v3/users` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:52:21.425057 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9192e022-f090-47b7-8d32-659a9ff46e1f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:52:21.426135 dv-cinder-master-3-smb devstack@keystone.service[81525]: WARNING py.warnings [None req-9192e022-f090-47b7-8d32-659a9ff46e1f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 09 00:52:21.426135 dv-cinder-master-3-smb devstack@keystone.service[81525]: warnings.warn(msg) Oct 09 00:52:21.426135 dv-cinder-master-3-smb devstack@keystone.service[81525]: Oct 09 00:52:21.427382 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9192e022-f090-47b7-8d32-659a9ff46e1f admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:52:21.476723 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 760/1498] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Oct 9 00:52:21 2022] POST /identity/v3/users => generated 290 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 09 00:52:21.481447 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37da50d1-6923-41bb-98cf-585ea209b820 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:52:21.483392 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-37da50d1-6923-41bb-98cf-585ea209b820 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:52:21.552518 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37da50d1-6923-41bb-98cf-585ea209b820 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:52:21.642378 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:52:21.655582 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373bcdf8-2cc2-4a2d-bbed-cca1d5fae59d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:52:21.656290 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373bcdf8-2cc2-4a2d-bbed-cca1d5fae59d admin admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:52:21.656645 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373bcdf8-2cc2-4a2d-bbed-cca1d5fae59d admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:52:21.656958 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373bcdf8-2cc2-4a2d-bbed-cca1d5fae59d admin admin] PATH_INFO: `/v3/roles` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:52:21.657734 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373bcdf8-2cc2-4a2d-bbed-cca1d5fae59d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:52:21.658828 dv-cinder-master-3-smb devstack@keystone.service[81524]: WARNING py.warnings [None req-373bcdf8-2cc2-4a2d-bbed-cca1d5fae59d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 09 00:52:21.658828 dv-cinder-master-3-smb devstack@keystone.service[81524]: warnings.warn(msg) Oct 09 00:52:21.658828 dv-cinder-master-3-smb devstack@keystone.service[81524]: Oct 09 00:52:21.659928 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373bcdf8-2cc2-4a2d-bbed-cca1d5fae59d admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:52:21.674087 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 739/1499] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Oct 9 00:52:21 2022] GET /identity/v3/roles => generated 1420 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 09 00:52:21.678730 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9192e022-f090-47b7-8d32-659a9ff46e1f admin admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:52:21.680430 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-9192e022-f090-47b7-8d32-659a9ff46e1f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:52:21.692567 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9192e022-f090-47b7-8d32-659a9ff46e1f admin admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:52:21.720629 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:52:21.803039 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9286351a-e09f-4868-ae3c-8aba0f7535bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:52:21.803594 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9286351a-e09f-4868-ae3c-8aba0f7535bd admin admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:52:21.803866 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9286351a-e09f-4868-ae3c-8aba0f7535bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:52:21.804128 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9286351a-e09f-4868-ae3c-8aba0f7535bd admin admin] PATH_INFO: `/v3/roles` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:52:21.804802 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9286351a-e09f-4868-ae3c-8aba0f7535bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:52:21.805893 dv-cinder-master-3-smb devstack@keystone.service[81525]: WARNING py.warnings [None req-9286351a-e09f-4868-ae3c-8aba0f7535bd admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 09 00:52:21.805893 dv-cinder-master-3-smb devstack@keystone.service[81525]: warnings.warn(msg) Oct 09 00:52:21.805893 dv-cinder-master-3-smb devstack@keystone.service[81525]: Oct 09 00:52:21.806820 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9286351a-e09f-4868-ae3c-8aba0f7535bd admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:52:21.820922 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 761/1500] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Oct 9 00:52:21 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 09 00:52:21.825424 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373bcdf8-2cc2-4a2d-bbed-cca1d5fae59d admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:52:21.827034 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-373bcdf8-2cc2-4a2d-bbed-cca1d5fae59d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:52:21.866012 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373bcdf8-2cc2-4a2d-bbed-cca1d5fae59d admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:52:21.980603 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940e1448-4f71-4301-8d9d-9674645f8697 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:52:21.981292 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940e1448-4f71-4301-8d9d-9674645f8697 admin admin] REQUEST_METHOD: `PUT` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:52:21.981567 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940e1448-4f71-4301-8d9d-9674645f8697 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:52:21.981849 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940e1448-4f71-4301-8d9d-9674645f8697 admin admin] PATH_INFO: `/v3/projects/42a0338edd7d4762b920233e057101bb/users/06d7520867d84f04bfaf1e9f15a954d6/roles/afb0a01183d9497795eaa4fa1a4046ae` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:52:22.010279 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940e1448-4f71-4301-8d9d-9674645f8697 admin admin] RBAC: Authorizing `identity:create_grant(project_id=42a0338edd7d4762b920233e057101bb, user_id=06d7520867d84f04bfaf1e9f15a954d6, role_id=afb0a01183d9497795eaa4fa1a4046ae)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:52:22.011484 dv-cinder-master-3-smb devstack@keystone.service[81524]: WARNING py.warnings [None req-940e1448-4f71-4301-8d9d-9674645f8697 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 09 00:52:22.011484 dv-cinder-master-3-smb devstack@keystone.service[81524]: warnings.warn(msg) Oct 09 00:52:22.011484 dv-cinder-master-3-smb devstack@keystone.service[81524]: Oct 09 00:52:22.013639 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940e1448-4f71-4301-8d9d-9674645f8697 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:52:22.044139 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 740/1501] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Oct 9 00:52:21 2022] PUT /identity/v3/projects/42a0338edd7d4762b920233e057101bb/users/06d7520867d84f04bfaf1e9f15a954d6/roles/afb0a01183d9497795eaa4fa1a4046ae => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 09 00:52:22.064892 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b258073-8527-4aee-84f1-0b9a17ef792a None None] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:52:22.065117 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b258073-8527-4aee-84f1-0b9a17ef792a None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:52:22.065331 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b258073-8527-4aee-84f1-0b9a17ef792a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:52:22.133744 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.auth.core [None req-4b258073-8527-4aee-84f1-0b9a17ef792a None None] MFA Rules not processed for user `06d7520867d84f04bfaf1e9f15a954d6`. Rule list: `[]` (Enabled: `True`). {{(pid=81525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:52:22.135040 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-4b258073-8527-4aee-84f1-0b9a17ef792a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:52:22.221338 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 762/1502] 10.222.0.15 () {58 vars in 958 bytes} [Sun Oct 9 00:52:22 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:52:22.246603 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba021dd-f6be-4796-9cbe-9045a48c210b None None] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:52:22.247025 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba021dd-f6be-4796-9cbe-9045a48c210b None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:52:22.247472 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba021dd-f6be-4796-9cbe-9045a48c210b None None] PATH_INFO: `/` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:52:22.249461 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 741/1503] 10.222.0.15 () {54 vars in 963 bytes} [Sun Oct 9 00:52:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:52:22.254818 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc204b22-d278-4ef7-a714-c1292530ba81 None None] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:52:22.255098 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc204b22-d278-4ef7-a714-c1292530ba81 None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:52:22.255413 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc204b22-d278-4ef7-a714-c1292530ba81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:52:22.290490 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:52:22.338921 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.auth.core [None req-bc204b22-d278-4ef7-a714-c1292530ba81 None None] MFA Rules not processed for user `ff7cb78bcd91467abe5c2e2b48aedd1b`. Rule list: `[]` (Enabled: `True`). {{(pid=81525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:52:22.340341 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-bc204b22-d278-4ef7-a714-c1292530ba81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:52:22.421555 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 763/1504] 10.222.0.15 () {58 vars in 1060 bytes} [Sun Oct 9 00:52:22 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:52:22.430361 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba021dd-f6be-4796-9cbe-9045a48c210b None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:52:22.432019 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-cba021dd-f6be-4796-9cbe-9045a48c210b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:52:22.491389 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:52:22.554038 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba021dd-f6be-4796-9cbe-9045a48c210b None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:52:22.639699 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614304d4-c038-4741-ae78-bab321e1ef6f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff7cb78bcd91467abe5c2e2b48aedd1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f148d39ced534860abfbe8fc3f98ace4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:52:22.640230 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614304d4-c038-4741-ae78-bab321e1ef6f service cinder] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:52:22.640508 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614304d4-c038-4741-ae78-bab321e1ef6f service cinder] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:52:22.640781 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614304d4-c038-4741-ae78-bab321e1ef6f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:52:22.642403 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-614304d4-c038-4741-ae78-bab321e1ef6f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:52:22.750309 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614304d4-c038-4741-ae78-bab321e1ef6f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:52:22.751803 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614304d4-c038-4741-ae78-bab321e1ef6f service cinder] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:52:22.755606 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:52:22.771819 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 742/1505] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Oct 9 00:52:22 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 09 00:52:22.822478 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e5c8d9-7632-46fe-9a08-9f5860ccefbf None None] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:52:22.823003 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e5c8d9-7632-46fe-9a08-9f5860ccefbf None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:52:22.823003 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e5c8d9-7632-46fe-9a08-9f5860ccefbf None None] PATH_INFO: `/` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:52:22.824355 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 764/1506] 10.222.0.15 () {52 vars in 830 bytes} [Sun Oct 9 00:52:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:52:22.829160 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614304d4-c038-4741-ae78-bab321e1ef6f service cinder] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:52:22.830668 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-614304d4-c038-4741-ae78-bab321e1ef6f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:52:22.942562 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614304d4-c038-4741-ae78-bab321e1ef6f service cinder] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:52:23.056814 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8309e1d1-d4e8-4f39-950e-58569b4c7129 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:52:23.057811 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8309e1d1-d4e8-4f39-950e-58569b4c7129 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:52:23.058269 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8309e1d1-d4e8-4f39-950e-58569b4c7129 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:52:23.058709 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8309e1d1-d4e8-4f39-950e-58569b4c7129 admin admin] PATH_INFO: `/v3/users/06d7520867d84f04bfaf1e9f15a954d6` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:52:23.081460 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8309e1d1-d4e8-4f39-950e-58569b4c7129 admin admin] RBAC: Authorizing `identity:delete_user(user_id=06d7520867d84f04bfaf1e9f15a954d6)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:52:23.083020 dv-cinder-master-3-smb devstack@keystone.service[81524]: WARNING py.warnings [None req-8309e1d1-d4e8-4f39-950e-58569b4c7129 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 09 00:52:23.083020 dv-cinder-master-3-smb devstack@keystone.service[81524]: warnings.warn(msg) Oct 09 00:52:23.083020 dv-cinder-master-3-smb devstack@keystone.service[81524]: Oct 09 00:52:23.085265 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8309e1d1-d4e8-4f39-950e-58569b4c7129 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:52:23.102324 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:52:23.184454 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-8309e1d1-d4e8-4f39-950e-58569b4c7129 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '06d7520867d84f04bfaf1e9f15a954d6'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:52:23.201533 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-8309e1d1-d4e8-4f39-950e-58569b4c7129 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '06d7520867d84f04bfaf1e9f15a954d6'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:52:23.201965 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-8309e1d1-d4e8-4f39-950e-58569b4c7129 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '06d7520867d84f04bfaf1e9f15a954d6'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:52:23.202547 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-8309e1d1-d4e8-4f39-950e-58569b4c7129 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '06d7520867d84f04bfaf1e9f15a954d6'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:52:23.214888 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-8309e1d1-d4e8-4f39-950e-58569b4c7129 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '06d7520867d84f04bfaf1e9f15a954d6'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:52:23.248757 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 743/1507] 10.222.0.15 () {58 vars in 1224 bytes} [Sun Oct 9 00:52:22 2022] DELETE /identity/v3/users/06d7520867d84f04bfaf1e9f15a954d6 => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 00:52:23.253816 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29d6e65-0baf-45b7-ab6b-5dadc0de5f61 None None] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:52:23.254075 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29d6e65-0baf-45b7-ab6b-5dadc0de5f61 None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:52:23.254350 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29d6e65-0baf-45b7-ab6b-5dadc0de5f61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:52:23.327779 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.auth.core [None req-b29d6e65-0baf-45b7-ab6b-5dadc0de5f61 None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:52:23.329764 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-b29d6e65-0baf-45b7-ab6b-5dadc0de5f61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:52:23.425226 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:52:23.445876 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 765/1508] 10.222.0.15 () {58 vars in 958 bytes} [Sun Oct 9 00:52:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:52:23.453538 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8309e1d1-d4e8-4f39-950e-58569b4c7129 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:52:23.454698 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-8309e1d1-d4e8-4f39-950e-58569b4c7129 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:52:23.597533 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8309e1d1-d4e8-4f39-950e-58569b4c7129 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:52:23.672527 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:52:23.697494 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79801934-858e-4bf0-8e76-c61b0799e3cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4ef90d456d2483e8ddafbe2d4d4fb5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f148d39ced534860abfbe8fc3f98ace4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:52:23.698219 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79801934-858e-4bf0-8e76-c61b0799e3cc service neutron] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:52:23.698501 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79801934-858e-4bf0-8e76-c61b0799e3cc service neutron] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:52:23.698772 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79801934-858e-4bf0-8e76-c61b0799e3cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:52:23.700625 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-79801934-858e-4bf0-8e76-c61b0799e3cc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:52:23.858088 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79801934-858e-4bf0-8e76-c61b0799e3cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:52:23.860650 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79801934-858e-4bf0-8e76-c61b0799e3cc service neutron] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:52:23.895868 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 744/1509] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Oct 9 00:52:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 443 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 09 00:52:24.290102 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29d6e65-0baf-45b7-ab6b-5dadc0de5f61 None None] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:52:24.292362 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-b29d6e65-0baf-45b7-ab6b-5dadc0de5f61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:52:24.313243 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29d6e65-0baf-45b7-ab6b-5dadc0de5f61 None None] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:52:24.435692 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3749c7-d9aa-4d95-960d-530a4c620442 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:52:24.436338 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3749c7-d9aa-4d95-960d-530a4c620442 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:52:24.436627 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3749c7-d9aa-4d95-960d-530a4c620442 admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:52:24.436884 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3749c7-d9aa-4d95-960d-530a4c620442 admin admin] PATH_INFO: `/v3/projects/42a0338edd7d4762b920233e057101bb` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:52:24.448114 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3749c7-d9aa-4d95-960d-530a4c620442 admin admin] RBAC: Authorizing `identity:delete_project(project_id=42a0338edd7d4762b920233e057101bb)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:52:24.449228 dv-cinder-master-3-smb devstack@keystone.service[81525]: WARNING py.warnings [None req-9d3749c7-d9aa-4d95-960d-530a4c620442 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 09 00:52:24.449228 dv-cinder-master-3-smb devstack@keystone.service[81525]: warnings.warn(msg) Oct 09 00:52:24.449228 dv-cinder-master-3-smb devstack@keystone.service[81525]: Oct 09 00:52:24.450437 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3749c7-d9aa-4d95-960d-530a4c620442 admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:52:24.517813 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-9d3749c7-d9aa-4d95-960d-530a4c620442 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '42a0338edd7d4762b920233e057101bb', 'request_id': 'req-9d3749c7-d9aa-4d95-960d-530a4c620442'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:52:24.530992 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-9d3749c7-d9aa-4d95-960d-530a4c620442 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '42a0338edd7d4762b920233e057101bb', 'request_id': 'req-9d3749c7-d9aa-4d95-960d-530a4c620442'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:52:24.547754 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-9d3749c7-d9aa-4d95-960d-530a4c620442 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '42a0338edd7d4762b920233e057101bb', 'request_id': 'req-9d3749c7-d9aa-4d95-960d-530a4c620442'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:52:24.589497 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-9d3749c7-d9aa-4d95-960d-530a4c620442 admin admin] The token cache is being invalidate because project 42a0338edd7d4762b920233e057101bb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81525) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 09 00:52:24.590008 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-9d3749c7-d9aa-4d95-960d-530a4c620442 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:52:24.590787 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-9d3749c7-d9aa-4d95-960d-530a4c620442 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:52:24.593360 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 766/1510] 10.222.0.15 () {58 vars in 1233 bytes} [Sun Oct 9 00:52:24 2022] DELETE /identity/v3/projects/42a0338edd7d4762b920233e057101bb => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 09 00:52:33.890839 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=62 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:52:34.585189 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:53:59.938373 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14918daf-6d7a-4e34-be3d-06d712636041 None None] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:53:59.939096 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14918daf-6d7a-4e34-be3d-06d712636041 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:53:59.939096 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14918daf-6d7a-4e34-be3d-06d712636041 None None] PATH_INFO: `/` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:53:59.940266 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 745/1511] 127.0.0.1 () {54 vars in 901 bytes} [Sun Oct 9 00:53:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:53:59.945491 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3122739-92ea-42d1-8921-1c3c30048851 None None] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:53:59.945972 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3122739-92ea-42d1-8921-1c3c30048851 None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:53:59.945972 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3122739-92ea-42d1-8921-1c3c30048851 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:54:00.029645 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.auth.core [None req-a3122739-92ea-42d1-8921-1c3c30048851 None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:54:00.030893 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-a3122739-92ea-42d1-8921-1c3c30048851 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:54:00.141467 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 767/1512] 127.0.0.1 () {58 vars in 998 bytes} [Sun Oct 9 00:53:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:54:00.292540 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14918daf-6d7a-4e34-be3d-06d712636041 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:54:00.294960 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-14918daf-6d7a-4e34-be3d-06d712636041 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:54:00.418539 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14918daf-6d7a-4e34-be3d-06d712636041 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:54:00.424308 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8cf2af-ac10-4bfc-84a8-42c50e8b3ae6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ac83d57fba841e0a666710732249c49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f148d39ced534860abfbe8fc3f98ace4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:54:00.424914 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8cf2af-ac10-4bfc-84a8-42c50e8b3ae6 service nova] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:54:00.425183 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8cf2af-ac10-4bfc-84a8-42c50e8b3ae6 service nova] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:54:00.425455 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8cf2af-ac10-4bfc-84a8-42c50e8b3ae6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:54:00.434215 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8cf2af-ac10-4bfc-84a8-42c50e8b3ae6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:54:00.435839 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8cf2af-ac10-4bfc-84a8-42c50e8b3ae6 service nova] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:54:00.446851 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 746/1513] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Oct 9 00:54:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 09 00:54:01.080296 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4b229c-31a7-461b-a999-80be04783b03 None None] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:54:01.080922 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4b229c-31a7-461b-a999-80be04783b03 None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:54:01.080922 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4b229c-31a7-461b-a999-80be04783b03 None None] PATH_INFO: `/v3` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:54:01.082161 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 768/1514] 10.222.0.48 () {54 vars in 925 bytes} [Sun Oct 9 00:54:01 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:54:01.089208 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5888216-fd82-4dbc-97e6-d3b48f3cc119 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:54:01.089668 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5888216-fd82-4dbc-97e6-d3b48f3cc119 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:54:01.089767 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5888216-fd82-4dbc-97e6-d3b48f3cc119 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:54:01.155423 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-b5888216-fd82-4dbc-97e6-d3b48f3cc119 None None] MFA Rules not processed for user `64be9d44437e4247a72334b9bab3cdd3`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:54:01.156673 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-b5888216-fd82-4dbc-97e6-d3b48f3cc119 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:54:01.228573 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:54:01.235769 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 747/1515] 10.222.0.48 () {58 vars in 1015 bytes} [Sun Oct 9 00:54:01 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:54:01.533394 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37603ad-98ed-4a3f-91a9-d6aa9d0bff66 None None] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:54:01.533699 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37603ad-98ed-4a3f-91a9-d6aa9d0bff66 None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:54:01.533995 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37603ad-98ed-4a3f-91a9-d6aa9d0bff66 None None] PATH_INFO: `/` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:54:01.535413 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 769/1516] 127.0.0.1 () {54 vars in 901 bytes} [Sun Oct 9 00:54:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:54:01.541890 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78de5160-6145-4547-84ea-0b3e158c599d None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:54:01.542133 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78de5160-6145-4547-84ea-0b3e158c599d None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:54:01.542411 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78de5160-6145-4547-84ea-0b3e158c599d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:54:01.562506 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-78de5160-6145-4547-84ea-0b3e158c599d None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:54:01.563750 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-78de5160-6145-4547-84ea-0b3e158c599d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:54:01.572185 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 748/1517] 127.0.0.1 () {58 vars in 998 bytes} [Sun Oct 9 00:54:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:54:01.724917 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37603ad-98ed-4a3f-91a9-d6aa9d0bff66 None None] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:54:01.740632 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37603ad-98ed-4a3f-91a9-d6aa9d0bff66 None None] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:54:01.746297 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967b2007-2dbc-446a-a8a2-eb384c317761 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ac83d57fba841e0a666710732249c49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f148d39ced534860abfbe8fc3f98ace4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:54:01.746878 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967b2007-2dbc-446a-a8a2-eb384c317761 service nova] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:54:01.747146 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967b2007-2dbc-446a-a8a2-eb384c317761 service nova] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:54:01.747436 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967b2007-2dbc-446a-a8a2-eb384c317761 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:54:01.756241 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967b2007-2dbc-446a-a8a2-eb384c317761 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:54:01.757937 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967b2007-2dbc-446a-a8a2-eb384c317761 service nova] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:54:01.767713 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 770/1518] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Oct 9 00:54:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 09 00:54:09.767743 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3612a4-93b1-4869-8e9e-6fb3288cfc31 None None] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:54:09.768284 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3612a4-93b1-4869-8e9e-6fb3288cfc31 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:54:09.768381 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3612a4-93b1-4869-8e9e-6fb3288cfc31 None None] PATH_INFO: `/` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:54:09.769737 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 749/1519] 10.222.0.15 () {54 vars in 961 bytes} [Sun Oct 9 00:54:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:54:09.775046 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1baf106-491e-4892-bdfb-e1b1a0c64971 None None] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:54:09.775490 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1baf106-491e-4892-bdfb-e1b1a0c64971 None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:54:09.775722 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1baf106-491e-4892-bdfb-e1b1a0c64971 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:54:09.797494 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.auth.core [None req-e1baf106-491e-4892-bdfb-e1b1a0c64971 None None] MFA Rules not processed for user `64be9d44437e4247a72334b9bab3cdd3`. Rule list: `[]` (Enabled: `True`). {{(pid=81525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:54:09.798763 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-e1baf106-491e-4892-bdfb-e1b1a0c64971 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:54:09.808407 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 771/1520] 10.222.0.15 () {58 vars in 1058 bytes} [Sun Oct 9 00:54:09 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:54:09.816285 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3612a4-93b1-4869-8e9e-6fb3288cfc31 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:54:09.830277 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3612a4-93b1-4869-8e9e-6fb3288cfc31 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:54:09.835402 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593b552d-0e70-41a0-8f4f-6cd81631a657 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64be9d44437e4247a72334b9bab3cdd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f148d39ced534860abfbe8fc3f98ace4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:54:09.836287 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593b552d-0e70-41a0-8f4f-6cd81631a657 service placement] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:54:09.836287 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593b552d-0e70-41a0-8f4f-6cd81631a657 service placement] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:54:09.836700 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593b552d-0e70-41a0-8f4f-6cd81631a657 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:54:09.845519 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593b552d-0e70-41a0-8f4f-6cd81631a657 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:54:09.847121 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593b552d-0e70-41a0-8f4f-6cd81631a657 service placement] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:54:09.857312 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 750/1521] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Oct 9 00:54:09 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 09 00:54:13.255090 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a15811-ec55-4f71-8294-ad772124cb12 None None] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:54:13.255790 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a15811-ec55-4f71-8294-ad772124cb12 None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:54:13.255790 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a15811-ec55-4f71-8294-ad772124cb12 None None] PATH_INFO: `/` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:54:13.257015 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 772/1522] 127.0.0.1 () {54 vars in 901 bytes} [Sun Oct 9 00:54:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:54:13.263735 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea954cb-620b-4226-b5ef-6953a0793c1c None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:54:13.264301 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea954cb-620b-4226-b5ef-6953a0793c1c None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:54:13.264301 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea954cb-620b-4226-b5ef-6953a0793c1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:54:13.286026 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-aea954cb-620b-4226-b5ef-6953a0793c1c None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:54:13.287220 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-aea954cb-620b-4226-b5ef-6953a0793c1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:54:13.296195 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 751/1523] 127.0.0.1 () {58 vars in 998 bytes} [Sun Oct 9 00:54:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:54:13.449700 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a15811-ec55-4f71-8294-ad772124cb12 None None] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:54:13.465190 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a15811-ec55-4f71-8294-ad772124cb12 None None] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:54:13.471012 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215886bb-49c7-474e-8be4-f128efcca44a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ac83d57fba841e0a666710732249c49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f148d39ced534860abfbe8fc3f98ace4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:54:13.471646 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215886bb-49c7-474e-8be4-f128efcca44a service nova] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:54:13.471930 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215886bb-49c7-474e-8be4-f128efcca44a service nova] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:54:13.472233 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215886bb-49c7-474e-8be4-f128efcca44a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:54:13.480700 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215886bb-49c7-474e-8be4-f128efcca44a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:54:13.482305 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215886bb-49c7-474e-8be4-f128efcca44a service nova] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:54:13.492080 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 773/1524] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Oct 9 00:54:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 09 00:54:14.561276 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2462e9-d6ec-4e0f-9cee-7d9939fdaf3b None None] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:54:14.561885 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2462e9-d6ec-4e0f-9cee-7d9939fdaf3b None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:54:14.561885 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2462e9-d6ec-4e0f-9cee-7d9939fdaf3b None None] PATH_INFO: `/` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:54:14.563170 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 752/1525] 127.0.0.1 () {54 vars in 901 bytes} [Sun Oct 9 00:54:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:54:14.569872 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577a05ab-070d-4935-8516-15b31ee71d1c None None] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:54:14.570385 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577a05ab-070d-4935-8516-15b31ee71d1c None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:54:14.570385 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577a05ab-070d-4935-8516-15b31ee71d1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:54:14.590251 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.auth.core [None req-577a05ab-070d-4935-8516-15b31ee71d1c None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:54:14.591502 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-577a05ab-070d-4935-8516-15b31ee71d1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:54:14.599977 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 774/1526] 127.0.0.1 () {58 vars in 998 bytes} [Sun Oct 9 00:54:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:54:14.750374 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2462e9-d6ec-4e0f-9cee-7d9939fdaf3b None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:54:14.766322 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2462e9-d6ec-4e0f-9cee-7d9939fdaf3b None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:54:14.772147 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4234224f-0a50-4931-8efd-6062d3d32895 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ac83d57fba841e0a666710732249c49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f148d39ced534860abfbe8fc3f98ace4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:54:14.772747 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4234224f-0a50-4931-8efd-6062d3d32895 service nova] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:54:14.773019 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4234224f-0a50-4931-8efd-6062d3d32895 service nova] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:54:14.773379 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4234224f-0a50-4931-8efd-6062d3d32895 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:54:14.781795 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4234224f-0a50-4931-8efd-6062d3d32895 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:54:14.783524 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4234224f-0a50-4931-8efd-6062d3d32895 service nova] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:54:14.792987 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 753/1527] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Oct 9 00:54:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 09 00:54:19.120677 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368d300e-6bb7-47ea-9a74-9cfdcbcaf6c9 None None] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:54:19.121364 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368d300e-6bb7-47ea-9a74-9cfdcbcaf6c9 None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:54:19.121364 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368d300e-6bb7-47ea-9a74-9cfdcbcaf6c9 None None] PATH_INFO: `/` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:54:19.123288 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 775/1528] 127.0.0.1 () {54 vars in 917 bytes} [Sun Oct 9 00:54:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:54:19.132013 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7809bd04-38c1-4b41-9779-5e2305d4c2af None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:54:19.132494 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7809bd04-38c1-4b41-9779-5e2305d4c2af None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:54:19.132610 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7809bd04-38c1-4b41-9779-5e2305d4c2af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:54:19.153674 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-7809bd04-38c1-4b41-9779-5e2305d4c2af None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:54:19.154904 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-7809bd04-38c1-4b41-9779-5e2305d4c2af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:54:19.163371 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 754/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Oct 9 00:54:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:54:19.456497 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368d300e-6bb7-47ea-9a74-9cfdcbcaf6c9 None None] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:54:19.458381 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-368d300e-6bb7-47ea-9a74-9cfdcbcaf6c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:54:19.491726 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:54:19.540877 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368d300e-6bb7-47ea-9a74-9cfdcbcaf6c9 None None] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:54:19.544825 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588312cd-b700-47af-b90c-244817a6d17c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4ef90d456d2483e8ddafbe2d4d4fb5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f148d39ced534860abfbe8fc3f98ace4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:54:19.545435 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588312cd-b700-47af-b90c-244817a6d17c service neutron] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:54:19.545706 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588312cd-b700-47af-b90c-244817a6d17c service neutron] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:54:19.545973 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588312cd-b700-47af-b90c-244817a6d17c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:54:19.559205 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588312cd-b700-47af-b90c-244817a6d17c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:54:19.561172 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588312cd-b700-47af-b90c-244817a6d17c service neutron] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:54:19.571949 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 776/1530] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Oct 9 00:54:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 09 00:54:21.718746 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537e07e0-0053-47f7-b3a4-867809cf3ffa None None] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:54:21.719316 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537e07e0-0053-47f7-b3a4-867809cf3ffa None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:54:21.719316 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537e07e0-0053-47f7-b3a4-867809cf3ffa None None] PATH_INFO: `/` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:54:21.720608 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 755/1531] 127.0.0.1 () {54 vars in 917 bytes} [Sun Oct 9 00:54:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:54:21.726249 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7db7de-679f-4298-99f2-04c2da95a226 None None] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:54:21.726742 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7db7de-679f-4298-99f2-04c2da95a226 None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:54:21.726742 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7db7de-679f-4298-99f2-04c2da95a226 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:54:21.746821 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.auth.core [None req-0b7db7de-679f-4298-99f2-04c2da95a226 None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:54:21.748059 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-0b7db7de-679f-4298-99f2-04c2da95a226 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:54:21.756848 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 777/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Oct 9 00:54:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 09 00:54:22.040549 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537e07e0-0053-47f7-b3a4-867809cf3ffa None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:54:22.053136 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537e07e0-0053-47f7-b3a4-867809cf3ffa None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:54:22.057506 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a20c405-168b-4d84-b8c3-9bcadf0c9cce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4ef90d456d2483e8ddafbe2d4d4fb5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f148d39ced534860abfbe8fc3f98ace4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:54:22.058117 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a20c405-168b-4d84-b8c3-9bcadf0c9cce service neutron] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:54:22.058428 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a20c405-168b-4d84-b8c3-9bcadf0c9cce service neutron] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:54:22.058698 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a20c405-168b-4d84-b8c3-9bcadf0c9cce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:54:22.068402 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a20c405-168b-4d84-b8c3-9bcadf0c9cce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:54:22.069837 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a20c405-168b-4d84-b8c3-9bcadf0c9cce service neutron] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:54:22.079600 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 756/1533] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Oct 9 00:54:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 09 00:54:25.902194 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd37cc23-7bbd-4887-b57f-ee1203246f1c None None] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:54:25.902657 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd37cc23-7bbd-4887-b57f-ee1203246f1c None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:54:25.902764 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd37cc23-7bbd-4887-b57f-ee1203246f1c None None] PATH_INFO: `/` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:54:25.904116 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 778/1534] 127.0.0.1 () {54 vars in 917 bytes} [Sun Oct 9 00:54:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:54:25.909826 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175c355b-5cb1-441c-84ea-c9e0b58341cc None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:54:25.910364 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175c355b-5cb1-441c-84ea-c9e0b58341cc None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:54:25.910364 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175c355b-5cb1-441c-84ea-c9e0b58341cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:54:25.930020 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-175c355b-5cb1-441c-84ea-c9e0b58341cc None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:54:25.931227 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-175c355b-5cb1-441c-84ea-c9e0b58341cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:54:25.939576 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 757/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Oct 9 00:54:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:54:26.235318 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd37cc23-7bbd-4887-b57f-ee1203246f1c None None] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:54:26.237222 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-bd37cc23-7bbd-4887-b57f-ee1203246f1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:54:26.325867 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd37cc23-7bbd-4887-b57f-ee1203246f1c None None] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:54:26.329980 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0748d696-b513-4416-b9ec-9d87b1d64ec2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff7cb78bcd91467abe5c2e2b48aedd1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f148d39ced534860abfbe8fc3f98ace4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:54:26.330615 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0748d696-b513-4416-b9ec-9d87b1d64ec2 service cinder] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:54:26.330886 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0748d696-b513-4416-b9ec-9d87b1d64ec2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:54:26.331153 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0748d696-b513-4416-b9ec-9d87b1d64ec2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:54:26.341688 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0748d696-b513-4416-b9ec-9d87b1d64ec2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:54:26.343157 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0748d696-b513-4416-b9ec-9d87b1d64ec2 service cinder] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:54:26.354177 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 779/1536] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Oct 9 00:54:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 09 00:54:28.522461 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0cff14-2650-4eba-a370-f36661c9a0e6 None None] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:54:28.523035 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0cff14-2650-4eba-a370-f36661c9a0e6 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:54:28.523035 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0cff14-2650-4eba-a370-f36661c9a0e6 None None] PATH_INFO: `/` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:54:28.524372 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 758/1537] 127.0.0.1 () {54 vars in 917 bytes} [Sun Oct 9 00:54:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:54:28.529969 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4198d812-5a8f-4778-9ffc-446713256a61 None None] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:54:28.530412 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4198d812-5a8f-4778-9ffc-446713256a61 None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:54:28.530597 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4198d812-5a8f-4778-9ffc-446713256a61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:54:28.556059 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.auth.core [None req-4198d812-5a8f-4778-9ffc-446713256a61 None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:54:28.557573 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-4198d812-5a8f-4778-9ffc-446713256a61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:54:28.567092 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 780/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Oct 9 00:54:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:54:28.865858 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0cff14-2650-4eba-a370-f36661c9a0e6 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:54:28.867946 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-de0cff14-2650-4eba-a370-f36661c9a0e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:54:28.882210 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0cff14-2650-4eba-a370-f36661c9a0e6 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:54:28.886160 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdd4565-0d6d-40e1-9f23-9132223b0396 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff7cb78bcd91467abe5c2e2b48aedd1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f148d39ced534860abfbe8fc3f98ace4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:54:28.886751 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdd4565-0d6d-40e1-9f23-9132223b0396 service cinder] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:54:28.887007 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdd4565-0d6d-40e1-9f23-9132223b0396 service cinder] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:54:28.887293 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdd4565-0d6d-40e1-9f23-9132223b0396 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:54:28.896509 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdd4565-0d6d-40e1-9f23-9132223b0396 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:54:28.897934 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdd4565-0d6d-40e1-9f23-9132223b0396 service cinder] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:54:28.908267 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 759/1539] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Oct 9 00:54:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 09 00:54:38.546095 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=63 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:54:38.904073 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=37 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:55:56.103734 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9806e804-e172-4dab-bb56-b5c52e24c89b None None] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:55:56.104385 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9806e804-e172-4dab-bb56-b5c52e24c89b None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:55:56.104385 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9806e804-e172-4dab-bb56-b5c52e24c89b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:55:56.140596 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.auth.core [None req-9806e804-e172-4dab-bb56-b5c52e24c89b None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:55:56.143005 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-9806e804-e172-4dab-bb56-b5c52e24c89b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:55:56.153675 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 781/1540] 10.222.0.15 () {58 vars in 958 bytes} [Sun Oct 9 00:55:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:55:56.162924 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97f6b4c-e1ab-4d28-95da-0bc24ff6425d None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:55:56.164039 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97f6b4c-e1ab-4d28-95da-0bc24ff6425d None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:55:56.164498 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97f6b4c-e1ab-4d28-95da-0bc24ff6425d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:55:56.191347 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-d97f6b4c-e1ab-4d28-95da-0bc24ff6425d None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:55:56.193433 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-d97f6b4c-e1ab-4d28-95da-0bc24ff6425d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:55:56.206850 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 760/1541] 10.222.0.15 () {58 vars in 958 bytes} [Sun Oct 9 00:55:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:55:56.220631 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9806e804-e172-4dab-bb56-b5c52e24c89b None None] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:55:56.236683 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9806e804-e172-4dab-bb56-b5c52e24c89b None None] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:55:56.244057 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f98187-0df0-422b-ad05-c6b7008b3d7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:55:56.245029 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f98187-0df0-422b-ad05-c6b7008b3d7d admin admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:55:56.245514 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f98187-0df0-422b-ad05-c6b7008b3d7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:55:56.245970 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f98187-0df0-422b-ad05-c6b7008b3d7d admin admin] PATH_INFO: `/v3/domains` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:55:56.246832 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f98187-0df0-422b-ad05-c6b7008b3d7d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:55:56.247367 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f98187-0df0-422b-ad05-c6b7008b3d7d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:55:56.249574 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f98187-0df0-422b-ad05-c6b7008b3d7d admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:55:56.267566 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 782/1542] 10.222.0.15 () {58 vars in 1153 bytes} [Sun Oct 9 00:55:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:55:56.276114 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97f6b4c-e1ab-4d28-95da-0bc24ff6425d None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:55:56.286336 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97f6b4c-e1ab-4d28-95da-0bc24ff6425d None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:55:56.295640 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7b7616-784c-4e25-a033-ea45d3c32509 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:55:56.296580 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7b7616-784c-4e25-a033-ea45d3c32509 admin admin] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:55:56.297066 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7b7616-784c-4e25-a033-ea45d3c32509 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:55:56.297527 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7b7616-784c-4e25-a033-ea45d3c32509 admin admin] PATH_INFO: `/v3/projects` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:55:56.298365 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7b7616-784c-4e25-a033-ea45d3c32509 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:55:56.300520 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7b7616-784c-4e25-a033-ea45d3c32509 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:55:56.358029 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 761/1543] 10.222.0.15 () {60 vars in 1153 bytes} [Sun Oct 9 00:55:56 2022] POST /identity/v3/projects => generated 383 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 09 00:55:56.364559 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f98187-0df0-422b-ad05-c6b7008b3d7d admin admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:55:56.378933 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f98187-0df0-422b-ad05-c6b7008b3d7d admin admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:55:56.486327 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026076ed-1443-4502-b628-348c8a3eaa70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:55:56.486953 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026076ed-1443-4502-b628-348c8a3eaa70 admin admin] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:55:56.487228 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026076ed-1443-4502-b628-348c8a3eaa70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:55:56.487522 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026076ed-1443-4502-b628-348c8a3eaa70 admin admin] PATH_INFO: `/v3/users` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:55:56.488846 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888f7e9c-2e89-4b16-9235-911846376f70 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:55:56.489080 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026076ed-1443-4502-b628-348c8a3eaa70 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:55:56.489566 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888f7e9c-2e89-4b16-9235-911846376f70 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:55:56.490057 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888f7e9c-2e89-4b16-9235-911846376f70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:55:56.491049 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026076ed-1443-4502-b628-348c8a3eaa70 admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:55:56.525271 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-888f7e9c-2e89-4b16-9235-911846376f70 None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:55:56.527064 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-888f7e9c-2e89-4b16-9235-911846376f70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:55:56.536865 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 783/1544] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Oct 9 00:55:56 2022] POST /identity/v3/users => generated 292 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 09 00:55:56.542985 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026076ed-1443-4502-b628-348c8a3eaa70 admin admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:55:56.546999 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 762/1545] 10.222.0.15 () {58 vars in 958 bytes} [Sun Oct 9 00:55:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:55:56.557064 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026076ed-1443-4502-b628-348c8a3eaa70 admin admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:55:56.558683 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179310f4-efdb-4ae1-915c-f10cc50dbabf None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:55:56.559203 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179310f4-efdb-4ae1-915c-f10cc50dbabf None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:55:56.559740 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179310f4-efdb-4ae1-915c-f10cc50dbabf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:55:56.567987 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079dda5a-b177-4c0d-bf35-da5e4ae202f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:55:56.568624 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079dda5a-b177-4c0d-bf35-da5e4ae202f8 admin admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:55:56.568899 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079dda5a-b177-4c0d-bf35-da5e4ae202f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:55:56.569167 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079dda5a-b177-4c0d-bf35-da5e4ae202f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:55:56.569854 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079dda5a-b177-4c0d-bf35-da5e4ae202f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:55:56.572447 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079dda5a-b177-4c0d-bf35-da5e4ae202f8 admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:55:56.587446 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 784/1546] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Oct 9 00:55:56 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 09 00:55:56.592268 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079dda5a-b177-4c0d-bf35-da5e4ae202f8 admin admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:55:56.594321 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-179310f4-efdb-4ae1-915c-f10cc50dbabf None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:55:56.595768 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-179310f4-efdb-4ae1-915c-f10cc50dbabf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:55:56.609965 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079dda5a-b177-4c0d-bf35-da5e4ae202f8 admin admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:55:56.612958 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 763/1547] 10.222.0.15 () {58 vars in 958 bytes} [Sun Oct 9 00:55:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:55:56.617602 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179310f4-efdb-4ae1-915c-f10cc50dbabf None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:55:56.623717 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353f0099-f57c-45d6-ac95-810c9e65c068 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:55:56.624782 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353f0099-f57c-45d6-ac95-810c9e65c068 admin admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:55:56.624955 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353f0099-f57c-45d6-ac95-810c9e65c068 admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:55:56.625326 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353f0099-f57c-45d6-ac95-810c9e65c068 admin admin] PATH_INFO: `/v3/roles` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:55:56.626131 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353f0099-f57c-45d6-ac95-810c9e65c068 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:55:56.631286 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353f0099-f57c-45d6-ac95-810c9e65c068 admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:55:56.633797 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179310f4-efdb-4ae1-915c-f10cc50dbabf None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:55:56.645727 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c23b4af-7970-41b5-a3ca-2bd3dd3cae2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:55:56.646804 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c23b4af-7970-41b5-a3ca-2bd3dd3cae2f admin admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:55:56.647293 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c23b4af-7970-41b5-a3ca-2bd3dd3cae2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:55:56.647688 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 785/1548] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Oct 9 00:55:56 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 09 00:55:56.648040 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c23b4af-7970-41b5-a3ca-2bd3dd3cae2f admin admin] PATH_INFO: `/v3/domains` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:55:56.648886 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c23b4af-7970-41b5-a3ca-2bd3dd3cae2f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:55:56.649362 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c23b4af-7970-41b5-a3ca-2bd3dd3cae2f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:55:56.650606 dv-cinder-master-3-smb devstack@keystone.service[81524]: WARNING py.warnings [None req-4c23b4af-7970-41b5-a3ca-2bd3dd3cae2f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 09 00:55:56.650606 dv-cinder-master-3-smb devstack@keystone.service[81524]: warnings.warn(msg) Oct 09 00:55:56.650606 dv-cinder-master-3-smb devstack@keystone.service[81524]: Oct 09 00:55:56.651887 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c23b4af-7970-41b5-a3ca-2bd3dd3cae2f admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:55:56.664571 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353f0099-f57c-45d6-ac95-810c9e65c068 admin admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:55:56.670280 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 764/1549] 10.222.0.15 () {58 vars in 1153 bytes} [Sun Oct 9 00:55:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 09 00:55:56.680631 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c23b4af-7970-41b5-a3ca-2bd3dd3cae2f admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:55:56.684584 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353f0099-f57c-45d6-ac95-810c9e65c068 admin admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:55:56.692171 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c23b4af-7970-41b5-a3ca-2bd3dd3cae2f admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:55:56.699296 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a0105b-bd60-442f-a48f-3d5cf56e01d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:55:56.699296 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a0105b-bd60-442f-a48f-3d5cf56e01d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:55:56.699296 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a0105b-bd60-442f-a48f-3d5cf56e01d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:55:56.699296 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a0105b-bd60-442f-a48f-3d5cf56e01d4 admin admin] PATH_INFO: `/v3/projects/a8c85369a53d49d1a96cf7ed0bba8e3a/users/6a2d7675a1fe4301b2920c86a35312dd/roles/afb0a01183d9497795eaa4fa1a4046ae` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:55:56.705805 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306ec783-a691-4b57-95e8-180fc61e8526 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:55:56.706711 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306ec783-a691-4b57-95e8-180fc61e8526 admin admin] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:55:56.707177 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306ec783-a691-4b57-95e8-180fc61e8526 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:55:56.707671 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306ec783-a691-4b57-95e8-180fc61e8526 admin admin] PATH_INFO: `/v3/projects` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:55:56.708527 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306ec783-a691-4b57-95e8-180fc61e8526 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:55:56.710714 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306ec783-a691-4b57-95e8-180fc61e8526 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:55:56.728221 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a0105b-bd60-442f-a48f-3d5cf56e01d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a8c85369a53d49d1a96cf7ed0bba8e3a, user_id=6a2d7675a1fe4301b2920c86a35312dd, role_id=afb0a01183d9497795eaa4fa1a4046ae)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:55:56.729398 dv-cinder-master-3-smb devstack@keystone.service[81525]: WARNING py.warnings [None req-e0a0105b-bd60-442f-a48f-3d5cf56e01d4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 09 00:55:56.729398 dv-cinder-master-3-smb devstack@keystone.service[81525]: warnings.warn(msg) Oct 09 00:55:56.729398 dv-cinder-master-3-smb devstack@keystone.service[81525]: Oct 09 00:55:56.731788 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a0105b-bd60-442f-a48f-3d5cf56e01d4 admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:55:56.758283 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 765/1550] 10.222.0.15 () {60 vars in 1153 bytes} [Sun Oct 9 00:55:56 2022] POST /identity/v3/projects => generated 379 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 09 00:55:56.763626 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306ec783-a691-4b57-95e8-180fc61e8526 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:55:56.765930 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 786/1551] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Oct 9 00:55:56 2022] PUT /identity/v3/projects/a8c85369a53d49d1a96cf7ed0bba8e3a/users/6a2d7675a1fe4301b2920c86a35312dd/roles/afb0a01183d9497795eaa4fa1a4046ae => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 00:55:56.784183 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f201c6d7-e82a-444c-bb00-442844783cd9 None None] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:55:56.784470 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f201c6d7-e82a-444c-bb00-442844783cd9 None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:55:56.784991 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f201c6d7-e82a-444c-bb00-442844783cd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:55:56.823368 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.auth.core [None req-f201c6d7-e82a-444c-bb00-442844783cd9 None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:55:56.824715 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-f201c6d7-e82a-444c-bb00-442844783cd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:55:56.866111 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306ec783-a691-4b57-95e8-180fc61e8526 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:55:56.881809 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5faae83c-f09c-40a5-bf8c-d6ba75639425 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:55:56.882875 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faae83c-f09c-40a5-bf8c-d6ba75639425 admin admin] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:55:56.883415 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faae83c-f09c-40a5-bf8c-d6ba75639425 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:55:56.883942 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faae83c-f09c-40a5-bf8c-d6ba75639425 admin admin] PATH_INFO: `/v3/users` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:55:56.884818 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5faae83c-f09c-40a5-bf8c-d6ba75639425 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:55:56.886074 dv-cinder-master-3-smb devstack@keystone.service[81524]: WARNING py.warnings [None req-5faae83c-f09c-40a5-bf8c-d6ba75639425 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 09 00:55:56.886074 dv-cinder-master-3-smb devstack@keystone.service[81524]: warnings.warn(msg) Oct 09 00:55:56.886074 dv-cinder-master-3-smb devstack@keystone.service[81524]: Oct 09 00:55:56.888642 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5faae83c-f09c-40a5-bf8c-d6ba75639425 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:55:56.923563 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 787/1552] 10.222.0.15 () {58 vars in 958 bytes} [Sun Oct 9 00:55:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 09 00:55:56.927012 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca7a102-33c6-4089-a1fb-352eab65ebc2 None None] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:55:56.929253 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca7a102-33c6-4089-a1fb-352eab65ebc2 None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:55:56.930203 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca7a102-33c6-4089-a1fb-352eab65ebc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:55:56.952382 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 766/1553] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Oct 9 00:55:56 2022] POST /identity/v3/users => generated 290 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 09 00:55:56.953784 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5faae83c-f09c-40a5-bf8c-d6ba75639425 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:55:56.984253 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.auth.core [None req-7ca7a102-33c6-4089-a1fb-352eab65ebc2 None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:55:56.988116 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-7ca7a102-33c6-4089-a1fb-352eab65ebc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:55:57.006324 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 788/1554] 10.222.0.15 () {58 vars in 958 bytes} [Sun Oct 9 00:55:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:55:57.012412 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca7a102-33c6-4089-a1fb-352eab65ebc2 None None] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:55:57.038155 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca7a102-33c6-4089-a1fb-352eab65ebc2 None None] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:55:57.051511 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4801d165-96c7-45d9-b5b7-d1d56263a3d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:55:57.060559 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4801d165-96c7-45d9-b5b7-d1d56263a3d1 admin admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:55:57.061728 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4801d165-96c7-45d9-b5b7-d1d56263a3d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:55:57.062508 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4801d165-96c7-45d9-b5b7-d1d56263a3d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:55:57.067221 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4801d165-96c7-45d9-b5b7-d1d56263a3d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:55:57.072149 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4801d165-96c7-45d9-b5b7-d1d56263a3d1 admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:55:57.103079 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 789/1555] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Oct 9 00:55:57 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 09 00:55:57.112390 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd54397a-f473-489c-bf8d-009d782053d9 None None] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:55:57.114137 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd54397a-f473-489c-bf8d-009d782053d9 None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:55:57.115841 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd54397a-f473-489c-bf8d-009d782053d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:55:57.148150 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5faae83c-f09c-40a5-bf8c-d6ba75639425 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:55:57.163046 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff7b10b-a280-43ff-97ec-baf84a7a17bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4ef90d456d2483e8ddafbe2d4d4fb5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f148d39ced534860abfbe8fc3f98ace4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:55:57.171434 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff7b10b-a280-43ff-97ec-baf84a7a17bf service neutron] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:55:57.172516 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff7b10b-a280-43ff-97ec-baf84a7a17bf service neutron] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:55:57.173251 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff7b10b-a280-43ff-97ec-baf84a7a17bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:55:57.175750 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:55:57.187093 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.auth.core [None req-bd54397a-f473-489c-bf8d-009d782053d9 None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:55:57.190229 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-bd54397a-f473-489c-bf8d-009d782053d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:55:57.208143 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 790/1556] 10.222.0.15 () {58 vars in 958 bytes} [Sun Oct 9 00:55:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:55:57.208452 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff7b10b-a280-43ff-97ec-baf84a7a17bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:55:57.209835 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff7b10b-a280-43ff-97ec-baf84a7a17bf service neutron] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:55:57.210347 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969b5fab-b1a0-4ef7-813e-5b1de068507b None None] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:55:57.210991 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969b5fab-b1a0-4ef7-813e-5b1de068507b None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:55:57.212227 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969b5fab-b1a0-4ef7-813e-5b1de068507b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:55:57.233771 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 767/1557] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Oct 9 00:55:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 09 00:55:57.234510 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff7b10b-a280-43ff-97ec-baf84a7a17bf service neutron] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:55:57.271960 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff7b10b-a280-43ff-97ec-baf84a7a17bf service neutron] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:55:57.287232 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.auth.core [None req-969b5fab-b1a0-4ef7-813e-5b1de068507b None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:55:57.294377 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-969b5fab-b1a0-4ef7-813e-5b1de068507b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:55:57.300013 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b127a286-a50a-483d-b85f-dd3db213a7ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:55:57.300650 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b127a286-a50a-483d-b85f-dd3db213a7ff admin admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:55:57.300927 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b127a286-a50a-483d-b85f-dd3db213a7ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:55:57.301185 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b127a286-a50a-483d-b85f-dd3db213a7ff admin admin] PATH_INFO: `/v3/roles` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:55:57.301826 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b127a286-a50a-483d-b85f-dd3db213a7ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:55:57.303455 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b127a286-a50a-483d-b85f-dd3db213a7ff admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:55:57.305308 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:55:57.339308 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 791/1558] 10.222.0.15 () {58 vars in 958 bytes} [Sun Oct 9 00:55:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:55:57.343349 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8c35bb-4855-4050-9e75-2b21544485a6 None None] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:55:57.343349 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8c35bb-4855-4050-9e75-2b21544485a6 None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:55:57.343349 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8c35bb-4855-4050-9e75-2b21544485a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:55:57.359209 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 768/1559] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Oct 9 00:55:57 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 09 00:55:57.371411 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bceb576-2c08-4b96-b08a-7226c750d3ce None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:55:57.371411 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bceb576-2c08-4b96-b08a-7226c750d3ce None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:55:57.371411 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bceb576-2c08-4b96-b08a-7226c750d3ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:55:57.421457 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.auth.core [None req-cd8c35bb-4855-4050-9e75-2b21544485a6 None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:55:57.424926 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-cd8c35bb-4855-4050-9e75-2b21544485a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:55:57.440195 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-6bceb576-2c08-4b96-b08a-7226c750d3ce None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:55:57.443753 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-6bceb576-2c08-4b96-b08a-7226c750d3ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:55:57.450891 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 792/1560] 10.222.0.15 () {58 vars in 958 bytes} [Sun Oct 9 00:55:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:55:57.453613 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df937c7-bb17-4426-89e8-c2543f115a09 None None] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:55:57.454136 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df937c7-bb17-4426-89e8-c2543f115a09 None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:55:57.455662 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df937c7-bb17-4426-89e8-c2543f115a09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:55:57.473056 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 769/1561] 10.222.0.15 () {58 vars in 958 bytes} [Sun Oct 9 00:55:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:55:57.474495 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bceb576-2c08-4b96-b08a-7226c750d3ce None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:55:57.491319 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bceb576-2c08-4b96-b08a-7226c750d3ce None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:55:57.498728 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.auth.core [None req-0df937c7-bb17-4426-89e8-c2543f115a09 None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:55:57.499760 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abdcedc-8a7a-4ec5-9e82-8203d1bbde3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:55:57.500451 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abdcedc-8a7a-4ec5-9e82-8203d1bbde3f admin admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:55:57.500980 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abdcedc-8a7a-4ec5-9e82-8203d1bbde3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:55:57.501306 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abdcedc-8a7a-4ec5-9e82-8203d1bbde3f admin admin] PATH_INFO: `/v3/domains` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:55:57.502224 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abdcedc-8a7a-4ec5-9e82-8203d1bbde3f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:55:57.502597 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abdcedc-8a7a-4ec5-9e82-8203d1bbde3f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:55:57.503218 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-0df937c7-bb17-4426-89e8-c2543f115a09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:55:57.504831 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abdcedc-8a7a-4ec5-9e82-8203d1bbde3f admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:55:57.518019 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 793/1562] 10.222.0.15 () {58 vars in 958 bytes} [Sun Oct 9 00:55:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:55:57.520157 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df937c7-bb17-4426-89e8-c2543f115a09 None None] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:55:57.532932 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 770/1563] 10.222.0.15 () {58 vars in 1153 bytes} [Sun Oct 9 00:55:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:55:57.540726 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ded414-f9a6-47a2-a0e5-58d69ad8a753 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:55:57.540726 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ded414-f9a6-47a2-a0e5-58d69ad8a753 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:55:57.540726 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ded414-f9a6-47a2-a0e5-58d69ad8a753 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:55:57.547895 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df937c7-bb17-4426-89e8-c2543f115a09 None None] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:55:57.565605 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d45034-2f4d-4855-9fee-2abc78a1cf3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:55:57.565605 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d45034-2f4d-4855-9fee-2abc78a1cf3f admin admin] REQUEST_METHOD: `PUT` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:55:57.565605 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d45034-2f4d-4855-9fee-2abc78a1cf3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:55:57.565605 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d45034-2f4d-4855-9fee-2abc78a1cf3f admin admin] PATH_INFO: `/v3/projects/2ac86a5c874c4a0b8da47d5144040d5d/users/08d6c41fef5c467e9826e5eabbbccc65/roles/afb0a01183d9497795eaa4fa1a4046ae` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:55:57.568766 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-b1ded414-f9a6-47a2-a0e5-58d69ad8a753 None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:55:57.569502 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-b1ded414-f9a6-47a2-a0e5-58d69ad8a753 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:55:57.581883 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 771/1564] 10.222.0.15 () {58 vars in 958 bytes} [Sun Oct 9 00:55:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:55:57.583530 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8af115a-78ad-40a2-abc9-03c6ddb68d3b None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:55:57.583698 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8af115a-78ad-40a2-abc9-03c6ddb68d3b None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:55:57.584020 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8af115a-78ad-40a2-abc9-03c6ddb68d3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:55:57.595883 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d45034-2f4d-4855-9fee-2abc78a1cf3f admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ac86a5c874c4a0b8da47d5144040d5d, user_id=08d6c41fef5c467e9826e5eabbbccc65, role_id=afb0a01183d9497795eaa4fa1a4046ae)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:55:57.601121 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d45034-2f4d-4855-9fee-2abc78a1cf3f admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:55:57.610294 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-a8af115a-78ad-40a2-abc9-03c6ddb68d3b None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:55:57.612662 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-a8af115a-78ad-40a2-abc9-03c6ddb68d3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:55:57.627122 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 794/1565] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Oct 9 00:55:57 2022] PUT /identity/v3/projects/2ac86a5c874c4a0b8da47d5144040d5d/users/08d6c41fef5c467e9826e5eabbbccc65/roles/afb0a01183d9497795eaa4fa1a4046ae => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 00:55:57.628796 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d45034-2f4d-4855-9fee-2abc78a1cf3f admin admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:55:57.707474 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 772/1566] 10.222.0.15 () {58 vars in 958 bytes} [Sun Oct 9 00:55:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:55:57.713079 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bce7bd-3471-4b2a-af31-182cd87ef5a3 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:55:57.713354 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bce7bd-3471-4b2a-af31-182cd87ef5a3 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:55:57.713898 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bce7bd-3471-4b2a-af31-182cd87ef5a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:55:57.734819 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d45034-2f4d-4855-9fee-2abc78a1cf3f admin admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:55:57.736541 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-54bce7bd-3471-4b2a-af31-182cd87ef5a3 None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:55:57.737765 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-54bce7bd-3471-4b2a-af31-182cd87ef5a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:55:57.740519 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51289d66-7dd7-4d81-8305-519a3df08c89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:55:57.741425 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51289d66-7dd7-4d81-8305-519a3df08c89 admin admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:55:57.742033 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51289d66-7dd7-4d81-8305-519a3df08c89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:55:57.742460 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51289d66-7dd7-4d81-8305-519a3df08c89 admin admin] PATH_INFO: `/v3/domains` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:55:57.743292 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51289d66-7dd7-4d81-8305-519a3df08c89 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:55:57.743873 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51289d66-7dd7-4d81-8305-519a3df08c89 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:55:57.745837 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51289d66-7dd7-4d81-8305-519a3df08c89 admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:55:57.745981 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 773/1567] 10.222.0.15 () {58 vars in 958 bytes} [Sun Oct 9 00:55:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:55:57.746922 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bce7bd-3471-4b2a-af31-182cd87ef5a3 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:55:57.761284 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bce7bd-3471-4b2a-af31-182cd87ef5a3 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:55:57.767315 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 795/1568] 10.222.0.15 () {58 vars in 1153 bytes} [Sun Oct 9 00:55:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:55:57.767315 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a27792-87cf-4b34-9cf7-2258994f4eb7 None None] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:55:57.767315 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a27792-87cf-4b34-9cf7-2258994f4eb7 None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:55:57.767315 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a27792-87cf-4b34-9cf7-2258994f4eb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:55:57.768838 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58a1eb6-ab04-466b-94e5-db49a26b1b39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:55:57.770111 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58a1eb6-ab04-466b-94e5-db49a26b1b39 admin admin] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:55:57.770852 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58a1eb6-ab04-466b-94e5-db49a26b1b39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:55:57.771442 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58a1eb6-ab04-466b-94e5-db49a26b1b39 admin admin] PATH_INFO: `/v3/projects` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:55:57.772593 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58a1eb6-ab04-466b-94e5-db49a26b1b39 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:55:57.775127 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58a1eb6-ab04-466b-94e5-db49a26b1b39 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:55:57.788875 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.auth.core [None req-65a27792-87cf-4b34-9cf7-2258994f4eb7 None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:55:57.790612 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-65a27792-87cf-4b34-9cf7-2258994f4eb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:55:57.799584 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 796/1569] 10.222.0.15 () {58 vars in 958 bytes} [Sun Oct 9 00:55:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:55:57.800729 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5805d315-c9cc-4d6a-9e4c-b6eb2f59884d None None] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:55:57.801014 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5805d315-c9cc-4d6a-9e4c-b6eb2f59884d None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:55:57.801286 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5805d315-c9cc-4d6a-9e4c-b6eb2f59884d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:55:57.814066 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 774/1570] 10.222.0.15 () {60 vars in 1153 bytes} [Sun Oct 9 00:55:57 2022] POST /identity/v3/projects => generated 389 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 09 00:55:57.814066 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bf2890-8eef-41d9-b557-ecb2bb67866d None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:55:57.814066 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bf2890-8eef-41d9-b557-ecb2bb67866d None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:55:57.814066 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bf2890-8eef-41d9-b557-ecb2bb67866d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:55:57.827708 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.auth.core [None req-5805d315-c9cc-4d6a-9e4c-b6eb2f59884d None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:55:57.828949 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-5805d315-c9cc-4d6a-9e4c-b6eb2f59884d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:55:57.833344 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-a6bf2890-8eef-41d9-b557-ecb2bb67866d None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:55:57.834623 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-a6bf2890-8eef-41d9-b557-ecb2bb67866d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:55:57.901613 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 797/1571] 10.222.0.15 () {58 vars in 958 bytes} [Sun Oct 9 00:55:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:55:57.902618 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 775/1572] 10.222.0.15 () {58 vars in 958 bytes} [Sun Oct 9 00:55:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:55:57.903617 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bf2890-8eef-41d9-b557-ecb2bb67866d None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:55:57.908694 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5805d315-c9cc-4d6a-9e4c-b6eb2f59884d None None] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:55:57.914424 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bf2890-8eef-41d9-b557-ecb2bb67866d None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:55:57.919493 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347563cb-bbf4-42a7-af7b-4a958bafd453 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:55:57.919677 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5805d315-c9cc-4d6a-9e4c-b6eb2f59884d None None] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:55:57.920170 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347563cb-bbf4-42a7-af7b-4a958bafd453 admin admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:55:57.920381 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347563cb-bbf4-42a7-af7b-4a958bafd453 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:55:57.920648 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347563cb-bbf4-42a7-af7b-4a958bafd453 admin admin] PATH_INFO: `/v3/domains` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:55:57.921296 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347563cb-bbf4-42a7-af7b-4a958bafd453 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:55:57.921597 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347563cb-bbf4-42a7-af7b-4a958bafd453 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:55:57.923194 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347563cb-bbf4-42a7-af7b-4a958bafd453 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:55:57.924618 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c2c61d-fd33-4069-9c18-97a3d2901dee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:55:57.925300 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c2c61d-fd33-4069-9c18-97a3d2901dee admin admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:55:57.925647 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c2c61d-fd33-4069-9c18-97a3d2901dee admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:55:57.925988 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c2c61d-fd33-4069-9c18-97a3d2901dee admin admin] PATH_INFO: `/v3/domains` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:55:57.926705 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c2c61d-fd33-4069-9c18-97a3d2901dee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:55:57.927069 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c2c61d-fd33-4069-9c18-97a3d2901dee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:55:57.928766 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c2c61d-fd33-4069-9c18-97a3d2901dee admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:55:57.937583 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 776/1573] 10.222.0.15 () {58 vars in 1153 bytes} [Sun Oct 9 00:55:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:55:57.938999 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347563cb-bbf4-42a7-af7b-4a958bafd453 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:55:57.948769 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 798/1574] 10.222.0.15 () {58 vars in 1153 bytes} [Sun Oct 9 00:55:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:55:57.948769 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461999ad-17c0-4a0c-a737-e5eaab95df78 None None] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:55:57.948769 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461999ad-17c0-4a0c-a737-e5eaab95df78 None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:55:57.948769 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461999ad-17c0-4a0c-a737-e5eaab95df78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:55:57.954747 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347563cb-bbf4-42a7-af7b-4a958bafd453 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:55:57.959387 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1044c48e-472a-4809-a383-ab9aaf525c6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:55:57.960002 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1044c48e-472a-4809-a383-ab9aaf525c6f admin admin] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:55:57.960346 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1044c48e-472a-4809-a383-ab9aaf525c6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:55:57.960623 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1044c48e-472a-4809-a383-ab9aaf525c6f admin admin] PATH_INFO: `/v3/projects` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:55:57.961264 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1044c48e-472a-4809-a383-ab9aaf525c6f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:55:57.963171 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1044c48e-472a-4809-a383-ab9aaf525c6f admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:55:57.965079 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.auth.core [None req-461999ad-17c0-4a0c-a737-e5eaab95df78 None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:55:57.966296 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-461999ad-17c0-4a0c-a737-e5eaab95df78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:55:57.977080 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 799/1575] 10.222.0.15 () {58 vars in 958 bytes} [Sun Oct 9 00:55:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:55:57.978015 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461999ad-17c0-4a0c-a737-e5eaab95df78 None None] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:55:57.989234 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461999ad-17c0-4a0c-a737-e5eaab95df78 None None] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:55:57.994393 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24467d16-c753-4075-ac3e-3282cd15eb22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:55:57.995091 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24467d16-c753-4075-ac3e-3282cd15eb22 admin admin] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:55:57.995406 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24467d16-c753-4075-ac3e-3282cd15eb22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:55:57.995676 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24467d16-c753-4075-ac3e-3282cd15eb22 admin admin] PATH_INFO: `/v3/users` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:55:57.996285 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 777/1576] 10.222.0.15 () {60 vars in 1153 bytes} [Sun Oct 9 00:55:57 2022] POST /identity/v3/projects => generated 363 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 09 00:55:57.996942 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1044c48e-472a-4809-a383-ab9aaf525c6f admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:55:57.999744 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24467d16-c753-4075-ac3e-3282cd15eb22 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:55:58.001909 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24467d16-c753-4075-ac3e-3282cd15eb22 admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:55:58.006644 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:55:58.028677 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 800/1577] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Oct 9 00:55:57 2022] POST /identity/v3/users => generated 295 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 09 00:55:58.029385 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24467d16-c753-4075-ac3e-3282cd15eb22 admin admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:55:58.039549 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:55:58.079647 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1044c48e-472a-4809-a383-ab9aaf525c6f admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:55:58.087755 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ccdf3d-ba98-40b0-9309-113d381baa35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:55:58.088529 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ccdf3d-ba98-40b0-9309-113d381baa35 admin admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:55:58.088652 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ccdf3d-ba98-40b0-9309-113d381baa35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:55:58.088910 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ccdf3d-ba98-40b0-9309-113d381baa35 admin admin] PATH_INFO: `/v3/domains` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:55:58.090465 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ccdf3d-ba98-40b0-9309-113d381baa35 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:55:58.090832 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ccdf3d-ba98-40b0-9309-113d381baa35 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:55:58.092477 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ccdf3d-ba98-40b0-9309-113d381baa35 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:55:58.101175 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24467d16-c753-4075-ac3e-3282cd15eb22 admin admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:55:58.106203 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 778/1578] 10.222.0.15 () {58 vars in 1153 bytes} [Sun Oct 9 00:55:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:55:58.107232 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ccdf3d-ba98-40b0-9309-113d381baa35 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:55:58.119752 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ccdf3d-ba98-40b0-9309-113d381baa35 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:55:58.126132 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0155e21-1ba6-4475-be19-2a6093436e6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:55:58.127009 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0155e21-1ba6-4475-be19-2a6093436e6e admin admin] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:55:58.127484 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0155e21-1ba6-4475-be19-2a6093436e6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:55:58.128051 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0155e21-1ba6-4475-be19-2a6093436e6e admin admin] PATH_INFO: `/v3/projects` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:55:58.128859 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0155e21-1ba6-4475-be19-2a6093436e6e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:55:58.132165 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0155e21-1ba6-4475-be19-2a6093436e6e admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:55:58.176656 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdfca65-8192-44c9-95c0-f3aecb796722 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4ef90d456d2483e8ddafbe2d4d4fb5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f148d39ced534860abfbe8fc3f98ace4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:55:58.177308 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdfca65-8192-44c9-95c0-f3aecb796722 service neutron] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:55:58.177555 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdfca65-8192-44c9-95c0-f3aecb796722 service neutron] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:55:58.177824 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdfca65-8192-44c9-95c0-f3aecb796722 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:55:58.180708 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 779/1579] 10.222.0.15 () {60 vars in 1153 bytes} [Sun Oct 9 00:55:58 2022] POST /identity/v3/projects => generated 393 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 09 00:55:58.185617 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0155e21-1ba6-4475-be19-2a6093436e6e admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:55:58.188654 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdfca65-8192-44c9-95c0-f3aecb796722 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:55:58.190395 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdfca65-8192-44c9-95c0-f3aecb796722 service neutron] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:55:58.202513 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 801/1580] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Oct 9 00:55:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 09 00:55:58.203511 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdfca65-8192-44c9-95c0-f3aecb796722 service neutron] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:55:58.214439 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdfca65-8192-44c9-95c0-f3aecb796722 service neutron] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:55:58.281237 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0155e21-1ba6-4475-be19-2a6093436e6e admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:55:58.287538 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0742b52-375c-4fcc-b4c6-8bf5351be10e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:55:58.288256 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0742b52-375c-4fcc-b4c6-8bf5351be10e admin admin] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:55:58.288894 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0742b52-375c-4fcc-b4c6-8bf5351be10e admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:55:58.289229 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0742b52-375c-4fcc-b4c6-8bf5351be10e admin admin] PATH_INFO: `/v3/projects` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:55:58.290353 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0742b52-375c-4fcc-b4c6-8bf5351be10e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:55:58.293107 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0742b52-375c-4fcc-b4c6-8bf5351be10e admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:55:58.297228 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc77531f-bf76-4fea-b1d7-3d3ae80c0e2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:55:58.298060 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc77531f-bf76-4fea-b1d7-3d3ae80c0e2a admin admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:55:58.298600 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc77531f-bf76-4fea-b1d7-3d3ae80c0e2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:55:58.298942 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc77531f-bf76-4fea-b1d7-3d3ae80c0e2a admin admin] PATH_INFO: `/v3/domains` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:55:58.299767 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc77531f-bf76-4fea-b1d7-3d3ae80c0e2a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:55:58.300172 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc77531f-bf76-4fea-b1d7-3d3ae80c0e2a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:55:58.302275 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc77531f-bf76-4fea-b1d7-3d3ae80c0e2a admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:55:58.324331 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 802/1581] 10.222.0.15 () {58 vars in 1153 bytes} [Sun Oct 9 00:55:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:55:58.324331 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc77531f-bf76-4fea-b1d7-3d3ae80c0e2a admin admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:55:58.330216 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc77531f-bf76-4fea-b1d7-3d3ae80c0e2a admin admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:55:58.339421 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd80e39-5033-4b66-82a8-79820405b1c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:55:58.339421 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd80e39-5033-4b66-82a8-79820405b1c6 admin admin] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:55:58.340012 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd80e39-5033-4b66-82a8-79820405b1c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:55:58.340249 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd80e39-5033-4b66-82a8-79820405b1c6 admin admin] PATH_INFO: `/v3/users` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:55:58.340969 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd80e39-5033-4b66-82a8-79820405b1c6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:55:58.343020 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 780/1582] 10.222.0.15 () {60 vars in 1153 bytes} [Sun Oct 9 00:55:58 2022] POST /identity/v3/projects => generated 379 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 09 00:55:58.343922 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0742b52-375c-4fcc-b4c6-8bf5351be10e admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:55:58.344068 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd80e39-5033-4b66-82a8-79820405b1c6 admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:55:58.370346 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 803/1583] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Oct 9 00:55:58 2022] POST /identity/v3/users => generated 282 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 09 00:55:58.371376 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd80e39-5033-4b66-82a8-79820405b1c6 admin admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:55:58.383792 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd80e39-5033-4b66-82a8-79820405b1c6 admin admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:55:58.449777 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:55:58.450715 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0742b52-375c-4fcc-b4c6-8bf5351be10e admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:55:58.461991 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64c02e7-f2ec-46c1-8275-40368aa013b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:55:58.462631 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64c02e7-f2ec-46c1-8275-40368aa013b1 admin admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:55:58.462998 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64c02e7-f2ec-46c1-8275-40368aa013b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:55:58.463335 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64c02e7-f2ec-46c1-8275-40368aa013b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:55:58.464231 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64c02e7-f2ec-46c1-8275-40368aa013b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:55:58.466599 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64c02e7-f2ec-46c1-8275-40368aa013b1 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:55:58.475944 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:55:58.476880 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba0d673-93b3-4c53-9b1f-edb790b7c77f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:55:58.477685 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba0d673-93b3-4c53-9b1f-edb790b7c77f admin admin] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:55:58.478076 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba0d673-93b3-4c53-9b1f-edb790b7c77f admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:55:58.478394 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba0d673-93b3-4c53-9b1f-edb790b7c77f admin admin] PATH_INFO: `/v3/projects` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:55:58.479132 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba0d673-93b3-4c53-9b1f-edb790b7c77f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:55:58.480430 dv-cinder-master-3-smb devstack@keystone.service[81525]: WARNING py.warnings [None req-6ba0d673-93b3-4c53-9b1f-edb790b7c77f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 09 00:55:58.480430 dv-cinder-master-3-smb devstack@keystone.service[81525]: warnings.warn(msg) Oct 09 00:55:58.480430 dv-cinder-master-3-smb devstack@keystone.service[81525]: Oct 09 00:55:58.481930 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba0d673-93b3-4c53-9b1f-edb790b7c77f admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:55:58.484459 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 781/1584] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Oct 9 00:55:58 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 09 00:55:58.485942 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64c02e7-f2ec-46c1-8275-40368aa013b1 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:55:58.504487 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64c02e7-f2ec-46c1-8275-40368aa013b1 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:55:58.512149 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe4759f-14b1-484f-aa5d-e5072dbbc5b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:55:58.512827 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe4759f-14b1-484f-aa5d-e5072dbbc5b8 admin admin] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:55:58.514088 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe4759f-14b1-484f-aa5d-e5072dbbc5b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:55:58.514088 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe4759f-14b1-484f-aa5d-e5072dbbc5b8 admin admin] PATH_INFO: `/v3/users` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:55:58.514448 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe4759f-14b1-484f-aa5d-e5072dbbc5b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:55:58.517364 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe4759f-14b1-484f-aa5d-e5072dbbc5b8 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:55:58.530988 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 804/1585] 10.222.0.15 () {60 vars in 1153 bytes} [Sun Oct 9 00:55:58 2022] POST /identity/v3/projects => generated 365 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 09 00:55:58.532593 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba0d673-93b3-4c53-9b1f-edb790b7c77f admin admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:55:58.550523 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 782/1586] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Oct 9 00:55:58 2022] POST /identity/v3/users => generated 297 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 09 00:55:58.550523 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe4759f-14b1-484f-aa5d-e5072dbbc5b8 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:55:58.560469 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe4759f-14b1-484f-aa5d-e5072dbbc5b8 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:55:58.614935 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba0d673-93b3-4c53-9b1f-edb790b7c77f admin admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:55:58.620852 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ff5ea4-7f7d-401f-a198-97cdf03da871 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:55:58.621546 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ff5ea4-7f7d-401f-a198-97cdf03da871 admin admin] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:55:58.621926 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ff5ea4-7f7d-401f-a198-97cdf03da871 admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:55:58.622291 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ff5ea4-7f7d-401f-a198-97cdf03da871 admin admin] PATH_INFO: `/v3/projects` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:55:58.623437 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ff5ea4-7f7d-401f-a198-97cdf03da871 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:55:58.626327 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ff5ea4-7f7d-401f-a198-97cdf03da871 admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:55:58.665948 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 805/1587] 10.222.0.15 () {60 vars in 1153 bytes} [Sun Oct 9 00:55:58 2022] POST /identity/v3/projects => generated 377 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 09 00:55:58.666934 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ff5ea4-7f7d-401f-a198-97cdf03da871 admin admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:55:58.686745 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6c64d7-675d-4820-b649-e6cef48f4756 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:55:58.687455 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6c64d7-675d-4820-b649-e6cef48f4756 admin admin] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:55:58.687732 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6c64d7-675d-4820-b649-e6cef48f4756 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:55:58.688470 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6c64d7-675d-4820-b649-e6cef48f4756 admin admin] PATH_INFO: `/v3/users` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:55:58.689122 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6c64d7-675d-4820-b649-e6cef48f4756 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:55:58.691128 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6c64d7-675d-4820-b649-e6cef48f4756 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:55:58.719019 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 783/1588] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Oct 9 00:55:58 2022] POST /identity/v3/users => generated 290 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 09 00:55:58.719908 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6c64d7-675d-4820-b649-e6cef48f4756 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:55:58.730978 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6c64d7-675d-4820-b649-e6cef48f4756 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:55:58.763199 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ff5ea4-7f7d-401f-a198-97cdf03da871 admin admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:55:58.771030 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e118e223-dc15-4ac3-8f8a-a370283a8781 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:55:58.772089 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e118e223-dc15-4ac3-8f8a-a370283a8781 admin admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:55:58.773243 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e118e223-dc15-4ac3-8f8a-a370283a8781 admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:55:58.773559 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e118e223-dc15-4ac3-8f8a-a370283a8781 admin admin] PATH_INFO: `/v3/roles` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:55:58.774455 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e118e223-dc15-4ac3-8f8a-a370283a8781 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:55:58.777121 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e118e223-dc15-4ac3-8f8a-a370283a8781 admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:55:58.794909 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 806/1589] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Oct 9 00:55:58 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 09 00:55:58.795844 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e118e223-dc15-4ac3-8f8a-a370283a8781 admin admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:55:58.809888 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e118e223-dc15-4ac3-8f8a-a370283a8781 admin admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:55:58.814516 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2988d310-b330-418d-a875-399a98643ebd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:55:58.815603 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2988d310-b330-418d-a875-399a98643ebd admin admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:55:58.816121 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2988d310-b330-418d-a875-399a98643ebd admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:55:58.816436 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2988d310-b330-418d-a875-399a98643ebd admin admin] PATH_INFO: `/v3/roles` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:55:58.816533 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133521d3-5cf4-4fbb-8a94-560087076a84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:55:58.817137 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133521d3-5cf4-4fbb-8a94-560087076a84 admin admin] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:55:58.817413 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133521d3-5cf4-4fbb-8a94-560087076a84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:55:58.817611 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2988d310-b330-418d-a875-399a98643ebd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:55:58.817715 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133521d3-5cf4-4fbb-8a94-560087076a84 admin admin] PATH_INFO: `/v3/users` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:55:58.819505 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2988d310-b330-418d-a875-399a98643ebd admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:55:58.820813 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133521d3-5cf4-4fbb-8a94-560087076a84 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:55:58.823411 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133521d3-5cf4-4fbb-8a94-560087076a84 admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:55:58.833838 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 784/1590] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Oct 9 00:55:58 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 09 00:55:58.835749 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2988d310-b330-418d-a875-399a98643ebd admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:55:58.848163 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2988d310-b330-418d-a875-399a98643ebd admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:55:58.855178 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147dc5dd-0293-4c36-8f97-56689c6b8ab9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:55:58.855178 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147dc5dd-0293-4c36-8f97-56689c6b8ab9 admin admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:55:58.855650 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147dc5dd-0293-4c36-8f97-56689c6b8ab9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:55:58.856305 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147dc5dd-0293-4c36-8f97-56689c6b8ab9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:55:58.857095 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147dc5dd-0293-4c36-8f97-56689c6b8ab9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:55:58.859122 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147dc5dd-0293-4c36-8f97-56689c6b8ab9 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:55:58.860274 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 807/1591] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Oct 9 00:55:58 2022] POST /identity/v3/users => generated 283 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 09 00:55:58.861342 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133521d3-5cf4-4fbb-8a94-560087076a84 admin admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:55:58.873356 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133521d3-5cf4-4fbb-8a94-560087076a84 admin admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:55:58.876945 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 785/1592] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Oct 9 00:55:58 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 09 00:55:58.879784 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24315c21-e1a8-466c-9a6a-b60e010ab96a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:55:58.880594 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24315c21-e1a8-466c-9a6a-b60e010ab96a admin admin] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:55:58.881108 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24315c21-e1a8-466c-9a6a-b60e010ab96a admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:55:58.881294 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147dc5dd-0293-4c36-8f97-56689c6b8ab9 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:55:58.881688 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24315c21-e1a8-466c-9a6a-b60e010ab96a admin admin] PATH_INFO: `/v3/users` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:55:58.882777 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24315c21-e1a8-466c-9a6a-b60e010ab96a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:55:58.884993 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24315c21-e1a8-466c-9a6a-b60e010ab96a admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:55:58.893406 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147dc5dd-0293-4c36-8f97-56689c6b8ab9 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:55:58.904198 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820940ff-af52-425a-bdee-c0b5514a758c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:55:58.904999 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820940ff-af52-425a-bdee-c0b5514a758c admin admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:55:58.905299 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820940ff-af52-425a-bdee-c0b5514a758c admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:55:58.907341 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820940ff-af52-425a-bdee-c0b5514a758c admin admin] PATH_INFO: `/v3/roles` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:55:58.908065 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820940ff-af52-425a-bdee-c0b5514a758c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:55:58.909824 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820940ff-af52-425a-bdee-c0b5514a758c admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:55:58.919516 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 808/1593] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Oct 9 00:55:58 2022] POST /identity/v3/users => generated 289 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 09 00:55:58.920540 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24315c21-e1a8-466c-9a6a-b60e010ab96a admin admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:55:58.934097 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 786/1594] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Oct 9 00:55:58 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 09 00:55:58.935021 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24315c21-e1a8-466c-9a6a-b60e010ab96a admin admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:55:58.935576 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820940ff-af52-425a-bdee-c0b5514a758c admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:55:58.942677 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aae884d-ea11-4dac-a9a2-8b9f0654ec3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:55:58.943576 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aae884d-ea11-4dac-a9a2-8b9f0654ec3b admin admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:55:58.944384 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aae884d-ea11-4dac-a9a2-8b9f0654ec3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:55:58.944384 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aae884d-ea11-4dac-a9a2-8b9f0654ec3b admin admin] PATH_INFO: `/v3/roles` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:55:58.944891 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aae884d-ea11-4dac-a9a2-8b9f0654ec3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:55:58.946764 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aae884d-ea11-4dac-a9a2-8b9f0654ec3b admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:55:58.947971 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820940ff-af52-425a-bdee-c0b5514a758c admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:55:58.955781 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa0df45-7703-4192-aa39-a5ce9436edd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:55:58.956676 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa0df45-7703-4192-aa39-a5ce9436edd3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:55:58.957011 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa0df45-7703-4192-aa39-a5ce9436edd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:55:58.957338 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa0df45-7703-4192-aa39-a5ce9436edd3 admin admin] PATH_INFO: `/v3/projects/325756eeb7724a9596fa324af7d5ea22/users/6e66ef13ab7f4fc99966752b351e845c/roles/afb0a01183d9497795eaa4fa1a4046ae` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:55:58.977590 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 809/1595] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Oct 9 00:55:58 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 09 00:55:58.978543 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aae884d-ea11-4dac-a9a2-8b9f0654ec3b admin admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:55:58.981347 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa0df45-7703-4192-aa39-a5ce9436edd3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=325756eeb7724a9596fa324af7d5ea22, user_id=6e66ef13ab7f4fc99966752b351e845c, role_id=afb0a01183d9497795eaa4fa1a4046ae)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:55:58.984487 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:55:58.986225 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa0df45-7703-4192-aa39-a5ce9436edd3 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:55:58.991937 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aae884d-ea11-4dac-a9a2-8b9f0654ec3b admin admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:55:58.999099 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df01ae76-a697-4e14-a156-56df68b112ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:55:58.999899 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df01ae76-a697-4e14-a156-56df68b112ad admin admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:55:59.000239 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df01ae76-a697-4e14-a156-56df68b112ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:55:59.000686 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df01ae76-a697-4e14-a156-56df68b112ad admin admin] PATH_INFO: `/v3/roles` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:55:59.001699 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df01ae76-a697-4e14-a156-56df68b112ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:55:59.003885 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df01ae76-a697-4e14-a156-56df68b112ad admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:55:59.020503 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 787/1596] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Oct 9 00:55:58 2022] PUT /identity/v3/projects/325756eeb7724a9596fa324af7d5ea22/users/6e66ef13ab7f4fc99966752b351e845c/roles/afb0a01183d9497795eaa4fa1a4046ae => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 00:55:59.021224 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa0df45-7703-4192-aa39-a5ce9436edd3 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:55:59.031315 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 810/1597] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Oct 9 00:55:58 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 09 00:55:59.031315 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df01ae76-a697-4e14-a156-56df68b112ad admin admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:55:59.046358 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df01ae76-a697-4e14-a156-56df68b112ad admin admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:55:59.064162 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:55:59.135504 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa0df45-7703-4192-aa39-a5ce9436edd3 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:55:59.144273 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789bb136-17e4-4315-8149-5e6e5c88f283 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:55:59.145486 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647f94bd-319c-46b7-b6b5-24cfe7f27d47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:55:59.146533 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647f94bd-319c-46b7-b6b5-24cfe7f27d47 admin admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:55:59.147135 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789bb136-17e4-4315-8149-5e6e5c88f283 admin admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:55:59.147471 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647f94bd-319c-46b7-b6b5-24cfe7f27d47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:55:59.147778 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647f94bd-319c-46b7-b6b5-24cfe7f27d47 admin admin] PATH_INFO: `/v3/roles` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:55:59.148440 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647f94bd-319c-46b7-b6b5-24cfe7f27d47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:55:59.149536 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789bb136-17e4-4315-8149-5e6e5c88f283 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:55:59.149832 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789bb136-17e4-4315-8149-5e6e5c88f283 admin admin] PATH_INFO: `/v3/roles` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:55:59.150812 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789bb136-17e4-4315-8149-5e6e5c88f283 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:55:59.153420 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647f94bd-319c-46b7-b6b5-24cfe7f27d47 admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:55:59.154530 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789bb136-17e4-4315-8149-5e6e5c88f283 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:55:59.180008 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 811/1598] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Oct 9 00:55:59 2022] GET /identity/v3/roles => generated 1420 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 09 00:55:59.183413 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 788/1599] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Oct 9 00:55:59 2022] GET /identity/v3/roles => generated 1420 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 09 00:55:59.185316 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647f94bd-319c-46b7-b6b5-24cfe7f27d47 admin admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:55:59.186210 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789bb136-17e4-4315-8149-5e6e5c88f283 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:55:59.205659 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789bb136-17e4-4315-8149-5e6e5c88f283 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:55:59.208512 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647f94bd-319c-46b7-b6b5-24cfe7f27d47 admin admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:55:59.214481 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fc579d-3f8c-4205-b89a-3b58c52c8e27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:55:59.215123 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fc579d-3f8c-4205-b89a-3b58c52c8e27 admin admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:55:59.215460 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fc579d-3f8c-4205-b89a-3b58c52c8e27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:55:59.215737 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fc579d-3f8c-4205-b89a-3b58c52c8e27 admin admin] PATH_INFO: `/v3/roles` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:55:59.216544 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fc579d-3f8c-4205-b89a-3b58c52c8e27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:55:59.217352 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e11360-79b9-4847-b644-3b6361058a1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:55:59.218161 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fc579d-3f8c-4205-b89a-3b58c52c8e27 admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:55:59.218674 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e11360-79b9-4847-b644-3b6361058a1c admin admin] REQUEST_METHOD: `PUT` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:55:59.219128 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e11360-79b9-4847-b644-3b6361058a1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:55:59.219636 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e11360-79b9-4847-b644-3b6361058a1c admin admin] PATH_INFO: `/v3/projects/03ac230f86cb4d389e7112ec38bae86e/users/3f8fd6011aef4e99a414efc607472a07/roles/afb0a01183d9497795eaa4fa1a4046ae` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:55:59.232221 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 812/1600] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Oct 9 00:55:59 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 09 00:55:59.233878 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7e83c8-6b65-4a6f-bbf0-aa1bf0c5b6a6 None None] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:55:59.234168 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7e83c8-6b65-4a6f-bbf0-aa1bf0c5b6a6 None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:55:59.234561 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7e83c8-6b65-4a6f-bbf0-aa1bf0c5b6a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:55:59.246572 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e11360-79b9-4847-b644-3b6361058a1c admin admin] RBAC: Authorizing `identity:create_grant(project_id=03ac230f86cb4d389e7112ec38bae86e, user_id=3f8fd6011aef4e99a414efc607472a07, role_id=afb0a01183d9497795eaa4fa1a4046ae)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:55:59.250186 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e11360-79b9-4847-b644-3b6361058a1c admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:55:59.258760 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.auth.core [None req-ad7e83c8-6b65-4a6f-bbf0-aa1bf0c5b6a6 None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:55:59.260084 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-ad7e83c8-6b65-4a6f-bbf0-aa1bf0c5b6a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:55:59.280051 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 813/1602] 10.222.0.15 () {58 vars in 958 bytes} [Sun Oct 9 00:55:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:55:59.280985 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7e83c8-6b65-4a6f-bbf0-aa1bf0c5b6a6 None None] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:55:59.395780 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 789/1602] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Oct 9 00:55:59 2022] PUT /identity/v3/projects/03ac230f86cb4d389e7112ec38bae86e/users/3f8fd6011aef4e99a414efc607472a07/roles/afb0a01183d9497795eaa4fa1a4046ae => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 00:55:59.395780 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e11360-79b9-4847-b644-3b6361058a1c admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:55:59.398746 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7e83c8-6b65-4a6f-bbf0-aa1bf0c5b6a6 None None] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:55:59.415437 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40804c4e-212b-4e42-a20b-ec9ca5a31082 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:55:59.416831 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40804c4e-212b-4e42-a20b-ec9ca5a31082 admin admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:55:59.417255 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40804c4e-212b-4e42-a20b-ec9ca5a31082 admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:55:59.417737 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40804c4e-212b-4e42-a20b-ec9ca5a31082 admin admin] PATH_INFO: `/v3/roles` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:55:59.418405 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40804c4e-212b-4e42-a20b-ec9ca5a31082 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:55:59.420124 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40804c4e-212b-4e42-a20b-ec9ca5a31082 admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:55:59.433448 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 814/1603] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Oct 9 00:55:59 2022] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 09 00:55:59.434460 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40804c4e-212b-4e42-a20b-ec9ca5a31082 admin admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:55:59.445250 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e11360-79b9-4847-b644-3b6361058a1c admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:55:59.449782 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40804c4e-212b-4e42-a20b-ec9ca5a31082 admin admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:55:59.455054 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd094607-09d9-4b58-96f9-b02e0adddaac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:55:59.456002 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd094607-09d9-4b58-96f9-b02e0adddaac admin admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:55:59.456448 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd094607-09d9-4b58-96f9-b02e0adddaac admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:55:59.456911 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd094607-09d9-4b58-96f9-b02e0adddaac admin admin] PATH_INFO: `/v3/roles` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:55:59.457781 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd094607-09d9-4b58-96f9-b02e0adddaac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:55:59.460424 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd094607-09d9-4b58-96f9-b02e0adddaac admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:55:59.466103 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05fc1d7-1923-4a9d-833c-1414094ed75f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:55:59.467081 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05fc1d7-1923-4a9d-833c-1414094ed75f admin admin] REQUEST_METHOD: `PUT` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:55:59.468461 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05fc1d7-1923-4a9d-833c-1414094ed75f admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:55:59.469675 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05fc1d7-1923-4a9d-833c-1414094ed75f admin admin] PATH_INFO: `/v3/projects/62258785aeb54f10a4d57cc9642d6186/users/5eaab5e4f7f14847b5c2ca8eb490d21c/roles/afb0a01183d9497795eaa4fa1a4046ae` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:55:59.486414 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 790/1604] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Oct 9 00:55:59 2022] GET /identity/v3/roles => generated 1420 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 09 00:55:59.487375 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd094607-09d9-4b58-96f9-b02e0adddaac admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:55:59.505180 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05fc1d7-1923-4a9d-833c-1414094ed75f admin admin] RBAC: Authorizing `identity:create_grant(project_id=62258785aeb54f10a4d57cc9642d6186, user_id=5eaab5e4f7f14847b5c2ca8eb490d21c, role_id=afb0a01183d9497795eaa4fa1a4046ae)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:55:59.507981 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05fc1d7-1923-4a9d-833c-1414094ed75f admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:55:59.512895 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd094607-09d9-4b58-96f9-b02e0adddaac admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:55:59.521404 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34477b67-46ae-4173-b96e-7f5d2d001a96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:55:59.522189 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34477b67-46ae-4173-b96e-7f5d2d001a96 admin admin] REQUEST_METHOD: `PUT` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:55:59.522513 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34477b67-46ae-4173-b96e-7f5d2d001a96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:55:59.522810 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34477b67-46ae-4173-b96e-7f5d2d001a96 admin admin] PATH_INFO: `/v3/projects/cc1d20a7ea25424896d87e572e4cd3f8/users/59057ca935124b528f0ae5a48e89f06f/roles/afb0a01183d9497795eaa4fa1a4046ae` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:55:59.531544 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 815/1605] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Oct 9 00:55:59 2022] PUT /identity/v3/projects/62258785aeb54f10a4d57cc9642d6186/users/5eaab5e4f7f14847b5c2ca8eb490d21c/roles/afb0a01183d9497795eaa4fa1a4046ae => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 00:55:59.539141 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c214b3-8bc1-42e4-b7c4-fab10dbf4315 None None] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:55:59.539640 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c214b3-8bc1-42e4-b7c4-fab10dbf4315 None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:55:59.540055 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c214b3-8bc1-42e4-b7c4-fab10dbf4315 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:55:59.546709 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34477b67-46ae-4173-b96e-7f5d2d001a96 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc1d20a7ea25424896d87e572e4cd3f8, user_id=59057ca935124b528f0ae5a48e89f06f, role_id=afb0a01183d9497795eaa4fa1a4046ae)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:55:59.549440 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34477b67-46ae-4173-b96e-7f5d2d001a96 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:55:59.580866 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 791/1606] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Oct 9 00:55:59 2022] PUT /identity/v3/projects/cc1d20a7ea25424896d87e572e4cd3f8/users/59057ca935124b528f0ae5a48e89f06f/roles/afb0a01183d9497795eaa4fa1a4046ae => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 00:55:59.581890 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34477b67-46ae-4173-b96e-7f5d2d001a96 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:55:59.598227 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.auth.core [None req-69c214b3-8bc1-42e4-b7c4-fab10dbf4315 None None] MFA Rules not processed for user `3f8fd6011aef4e99a414efc607472a07`. Rule list: `[]` (Enabled: `True`). {{(pid=81525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:55:59.600107 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-69c214b3-8bc1-42e4-b7c4-fab10dbf4315 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:55:59.659031 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:55:59.702686 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34477b67-46ae-4173-b96e-7f5d2d001a96 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:55:59.709055 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12844330-9ae0-4528-918c-57cc89257192 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:55:59.710235 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12844330-9ae0-4528-918c-57cc89257192 admin admin] REQUEST_METHOD: `PUT` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:55:59.710818 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12844330-9ae0-4528-918c-57cc89257192 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:55:59.711329 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12844330-9ae0-4528-918c-57cc89257192 admin admin] PATH_INFO: `/v3/projects/6f169c9ba50b4f47aaa0b58adc3d3672/users/9c1cdb07fd174a69bec973608836db9e/roles/afb0a01183d9497795eaa4fa1a4046ae` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:55:59.715108 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 816/1607] 10.222.0.15 () {58 vars in 958 bytes} [Sun Oct 9 00:55:59 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:55:59.715108 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c214b3-8bc1-42e4-b7c4-fab10dbf4315 None None] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:55:59.717113 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-69c214b3-8bc1-42e4-b7c4-fab10dbf4315 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:55:59.734925 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:55:59.743779 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12844330-9ae0-4528-918c-57cc89257192 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f169c9ba50b4f47aaa0b58adc3d3672, user_id=9c1cdb07fd174a69bec973608836db9e, role_id=afb0a01183d9497795eaa4fa1a4046ae)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:55:59.747774 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12844330-9ae0-4528-918c-57cc89257192 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:55:59.779854 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 792/1608] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Oct 9 00:55:59 2022] PUT /identity/v3/projects/6f169c9ba50b4f47aaa0b58adc3d3672/users/9c1cdb07fd174a69bec973608836db9e/roles/afb0a01183d9497795eaa4fa1a4046ae => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 00:55:59.779854 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12844330-9ae0-4528-918c-57cc89257192 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:55:59.816282 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c214b3-8bc1-42e4-b7c4-fab10dbf4315 None None] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:55:59.888360 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12844330-9ae0-4528-918c-57cc89257192 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:55:59.897879 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbabf5fa-4985-49fa-9fc0-123cddd8ccef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:55:59.898729 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbabf5fa-4985-49fa-9fc0-123cddd8ccef admin admin] REQUEST_METHOD: `PUT` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:55:59.899159 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbabf5fa-4985-49fa-9fc0-123cddd8ccef admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:55:59.900201 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbabf5fa-4985-49fa-9fc0-123cddd8ccef admin admin] PATH_INFO: `/v3/projects/feaf08f170154714be8503f68562741a/users/c4df6b9e42314edcbee1710279d0aa5a/roles/afb0a01183d9497795eaa4fa1a4046ae` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:55:59.905758 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52496700-6178-4851-9879-74135042803f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4ef90d456d2483e8ddafbe2d4d4fb5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f148d39ced534860abfbe8fc3f98ace4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:55:59.906724 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52496700-6178-4851-9879-74135042803f service neutron] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:55:59.907835 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52496700-6178-4851-9879-74135042803f service neutron] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:55:59.908251 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52496700-6178-4851-9879-74135042803f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:55:59.923820 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52496700-6178-4851-9879-74135042803f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:55:59.925661 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52496700-6178-4851-9879-74135042803f service neutron] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:55:59.931999 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbabf5fa-4985-49fa-9fc0-123cddd8ccef admin admin] RBAC: Authorizing `identity:create_grant(project_id=feaf08f170154714be8503f68562741a, user_id=c4df6b9e42314edcbee1710279d0aa5a, role_id=afb0a01183d9497795eaa4fa1a4046ae)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:55:59.935480 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbabf5fa-4985-49fa-9fc0-123cddd8ccef admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:55:59.940799 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 817/1609] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Oct 9 00:55:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 09 00:55:59.942514 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463bb316-6705-4a7b-ab30-e1d4a01224e6 None None] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:55:59.942951 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463bb316-6705-4a7b-ab30-e1d4a01224e6 None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:55:59.943177 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463bb316-6705-4a7b-ab30-e1d4a01224e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:55:59.968551 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 793/1610] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Oct 9 00:55:59 2022] PUT /identity/v3/projects/feaf08f170154714be8503f68562741a/users/c4df6b9e42314edcbee1710279d0aa5a/roles/afb0a01183d9497795eaa4fa1a4046ae => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 00:55:59.971307 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5fd751-cad5-4b0d-9556-1c59ae1ee322 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:55:59.971890 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5fd751-cad5-4b0d-9556-1c59ae1ee322 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:55:59.972625 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5fd751-cad5-4b0d-9556-1c59ae1ee322 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:55:59.974061 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.auth.core [None req-463bb316-6705-4a7b-ab30-e1d4a01224e6 None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:55:59.977871 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-463bb316-6705-4a7b-ab30-e1d4a01224e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:56:00.027155 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-3f5fd751-cad5-4b0d-9556-1c59ae1ee322 None None] MFA Rules not processed for user `59057ca935124b528f0ae5a48e89f06f`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:56:00.029236 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-3f5fd751-cad5-4b0d-9556-1c59ae1ee322 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:56:00.131187 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 818/1611] 10.222.0.15 () {58 vars in 958 bytes} [Sun Oct 9 00:55:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:56:00.135517 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463bb316-6705-4a7b-ab30-e1d4a01224e6 None None] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:56:00.180403 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463bb316-6705-4a7b-ab30-e1d4a01224e6 None None] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:56:00.200326 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c065a7-3a88-4cd9-9834-253372c7e850 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:56:00.203869 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c065a7-3a88-4cd9-9834-253372c7e850 admin admin] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:00.205408 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c065a7-3a88-4cd9-9834-253372c7e850 admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:00.206113 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c065a7-3a88-4cd9-9834-253372c7e850 admin admin] PATH_INFO: `/v3/projects` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:00.208167 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c065a7-3a88-4cd9-9834-253372c7e850 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:56:00.218579 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c065a7-3a88-4cd9-9834-253372c7e850 admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:56:00.244231 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 794/1612] 10.222.0.15 () {58 vars in 958 bytes} [Sun Oct 9 00:55:59 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:56:00.246114 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a3e5de-c343-4ce3-92ea-c68cba69ff1f None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:00.258053 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a3e5de-c343-4ce3-92ea-c68cba69ff1f None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:00.258661 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a3e5de-c343-4ce3-92ea-c68cba69ff1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:00.316688 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 819/1613] 10.222.0.15 () {60 vars in 1153 bytes} [Sun Oct 9 00:56:00 2022] POST /identity/v3/projects => generated 363 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 09 00:56:00.321622 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3160817-901e-41b4-a4b2-1a30976fc020 None None] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:00.321977 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3160817-901e-41b4-a4b2-1a30976fc020 None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:00.322318 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3160817-901e-41b4-a4b2-1a30976fc020 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:00.351081 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.auth.core [None req-a3160817-901e-41b4-a4b2-1a30976fc020 None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:56:00.351747 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-78a3e5de-c343-4ce3-92ea-c68cba69ff1f None None] MFA Rules not processed for user `9c1cdb07fd174a69bec973608836db9e`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:56:00.352619 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-a3160817-901e-41b4-a4b2-1a30976fc020 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:56:00.353095 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-78a3e5de-c343-4ce3-92ea-c68cba69ff1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:56:00.357693 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:56:00.463182 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:56:00.470505 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 820/1614] 10.222.0.15 () {58 vars in 958 bytes} [Sun Oct 9 00:56:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:56:00.470505 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3160817-901e-41b4-a4b2-1a30976fc020 None None] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:56:00.511206 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 795/1615] 10.222.0.15 () {58 vars in 958 bytes} [Sun Oct 9 00:56:00 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:56:00.513796 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a3e5de-c343-4ce3-92ea-c68cba69ff1f None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:56:00.582736 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3160817-901e-41b4-a4b2-1a30976fc020 None None] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:56:00.591277 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da486f19-65a7-42f0-a87f-c17def0a7b98 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4ef90d456d2483e8ddafbe2d4d4fb5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f148d39ced534860abfbe8fc3f98ace4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:56:00.592697 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da486f19-65a7-42f0-a87f-c17def0a7b98 service neutron] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:00.593072 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da486f19-65a7-42f0-a87f-c17def0a7b98 service neutron] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:00.593435 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da486f19-65a7-42f0-a87f-c17def0a7b98 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:00.599347 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a3e5de-c343-4ce3-92ea-c68cba69ff1f None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:56:00.603782 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf35e975-84ba-46bb-8534-0c6f3ff803cf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff7cb78bcd91467abe5c2e2b48aedd1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f148d39ced534860abfbe8fc3f98ace4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:56:00.604751 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf35e975-84ba-46bb-8534-0c6f3ff803cf service cinder] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:00.605229 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf35e975-84ba-46bb-8534-0c6f3ff803cf service cinder] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:00.605697 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf35e975-84ba-46bb-8534-0c6f3ff803cf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:00.609661 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da486f19-65a7-42f0-a87f-c17def0a7b98 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:56:00.610759 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da486f19-65a7-42f0-a87f-c17def0a7b98 service neutron] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:56:00.625310 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 821/1616] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Oct 9 00:56:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 09 00:56:00.626308 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da486f19-65a7-42f0-a87f-c17def0a7b98 service neutron] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:56:00.637927 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da486f19-65a7-42f0-a87f-c17def0a7b98 service neutron] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:56:00.644851 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370602a9-c394-44e6-89e5-bb87266d97d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:56:00.645776 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370602a9-c394-44e6-89e5-bb87266d97d5 admin admin] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:00.646239 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370602a9-c394-44e6-89e5-bb87266d97d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:00.646878 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370602a9-c394-44e6-89e5-bb87266d97d5 admin admin] PATH_INFO: `/v3/users` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:00.648028 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370602a9-c394-44e6-89e5-bb87266d97d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:56:00.651051 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370602a9-c394-44e6-89e5-bb87266d97d5 admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:56:00.695328 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 822/1617] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Oct 9 00:56:00 2022] POST /identity/v3/users => generated 288 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 09 00:56:00.696902 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370602a9-c394-44e6-89e5-bb87266d97d5 admin admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:56:00.719133 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370602a9-c394-44e6-89e5-bb87266d97d5 admin admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:56:00.734365 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07d924a-a1fb-4649-a4c7-673b6cedc741 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:56:00.735824 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07d924a-a1fb-4649-a4c7-673b6cedc741 admin admin] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:00.737365 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07d924a-a1fb-4649-a4c7-673b6cedc741 admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:00.737493 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07d924a-a1fb-4649-a4c7-673b6cedc741 admin admin] PATH_INFO: `/v3/projects` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:00.739438 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07d924a-a1fb-4649-a4c7-673b6cedc741 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:56:00.744480 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07d924a-a1fb-4649-a4c7-673b6cedc741 admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:56:00.790019 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf35e975-84ba-46bb-8534-0c6f3ff803cf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:56:00.793739 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf35e975-84ba-46bb-8534-0c6f3ff803cf service cinder] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:56:00.817194 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 823/1618] 10.222.0.15 () {60 vars in 1153 bytes} [Sun Oct 9 00:56:00 2022] POST /identity/v3/projects => generated 365 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 09 00:56:00.817194 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07d924a-a1fb-4649-a4c7-673b6cedc741 admin admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:56:00.830458 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 796/1619] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Oct 9 00:56:00 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 09 00:56:00.833592 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf35e975-84ba-46bb-8534-0c6f3ff803cf service cinder] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:56:00.864924 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf35e975-84ba-46bb-8534-0c6f3ff803cf service cinder] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:56:00.939226 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07d924a-a1fb-4649-a4c7-673b6cedc741 admin admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:56:00.945656 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f25ad6-f875-4328-bb74-0a107f6d8d68 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4ef90d456d2483e8ddafbe2d4d4fb5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f148d39ced534860abfbe8fc3f98ace4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:56:00.947180 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f25ad6-f875-4328-bb74-0a107f6d8d68 service neutron] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:00.947822 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f25ad6-f875-4328-bb74-0a107f6d8d68 service neutron] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:00.948425 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f25ad6-f875-4328-bb74-0a107f6d8d68 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:01.012343 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:56:01.032813 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6ec2a2-e382-48c5-ab86-81a6130f3286 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:56:01.033225 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6ec2a2-e382-48c5-ab86-81a6130f3286 admin admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:01.033548 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6ec2a2-e382-48c5-ab86-81a6130f3286 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:01.034611 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6ec2a2-e382-48c5-ab86-81a6130f3286 admin admin] PATH_INFO: `/v3/roles` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:01.035789 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6ec2a2-e382-48c5-ab86-81a6130f3286 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:56:01.039504 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6ec2a2-e382-48c5-ab86-81a6130f3286 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:56:01.068687 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 797/1620] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Oct 9 00:56:00 2022] GET /identity/v3/roles => generated 1420 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 09 00:56:01.070439 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6ec2a2-e382-48c5-ab86-81a6130f3286 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:56:01.083841 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f25ad6-f875-4328-bb74-0a107f6d8d68 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:56:01.085789 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f25ad6-f875-4328-bb74-0a107f6d8d68 service neutron] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:56:01.094134 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6ec2a2-e382-48c5-ab86-81a6130f3286 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:56:01.102411 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 824/1621] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Oct 9 00:56:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 09 00:56:01.103432 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f25ad6-f875-4328-bb74-0a107f6d8d68 service neutron] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:56:01.108142 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d566db93-7951-4cf9-a06c-ae0e798077be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:56:01.108780 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d566db93-7951-4cf9-a06c-ae0e798077be admin admin] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:01.109055 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d566db93-7951-4cf9-a06c-ae0e798077be admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:01.109323 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d566db93-7951-4cf9-a06c-ae0e798077be admin admin] PATH_INFO: `/v3/users` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:01.109978 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d566db93-7951-4cf9-a06c-ae0e798077be admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:56:01.111977 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d566db93-7951-4cf9-a06c-ae0e798077be admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:56:01.117012 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f25ad6-f875-4328-bb74-0a107f6d8d68 service neutron] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:56:01.126594 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441f7431-9a65-4052-99b2-782d94173794 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:56:01.127622 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441f7431-9a65-4052-99b2-782d94173794 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:01.128120 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441f7431-9a65-4052-99b2-782d94173794 admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:01.128622 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441f7431-9a65-4052-99b2-782d94173794 admin admin] PATH_INFO: `/v3/users/59057ca935124b528f0ae5a48e89f06f` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:01.133103 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441f7431-9a65-4052-99b2-782d94173794 admin admin] RBAC: Authorizing `identity:delete_user(user_id=59057ca935124b528f0ae5a48e89f06f)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:56:01.134642 dv-cinder-master-3-smb devstack@keystone.service[81525]: WARNING py.warnings [None req-441f7431-9a65-4052-99b2-782d94173794 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 09 00:56:01.134642 dv-cinder-master-3-smb devstack@keystone.service[81525]: warnings.warn(msg) Oct 09 00:56:01.134642 dv-cinder-master-3-smb devstack@keystone.service[81525]: Oct 09 00:56:01.136974 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441f7431-9a65-4052-99b2-782d94173794 admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:56:01.164853 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 798/1622] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Oct 9 00:56:01 2022] POST /identity/v3/users => generated 289 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 09 00:56:01.165943 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d566db93-7951-4cf9-a06c-ae0e798077be admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:56:01.196321 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d566db93-7951-4cf9-a06c-ae0e798077be admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:56:01.212755 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba85a62-6959-4970-8044-e0342f000a20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:56:01.217351 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba85a62-6959-4970-8044-e0342f000a20 admin admin] REQUEST_METHOD: `PUT` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:01.217692 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba85a62-6959-4970-8044-e0342f000a20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:01.218307 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba85a62-6959-4970-8044-e0342f000a20 admin admin] PATH_INFO: `/v3/projects/da478b4d2144422f87958b13a067f5ae/users/d9d1f2999076469eb63edca426186bed/roles/f69dddf26daf4dd79d4c962beb877af5` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:01.265333 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba85a62-6959-4970-8044-e0342f000a20 admin admin] RBAC: Authorizing `identity:create_grant(project_id=da478b4d2144422f87958b13a067f5ae, user_id=d9d1f2999076469eb63edca426186bed, role_id=f69dddf26daf4dd79d4c962beb877af5)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:56:01.275661 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba85a62-6959-4970-8044-e0342f000a20 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:56:01.282973 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-441f7431-9a65-4052-99b2-782d94173794 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '59057ca935124b528f0ae5a48e89f06f'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:56:01.297520 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:56:01.309244 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 799/1623] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Oct 9 00:56:01 2022] PUT /identity/v3/projects/da478b4d2144422f87958b13a067f5ae/users/d9d1f2999076469eb63edca426186bed/roles/f69dddf26daf4dd79d4c962beb877af5 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 00:56:01.310661 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba85a62-6959-4970-8044-e0342f000a20 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:56:01.318921 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-441f7431-9a65-4052-99b2-782d94173794 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '59057ca935124b528f0ae5a48e89f06f'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:56:01.321486 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-441f7431-9a65-4052-99b2-782d94173794 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '59057ca935124b528f0ae5a48e89f06f'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:56:01.323989 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-441f7431-9a65-4052-99b2-782d94173794 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '59057ca935124b528f0ae5a48e89f06f'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:56:01.352870 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-441f7431-9a65-4052-99b2-782d94173794 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '59057ca935124b528f0ae5a48e89f06f'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:56:01.500489 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 825/1624] 10.222.0.15 () {58 vars in 1224 bytes} [Sun Oct 9 00:56:01 2022] DELETE /identity/v3/users/59057ca935124b528f0ae5a48e89f06f => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 00:56:01.505882 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441f7431-9a65-4052-99b2-782d94173794 admin admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:56:01.513806 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-441f7431-9a65-4052-99b2-782d94173794 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:56:01.614048 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba85a62-6959-4970-8044-e0342f000a20 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:56:01.706992 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441f7431-9a65-4052-99b2-782d94173794 admin admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:56:01.715631 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b12e7f-8b72-4083-9b63-775831c1431e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:56:01.716554 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b12e7f-8b72-4083-9b63-775831c1431e admin admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:01.718194 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b12e7f-8b72-4083-9b63-775831c1431e admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:01.718729 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b12e7f-8b72-4083-9b63-775831c1431e admin admin] PATH_INFO: `/v3/roles` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:01.719564 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b12e7f-8b72-4083-9b63-775831c1431e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:56:01.721608 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b12e7f-8b72-4083-9b63-775831c1431e admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:56:01.739350 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 826/1625] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Oct 9 00:56:01 2022] GET /identity/v3/roles => generated 1420 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 09 00:56:01.739350 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2188f681-e5f3-4440-a3fc-b97b1963c1c2 None None] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:01.739350 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2188f681-e5f3-4440-a3fc-b97b1963c1c2 None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:01.739350 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2188f681-e5f3-4440-a3fc-b97b1963c1c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:01.754724 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d592ef5f-cabb-4529-8510-d1e015db576e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:56:01.755756 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d592ef5f-cabb-4529-8510-d1e015db576e admin admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:01.756179 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d592ef5f-cabb-4529-8510-d1e015db576e admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:01.756626 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d592ef5f-cabb-4529-8510-d1e015db576e admin admin] PATH_INFO: `/v3/roles` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:01.757649 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d592ef5f-cabb-4529-8510-d1e015db576e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:56:01.760310 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d592ef5f-cabb-4529-8510-d1e015db576e admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:56:01.777310 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 800/1626] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Oct 9 00:56:01 2022] GET /identity/v3/roles => generated 1420 bytes in 468 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 09 00:56:01.778696 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d592ef5f-cabb-4529-8510-d1e015db576e admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:56:01.779887 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.auth.core [None req-2188f681-e5f3-4440-a3fc-b97b1963c1c2 None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:56:01.782053 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-2188f681-e5f3-4440-a3fc-b97b1963c1c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:56:01.792311 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d592ef5f-cabb-4529-8510-d1e015db576e admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:56:01.797784 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 827/1627] 10.222.0.15 () {58 vars in 958 bytes} [Sun Oct 9 00:56:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:56:01.797784 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2188f681-e5f3-4440-a3fc-b97b1963c1c2 None None] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:56:01.800015 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-2188f681-e5f3-4440-a3fc-b97b1963c1c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:56:01.802019 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da83cae5-7a0f-4482-ace4-c7ec5c782ef0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:56:01.802918 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da83cae5-7a0f-4482-ace4-c7ec5c782ef0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:01.803544 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da83cae5-7a0f-4482-ace4-c7ec5c782ef0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:01.804072 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da83cae5-7a0f-4482-ace4-c7ec5c782ef0 admin admin] PATH_INFO: `/v3/projects/da478b4d2144422f87958b13a067f5ae/users/d9d1f2999076469eb63edca426186bed/roles/f69dddf26daf4dd79d4c962beb877af5` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:01.806374 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da83cae5-7a0f-4482-ace4-c7ec5c782ef0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=da478b4d2144422f87958b13a067f5ae, user_id=d9d1f2999076469eb63edca426186bed, role_id=f69dddf26daf4dd79d4c962beb877af5)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:56:01.809265 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da83cae5-7a0f-4482-ace4-c7ec5c782ef0 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:56:01.817727 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2188f681-e5f3-4440-a3fc-b97b1963c1c2 None None] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:56:01.831908 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 801/1628] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Oct 9 00:56:01 2022] PUT /identity/v3/projects/da478b4d2144422f87958b13a067f5ae/users/d9d1f2999076469eb63edca426186bed/roles/f69dddf26daf4dd79d4c962beb877af5 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 00:56:01.833926 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fae2e69-b982-4247-b4b6-e475e3f5e1cc None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:01.834217 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fae2e69-b982-4247-b4b6-e475e3f5e1cc None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:01.834490 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fae2e69-b982-4247-b4b6-e475e3f5e1cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:01.847714 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:56:01.888923 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-4fae2e69-b982-4247-b4b6-e475e3f5e1cc None None] MFA Rules not processed for user `d9d1f2999076469eb63edca426186bed`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:56:01.893705 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-4fae2e69-b982-4247-b4b6-e475e3f5e1cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:56:01.925765 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c874f32-acfd-4dad-ae4e-044a90bbec7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:56:01.927516 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c874f32-acfd-4dad-ae4e-044a90bbec7c admin admin] REQUEST_METHOD: `PUT` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:01.927664 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c874f32-acfd-4dad-ae4e-044a90bbec7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:01.928036 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c874f32-acfd-4dad-ae4e-044a90bbec7c admin admin] PATH_INFO: `/v3/projects/b8e7bf84f75242209ba6686e1d65a098/users/9cb40859a78d4df4b86fe5c5b20f968d/roles/f69dddf26daf4dd79d4c962beb877af5` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:01.956120 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c874f32-acfd-4dad-ae4e-044a90bbec7c admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8e7bf84f75242209ba6686e1d65a098, user_id=9cb40859a78d4df4b86fe5c5b20f968d, role_id=f69dddf26daf4dd79d4c962beb877af5)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:56:01.959874 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c874f32-acfd-4dad-ae4e-044a90bbec7c admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:56:01.984456 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 828/1629] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Oct 9 00:56:01 2022] PUT /identity/v3/projects/b8e7bf84f75242209ba6686e1d65a098/users/9cb40859a78d4df4b86fe5c5b20f968d/roles/f69dddf26daf4dd79d4c962beb877af5 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 00:56:01.985421 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c874f32-acfd-4dad-ae4e-044a90bbec7c admin admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:56:01.987628 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-2c874f32-acfd-4dad-ae4e-044a90bbec7c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:56:02.021283 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 802/1630] 10.222.0.15 () {58 vars in 958 bytes} [Sun Oct 9 00:56:01 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 09 00:56:02.023515 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fae2e69-b982-4247-b4b6-e475e3f5e1cc None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:56:02.045187 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fae2e69-b982-4247-b4b6-e475e3f5e1cc None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:56:02.066410 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:56:02.146846 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c874f32-acfd-4dad-ae4e-044a90bbec7c admin admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:56:02.179443 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e7df49-0274-4803-a687-d5e4a4f40b30 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4ef90d456d2483e8ddafbe2d4d4fb5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f148d39ced534860abfbe8fc3f98ace4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:56:02.180318 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e7df49-0274-4803-a687-d5e4a4f40b30 service neutron] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:02.180596 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e7df49-0274-4803-a687-d5e4a4f40b30 service neutron] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:02.180867 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e7df49-0274-4803-a687-d5e4a4f40b30 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:02.187056 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cee95c-7c1a-483c-8b43-0b7b1b93f057 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:56:02.188324 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cee95c-7c1a-483c-8b43-0b7b1b93f057 admin admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:02.191207 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cee95c-7c1a-483c-8b43-0b7b1b93f057 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:02.192949 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cee95c-7c1a-483c-8b43-0b7b1b93f057 admin admin] PATH_INFO: `/v3/roles` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:02.195824 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cee95c-7c1a-483c-8b43-0b7b1b93f057 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:56:02.199027 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cee95c-7c1a-483c-8b43-0b7b1b93f057 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:56:02.220585 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e7df49-0274-4803-a687-d5e4a4f40b30 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:56:02.222060 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e7df49-0274-4803-a687-d5e4a4f40b30 service neutron] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:56:02.230584 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 803/1631] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Oct 9 00:56:02 2022] GET /identity/v3/roles => generated 1420 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 09 00:56:02.232487 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cee95c-7c1a-483c-8b43-0b7b1b93f057 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:56:02.235010 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-74cee95c-7c1a-483c-8b43-0b7b1b93f057 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:56:02.250449 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 829/1632] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Oct 9 00:56:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 09 00:56:02.251820 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e7df49-0274-4803-a687-d5e4a4f40b30 service neutron] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:56:02.283525 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e7df49-0274-4803-a687-d5e4a4f40b30 service neutron] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:56:02.316019 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812ffe30-0af7-4d5b-beb4-705213932093 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:56:02.316726 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812ffe30-0af7-4d5b-beb4-705213932093 admin admin] REQUEST_METHOD: `PUT` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:02.317010 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812ffe30-0af7-4d5b-beb4-705213932093 admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:02.317281 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812ffe30-0af7-4d5b-beb4-705213932093 admin admin] PATH_INFO: `/v3/projects/b8e7bf84f75242209ba6686e1d65a098/users/9cb40859a78d4df4b86fe5c5b20f968d/roles/f69dddf26daf4dd79d4c962beb877af5` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:02.322142 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812ffe30-0af7-4d5b-beb4-705213932093 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8e7bf84f75242209ba6686e1d65a098, user_id=9cb40859a78d4df4b86fe5c5b20f968d, role_id=f69dddf26daf4dd79d4c962beb877af5)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:56:02.329315 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812ffe30-0af7-4d5b-beb4-705213932093 admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:56:02.353283 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 830/1633] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Oct 9 00:56:02 2022] PUT /identity/v3/projects/b8e7bf84f75242209ba6686e1d65a098/users/9cb40859a78d4df4b86fe5c5b20f968d/roles/f69dddf26daf4dd79d4c962beb877af5 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 00:56:02.363940 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af41773-f917-47bd-98d9-86ae0330c04a None None] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:02.364070 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af41773-f917-47bd-98d9-86ae0330c04a None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:02.364275 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af41773-f917-47bd-98d9-86ae0330c04a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:02.416246 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cee95c-7c1a-483c-8b43-0b7b1b93f057 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:56:02.444256 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.auth.core [None req-8af41773-f917-47bd-98d9-86ae0330c04a None None] MFA Rules not processed for user `9cb40859a78d4df4b86fe5c5b20f968d`. Rule list: `[]` (Enabled: `True`). {{(pid=81525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:56:02.450088 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-8af41773-f917-47bd-98d9-86ae0330c04a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:56:02.565556 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99eff63-e4b6-4c99-b808-341990eca34c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff7cb78bcd91467abe5c2e2b48aedd1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f148d39ced534860abfbe8fc3f98ace4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:56:02.566711 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99eff63-e4b6-4c99-b808-341990eca34c service cinder] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:02.566986 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99eff63-e4b6-4c99-b808-341990eca34c service cinder] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:02.567421 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99eff63-e4b6-4c99-b808-341990eca34c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:02.648819 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 831/1634] 10.222.0.15 () {58 vars in 958 bytes} [Sun Oct 9 00:56:02 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:56:02.658523 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af41773-f917-47bd-98d9-86ae0330c04a None None] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:56:02.660550 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-8af41773-f917-47bd-98d9-86ae0330c04a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:56:02.667811 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99eff63-e4b6-4c99-b808-341990eca34c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:56:02.674424 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99eff63-e4b6-4c99-b808-341990eca34c service cinder] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:56:02.703830 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 804/1635] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Oct 9 00:56:02 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 473 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 09 00:56:02.716280 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af41773-f917-47bd-98d9-86ae0330c04a None None] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:56:02.727687 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e121ea-1ab5-4b2f-b971-208ce0d144ef service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff7cb78bcd91467abe5c2e2b48aedd1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f148d39ced534860abfbe8fc3f98ace4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:56:02.728378 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e121ea-1ab5-4b2f-b971-208ce0d144ef service cinder] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:02.728719 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e121ea-1ab5-4b2f-b971-208ce0d144ef service cinder] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:02.729049 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e121ea-1ab5-4b2f-b971-208ce0d144ef service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:02.777774 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e121ea-1ab5-4b2f-b971-208ce0d144ef service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:56:02.777774 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e121ea-1ab5-4b2f-b971-208ce0d144ef service cinder] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:56:02.803930 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 832/1636] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Oct 9 00:56:02 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 09 00:56:02.900517 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99eff63-e4b6-4c99-b808-341990eca34c service cinder] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:56:02.913821 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99eff63-e4b6-4c99-b808-341990eca34c service cinder] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:56:02.925972 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6ae7e1-69a1-4dd8-8de7-fadb6c4d68de service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff7cb78bcd91467abe5c2e2b48aedd1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f148d39ced534860abfbe8fc3f98ace4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:56:02.926626 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6ae7e1-69a1-4dd8-8de7-fadb6c4d68de service cinder] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:02.926905 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6ae7e1-69a1-4dd8-8de7-fadb6c4d68de service cinder] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:02.927216 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6ae7e1-69a1-4dd8-8de7-fadb6c4d68de service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:02.931027 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-ba6ae7e1-69a1-4dd8-8de7-fadb6c4d68de service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:56:02.940791 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e121ea-1ab5-4b2f-b971-208ce0d144ef service cinder] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:56:02.952566 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e121ea-1ab5-4b2f-b971-208ce0d144ef service cinder] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:56:02.960698 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6e5e41-b34a-4372-8135-5a6684181fd9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff7cb78bcd91467abe5c2e2b48aedd1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f148d39ced534860abfbe8fc3f98ace4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:56:02.962231 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6e5e41-b34a-4372-8135-5a6684181fd9 service cinder] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:02.962682 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6e5e41-b34a-4372-8135-5a6684181fd9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:02.963320 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6e5e41-b34a-4372-8135-5a6684181fd9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:02.966861 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-fe6e5e41-b34a-4372-8135-5a6684181fd9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:56:02.974902 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:56:02.978265 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:56:03.069973 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6ae7e1-69a1-4dd8-8de7-fadb6c4d68de service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:56:03.074940 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6ae7e1-69a1-4dd8-8de7-fadb6c4d68de service cinder] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:56:03.099128 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 805/1637] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Oct 9 00:56:02 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 09 00:56:03.106773 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6e5e41-b34a-4372-8135-5a6684181fd9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:56:03.108276 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6e5e41-b34a-4372-8135-5a6684181fd9 service cinder] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:56:03.137719 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 833/1638] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Oct 9 00:56:02 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 09 00:56:03.648694 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6ae7e1-69a1-4dd8-8de7-fadb6c4d68de service cinder] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:56:03.650737 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-ba6ae7e1-69a1-4dd8-8de7-fadb6c4d68de service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:56:03.841964 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6ae7e1-69a1-4dd8-8de7-fadb6c4d68de service cinder] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:56:03.848753 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34618f78-1644-4439-88c1-39f9eb38e265 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:56:03.849773 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34618f78-1644-4439-88c1-39f9eb38e265 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:03.849773 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34618f78-1644-4439-88c1-39f9eb38e265 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:03.850135 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34618f78-1644-4439-88c1-39f9eb38e265 admin admin] PATH_INFO: `/v3/projects/cc1d20a7ea25424896d87e572e4cd3f8` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:03.852123 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34618f78-1644-4439-88c1-39f9eb38e265 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cc1d20a7ea25424896d87e572e4cd3f8)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:56:03.853613 dv-cinder-master-3-smb devstack@keystone.service[81524]: WARNING py.warnings [None req-34618f78-1644-4439-88c1-39f9eb38e265 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 09 00:56:03.853613 dv-cinder-master-3-smb devstack@keystone.service[81524]: warnings.warn(msg) Oct 09 00:56:03.853613 dv-cinder-master-3-smb devstack@keystone.service[81524]: Oct 09 00:56:03.855973 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34618f78-1644-4439-88c1-39f9eb38e265 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:56:03.957945 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-34618f78-1644-4439-88c1-39f9eb38e265 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cc1d20a7ea25424896d87e572e4cd3f8', 'request_id': 'req-34618f78-1644-4439-88c1-39f9eb38e265'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:56:03.980482 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-34618f78-1644-4439-88c1-39f9eb38e265 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cc1d20a7ea25424896d87e572e4cd3f8', 'request_id': 'req-34618f78-1644-4439-88c1-39f9eb38e265'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:56:04.009246 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-34618f78-1644-4439-88c1-39f9eb38e265 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cc1d20a7ea25424896d87e572e4cd3f8', 'request_id': 'req-34618f78-1644-4439-88c1-39f9eb38e265'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:56:04.037043 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-34618f78-1644-4439-88c1-39f9eb38e265 admin admin] The token cache is being invalidate because project cc1d20a7ea25424896d87e572e4cd3f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81524) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 09 00:56:04.037470 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-34618f78-1644-4439-88c1-39f9eb38e265 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:56:04.039401 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-34618f78-1644-4439-88c1-39f9eb38e265 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:56:04.047705 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 806/1639] 10.222.0.15 () {58 vars in 1233 bytes} [Sun Oct 9 00:56:03 2022] DELETE /identity/v3/projects/cc1d20a7ea25424896d87e572e4cd3f8 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 00:56:04.051383 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb5af03-cbea-49d7-b5e4-b00de0e92214 None None] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:04.051925 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb5af03-cbea-49d7-b5e4-b00de0e92214 None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:04.052005 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb5af03-cbea-49d7-b5e4-b00de0e92214 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:04.099183 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.auth.core [None req-7cb5af03-cbea-49d7-b5e4-b00de0e92214 None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:56:04.104024 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-7cb5af03-cbea-49d7-b5e4-b00de0e92214 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:56:04.210672 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 834/1640] 10.222.0.15 () {58 vars in 958 bytes} [Sun Oct 9 00:56:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:56:04.212773 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37e453e-a005-483a-8c68-2b1fd676d403 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:04.212888 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37e453e-a005-483a-8c68-2b1fd676d403 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:04.213248 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37e453e-a005-483a-8c68-2b1fd676d403 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:04.247637 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-c37e453e-a005-483a-8c68-2b1fd676d403 None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:56:04.249936 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-c37e453e-a005-483a-8c68-2b1fd676d403 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:56:04.274411 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 807/1641] 10.222.0.15 () {58 vars in 958 bytes} [Sun Oct 9 00:56:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:56:04.279913 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb5af03-cbea-49d7-b5e4-b00de0e92214 None None] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:56:04.293401 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb5af03-cbea-49d7-b5e4-b00de0e92214 None None] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:56:04.299374 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3dbd893-14d1-4148-8fb5-a3652debaa93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:56:04.300191 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dbd893-14d1-4148-8fb5-a3652debaa93 admin admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:04.300475 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dbd893-14d1-4148-8fb5-a3652debaa93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:04.300747 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dbd893-14d1-4148-8fb5-a3652debaa93 admin admin] PATH_INFO: `/v3/domains` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:04.301427 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3dbd893-14d1-4148-8fb5-a3652debaa93 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:56:04.301826 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3dbd893-14d1-4148-8fb5-a3652debaa93 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:56:04.304062 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3dbd893-14d1-4148-8fb5-a3652debaa93 admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:56:04.323368 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 835/1642] 10.222.0.15 () {58 vars in 1153 bytes} [Sun Oct 9 00:56:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:56:04.324578 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37e453e-a005-483a-8c68-2b1fd676d403 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:56:04.335797 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37e453e-a005-483a-8c68-2b1fd676d403 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:56:04.341907 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38029b22-a600-4eed-aa75-6c01abaaac26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:56:04.342750 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38029b22-a600-4eed-aa75-6c01abaaac26 admin admin] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:04.343033 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38029b22-a600-4eed-aa75-6c01abaaac26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:04.343327 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38029b22-a600-4eed-aa75-6c01abaaac26 admin admin] PATH_INFO: `/v3/projects` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:04.344001 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38029b22-a600-4eed-aa75-6c01abaaac26 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:56:04.345997 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38029b22-a600-4eed-aa75-6c01abaaac26 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:56:04.389704 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 808/1643] 10.222.0.15 () {60 vars in 1153 bytes} [Sun Oct 9 00:56:04 2022] POST /identity/v3/projects => generated 377 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 09 00:56:04.391952 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3dbd893-14d1-4148-8fb5-a3652debaa93 admin admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:56:04.408176 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3dbd893-14d1-4148-8fb5-a3652debaa93 admin admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:56:04.500378 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5f5432-98b4-4328-88e9-21ef68016e54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:56:04.502912 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5f5432-98b4-4328-88e9-21ef68016e54 admin admin] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:04.502912 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5f5432-98b4-4328-88e9-21ef68016e54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:04.502912 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5f5432-98b4-4328-88e9-21ef68016e54 admin admin] PATH_INFO: `/v3/users` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:04.503368 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5f5432-98b4-4328-88e9-21ef68016e54 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:56:04.506779 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5f5432-98b4-4328-88e9-21ef68016e54 admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:56:04.552122 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 836/1644] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Oct 9 00:56:04 2022] POST /identity/v3/users => generated 289 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 09 00:56:04.557495 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38029b22-a600-4eed-aa75-6c01abaaac26 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:56:04.582981 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38029b22-a600-4eed-aa75-6c01abaaac26 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:56:04.597366 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe826c83-db3d-404a-803a-7d51c52f6eb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:56:04.598587 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe826c83-db3d-404a-803a-7d51c52f6eb2 admin admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:04.599001 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe826c83-db3d-404a-803a-7d51c52f6eb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:04.599436 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe826c83-db3d-404a-803a-7d51c52f6eb2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:04.603557 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe826c83-db3d-404a-803a-7d51c52f6eb2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:56:04.609548 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe826c83-db3d-404a-803a-7d51c52f6eb2 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:56:04.647041 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 809/1645] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Oct 9 00:56:04 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 09 00:56:04.648467 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5f5432-98b4-4328-88e9-21ef68016e54 admin admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:56:04.663295 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5f5432-98b4-4328-88e9-21ef68016e54 admin admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:56:04.680010 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ae2c1b-330f-45da-9ba7-abd7eff5d213 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:56:04.681418 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ae2c1b-330f-45da-9ba7-abd7eff5d213 admin admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:04.682969 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ae2c1b-330f-45da-9ba7-abd7eff5d213 admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:04.683854 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ae2c1b-330f-45da-9ba7-abd7eff5d213 admin admin] PATH_INFO: `/v3/roles` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:04.685246 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ae2c1b-330f-45da-9ba7-abd7eff5d213 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:56:04.688814 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ae2c1b-330f-45da-9ba7-abd7eff5d213 admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:56:04.708964 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 837/1646] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Oct 9 00:56:04 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 09 00:56:04.714983 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe826c83-db3d-404a-803a-7d51c52f6eb2 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:56:04.730746 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe826c83-db3d-404a-803a-7d51c52f6eb2 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:56:04.736177 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c603d6-2955-48bd-acff-ae3d433df2b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:56:04.736873 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c603d6-2955-48bd-acff-ae3d433df2b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:04.737148 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c603d6-2955-48bd-acff-ae3d433df2b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:04.737417 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c603d6-2955-48bd-acff-ae3d433df2b2 admin admin] PATH_INFO: `/v3/projects/58cbd21b11d546c8901c53c2ab5862fc/users/4954df36b4a7436e8c19418af919d21d/roles/afb0a01183d9497795eaa4fa1a4046ae` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:04.758353 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:56:04.792102 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c603d6-2955-48bd-acff-ae3d433df2b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=58cbd21b11d546c8901c53c2ab5862fc, user_id=4954df36b4a7436e8c19418af919d21d, role_id=afb0a01183d9497795eaa4fa1a4046ae)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:56:04.813036 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c603d6-2955-48bd-acff-ae3d433df2b2 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:56:04.888087 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 810/1647] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Oct 9 00:56:04 2022] PUT /identity/v3/projects/58cbd21b11d546c8901c53c2ab5862fc/users/4954df36b4a7436e8c19418af919d21d/roles/afb0a01183d9497795eaa4fa1a4046ae => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 00:56:04.892826 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021fb277-bffa-4882-851f-a94613dbb105 None None] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:04.893332 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021fb277-bffa-4882-851f-a94613dbb105 None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:04.893726 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021fb277-bffa-4882-851f-a94613dbb105 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:04.991627 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:56:05.012073 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.auth.core [None req-021fb277-bffa-4882-851f-a94613dbb105 None None] MFA Rules not processed for user `4954df36b4a7436e8c19418af919d21d`. Rule list: `[]` (Enabled: `True`). {{(pid=81525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:56:05.019947 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-021fb277-bffa-4882-851f-a94613dbb105 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:56:05.245393 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 838/1648] 10.222.0.15 () {58 vars in 958 bytes} [Sun Oct 9 00:56:04 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 353 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:56:05.247764 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c603d6-2955-48bd-acff-ae3d433df2b2 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:56:05.249910 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-e2c603d6-2955-48bd-acff-ae3d433df2b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:56:05.425922 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c603d6-2955-48bd-acff-ae3d433df2b2 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:56:05.437242 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ed42dd-fcd9-4d27-b8ff-456b74bcc654 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd88a9f3d154c4cf98369972a0561b2b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f148d39ced534860abfbe8fc3f98ace4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:56:05.437952 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ed42dd-fcd9-4d27-b8ff-456b74bcc654 service glance] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:05.438396 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ed42dd-fcd9-4d27-b8ff-456b74bcc654 service glance] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:05.438678 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ed42dd-fcd9-4d27-b8ff-456b74bcc654 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:05.462635 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ed42dd-fcd9-4d27-b8ff-456b74bcc654 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:56:05.469098 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ed42dd-fcd9-4d27-b8ff-456b74bcc654 service glance] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:56:05.485803 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 811/1649] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Oct 9 00:56:05 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 09 00:56:07.736944 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5847a6f3-5368-4f9f-a0a6-709fabc47c64 None None] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:07.737548 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5847a6f3-5368-4f9f-a0a6-709fabc47c64 None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:07.737548 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5847a6f3-5368-4f9f-a0a6-709fabc47c64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:07.900626 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.auth.core [None req-5847a6f3-5368-4f9f-a0a6-709fabc47c64 None None] MFA Rules not processed for user `3a6cfef106c84f759ce0874be77f7380`. Rule list: `[]` (Enabled: `True`). {{(pid=81525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:56:07.903303 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-5847a6f3-5368-4f9f-a0a6-709fabc47c64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:56:08.051471 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 839/1650] 10.222.0.15 () {58 vars in 1009 bytes} [Sun Oct 9 00:56:07 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 315 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:56:08.096134 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ed42dd-fcd9-4d27-b8ff-456b74bcc654 service glance] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:56:08.097650 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-57ed42dd-fcd9-4d27-b8ff-456b74bcc654 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:56:08.360387 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ed42dd-fcd9-4d27-b8ff-456b74bcc654 service glance] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:56:08.378959 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ee2da5-501d-4618-a3d1-56bfac28750f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:56:08.379959 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ee2da5-501d-4618-a3d1-56bfac28750f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:08.380420 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ee2da5-501d-4618-a3d1-56bfac28750f admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:08.382007 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ee2da5-501d-4618-a3d1-56bfac28750f admin admin] PATH_INFO: `/v3/users/3f8fd6011aef4e99a414efc607472a07` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:08.384006 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ee2da5-501d-4618-a3d1-56bfac28750f admin admin] RBAC: Authorizing `identity:delete_user(user_id=3f8fd6011aef4e99a414efc607472a07)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:56:08.388677 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ee2da5-501d-4618-a3d1-56bfac28750f admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:56:08.391396 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5847a6f3-5368-4f9f-a0a6-709fabc47c64 None None] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:56:08.394278 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-5847a6f3-5368-4f9f-a0a6-709fabc47c64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:56:08.503838 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-a9ee2da5-501d-4618-a3d1-56bfac28750f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3f8fd6011aef4e99a414efc607472a07'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:56:08.552361 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-a9ee2da5-501d-4618-a3d1-56bfac28750f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3f8fd6011aef4e99a414efc607472a07'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:56:08.555102 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-a9ee2da5-501d-4618-a3d1-56bfac28750f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3f8fd6011aef4e99a414efc607472a07'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:56:08.560997 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-a9ee2da5-501d-4618-a3d1-56bfac28750f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3f8fd6011aef4e99a414efc607472a07'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:56:08.588231 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-a9ee2da5-501d-4618-a3d1-56bfac28750f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3f8fd6011aef4e99a414efc607472a07'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:56:08.597751 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:56:08.651879 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:56:08.661011 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 812/1651] 10.222.0.15 () {58 vars in 1224 bytes} [Sun Oct 9 00:56:08 2022] DELETE /identity/v3/users/3f8fd6011aef4e99a414efc607472a07 => generated 0 bytes in 565 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 00:56:08.667735 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805904b7-a637-452d-a820-ad5047cdbd58 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:08.668095 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805904b7-a637-452d-a820-ad5047cdbd58 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:08.668380 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805904b7-a637-452d-a820-ad5047cdbd58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:08.678111 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5847a6f3-5368-4f9f-a0a6-709fabc47c64 None None] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:56:08.739631 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-805904b7-a637-452d-a820-ad5047cdbd58 None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:56:08.740911 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-805904b7-a637-452d-a820-ad5047cdbd58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:56:08.850677 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07f3bf4-37e1-4b93-8f13-affcc6e10b25 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4c467943b8f4d31a2f067ca6ed3b25c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f148d39ced534860abfbe8fc3f98ace4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:56:08.852827 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07f3bf4-37e1-4b93-8f13-affcc6e10b25 service swift] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:08.852936 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07f3bf4-37e1-4b93-8f13-affcc6e10b25 service swift] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:08.853339 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07f3bf4-37e1-4b93-8f13-affcc6e10b25 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:08.858647 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-c07f3bf4-37e1-4b93-8f13-affcc6e10b25 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:56:08.998189 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 813/1652] 10.222.0.15 () {58 vars in 958 bytes} [Sun Oct 9 00:56:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 332 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:56:09.042000 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805904b7-a637-452d-a820-ad5047cdbd58 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:56:09.043535 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-805904b7-a637-452d-a820-ad5047cdbd58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:56:09.112603 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07f3bf4-37e1-4b93-8f13-affcc6e10b25 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:56:09.119588 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07f3bf4-37e1-4b93-8f13-affcc6e10b25 service swift] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:56:09.150348 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 840/1653] 10.222.0.15 () {60 vars in 1384 bytes} [Sun Oct 9 00:56:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 759 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 09 00:56:09.209480 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805904b7-a637-452d-a820-ad5047cdbd58 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:56:09.228664 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d20acad-4050-4235-ad4d-59f4076b78b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4ef90d456d2483e8ddafbe2d4d4fb5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f148d39ced534860abfbe8fc3f98ace4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:56:09.229332 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d20acad-4050-4235-ad4d-59f4076b78b0 service neutron] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:09.229593 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d20acad-4050-4235-ad4d-59f4076b78b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:09.235674 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d20acad-4050-4235-ad4d-59f4076b78b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:09.272128 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d20acad-4050-4235-ad4d-59f4076b78b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:56:09.277260 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d20acad-4050-4235-ad4d-59f4076b78b0 service neutron] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:56:09.308313 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 814/1654] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Oct 9 00:56:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 09 00:56:11.047610 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b8d9df-891b-4401-a54e-cadb3992ea9f None None] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:11.049270 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b8d9df-891b-4401-a54e-cadb3992ea9f None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:11.050180 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b8d9df-891b-4401-a54e-cadb3992ea9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:11.114369 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.auth.core [None req-60b8d9df-891b-4401-a54e-cadb3992ea9f None None] MFA Rules not processed for user `6a2d7675a1fe4301b2920c86a35312dd`. Rule list: `[]` (Enabled: `True`). {{(pid=81525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:56:11.115934 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-60b8d9df-891b-4401-a54e-cadb3992ea9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:56:11.175296 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d20acad-4050-4235-ad4d-59f4076b78b0 service neutron] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:56:11.177435 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-8d20acad-4050-4235-ad4d-59f4076b78b0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:56:11.199584 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d20acad-4050-4235-ad4d-59f4076b78b0 service neutron] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:56:11.213586 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fd5483-7964-492b-91eb-d87c499465d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:56:11.218238 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fd5483-7964-492b-91eb-d87c499465d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:11.218856 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fd5483-7964-492b-91eb-d87c499465d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:11.220218 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fd5483-7964-492b-91eb-d87c499465d5 admin admin] PATH_INFO: `/v3/projects/03ac230f86cb4d389e7112ec38bae86e` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:11.225005 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fd5483-7964-492b-91eb-d87c499465d5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=03ac230f86cb4d389e7112ec38bae86e)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:56:11.229935 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fd5483-7964-492b-91eb-d87c499465d5 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:56:11.325665 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 841/1655] 10.222.0.15 () {58 vars in 958 bytes} [Sun Oct 9 00:56:11 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:56:11.392116 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45747560-1458-43bc-b7fd-a0af778afe53 None None] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:11.393237 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45747560-1458-43bc-b7fd-a0af778afe53 None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:11.393678 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45747560-1458-43bc-b7fd-a0af778afe53 None None] PATH_INFO: `/` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:11.398088 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 842/1656] 10.222.0.15 () {54 vars in 961 bytes} [Sun Oct 9 00:56:11 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 09 00:56:11.404279 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-13fd5483-7964-492b-91eb-d87c499465d5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '03ac230f86cb4d389e7112ec38bae86e', 'request_id': 'req-13fd5483-7964-492b-91eb-d87c499465d5'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:56:11.424446 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c035ea-df93-4ea2-bd00-d1cf15415e20 None None] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:11.425497 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c035ea-df93-4ea2-bd00-d1cf15415e20 None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:11.425497 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c035ea-df93-4ea2-bd00-d1cf15415e20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:11.430327 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-13fd5483-7964-492b-91eb-d87c499465d5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '03ac230f86cb4d389e7112ec38bae86e', 'request_id': 'req-13fd5483-7964-492b-91eb-d87c499465d5'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:56:11.461675 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-13fd5483-7964-492b-91eb-d87c499465d5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '03ac230f86cb4d389e7112ec38bae86e', 'request_id': 'req-13fd5483-7964-492b-91eb-d87c499465d5'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:56:11.504602 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-13fd5483-7964-492b-91eb-d87c499465d5 admin admin] The token cache is being invalidate because project 03ac230f86cb4d389e7112ec38bae86e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81524) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 09 00:56:11.506612 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-13fd5483-7964-492b-91eb-d87c499465d5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:56:11.510273 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-13fd5483-7964-492b-91eb-d87c499465d5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:56:11.516710 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 815/1657] 10.222.0.15 () {58 vars in 1233 bytes} [Sun Oct 9 00:56:11 2022] DELETE /identity/v3/projects/03ac230f86cb4d389e7112ec38bae86e => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 09 00:56:11.520914 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fd5483-7964-492b-91eb-d87c499465d5 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:56:11.526457 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-13fd5483-7964-492b-91eb-d87c499465d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:56:11.578535 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.auth.core [None req-51c035ea-df93-4ea2-bd00-d1cf15415e20 None None] MFA Rules not processed for user `4ac83d57fba841e0a666710732249c49`. Rule list: `[]` (Enabled: `True`). {{(pid=81525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:56:11.580165 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-51c035ea-df93-4ea2-bd00-d1cf15415e20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:56:11.590740 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:56:11.605391 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:56:11.777795 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fd5483-7964-492b-91eb-d87c499465d5 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:56:11.785979 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d52fa80-7fca-41ca-b526-3dece498dc27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:56:11.787130 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d52fa80-7fca-41ca-b526-3dece498dc27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:11.787303 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d52fa80-7fca-41ca-b526-3dece498dc27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:11.787773 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d52fa80-7fca-41ca-b526-3dece498dc27 admin admin] PATH_INFO: `/v3/users/d9d1f2999076469eb63edca426186bed` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:11.789489 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d52fa80-7fca-41ca-b526-3dece498dc27 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d9d1f2999076469eb63edca426186bed)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:56:11.793391 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d52fa80-7fca-41ca-b526-3dece498dc27 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:56:11.850688 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 843/1658] 10.222.0.15 () {58 vars in 1058 bytes} [Sun Oct 9 00:56:11 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 427 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 09 00:56:11.852414 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b88c12-bac1-4df7-ab95-163e937c4597 None None] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:11.852700 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b88c12-bac1-4df7-ab95-163e937c4597 None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:11.853002 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b88c12-bac1-4df7-ab95-163e937c4597 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:11.906774 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-1d52fa80-7fca-41ca-b526-3dece498dc27 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd9d1f2999076469eb63edca426186bed'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:56:11.930583 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-1d52fa80-7fca-41ca-b526-3dece498dc27 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd9d1f2999076469eb63edca426186bed'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:56:11.934471 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-1d52fa80-7fca-41ca-b526-3dece498dc27 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd9d1f2999076469eb63edca426186bed'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:56:11.935662 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-1d52fa80-7fca-41ca-b526-3dece498dc27 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd9d1f2999076469eb63edca426186bed'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:56:11.953765 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-1d52fa80-7fca-41ca-b526-3dece498dc27 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd9d1f2999076469eb63edca426186bed'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:56:11.963223 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.auth.core [None req-68b88c12-bac1-4df7-ab95-163e937c4597 None None] MFA Rules not processed for user `08d6c41fef5c467e9826e5eabbbccc65`. Rule list: `[]` (Enabled: `True`). {{(pid=81525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:56:11.963810 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-68b88c12-bac1-4df7-ab95-163e937c4597 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:56:12.001292 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 816/1659] 10.222.0.15 () {58 vars in 1224 bytes} [Sun Oct 9 00:56:11 2022] DELETE /identity/v3/users/d9d1f2999076469eb63edca426186bed => generated 0 bytes in 481 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 00:56:12.004577 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d52fa80-7fca-41ca-b526-3dece498dc27 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:56:12.006594 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-1d52fa80-7fca-41ca-b526-3dece498dc27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:56:12.125070 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 844/1660] 10.222.0.15 () {58 vars in 958 bytes} [Sun Oct 9 00:56:11 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:56:12.136557 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca53f0f5-99c4-4df5-9fd4-a302e98a378d None None] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:12.137330 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca53f0f5-99c4-4df5-9fd4-a302e98a378d None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:12.137848 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca53f0f5-99c4-4df5-9fd4-a302e98a378d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:12.181544 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.auth.core [None req-ca53f0f5-99c4-4df5-9fd4-a302e98a378d None None] MFA Rules not processed for user `08d6c41fef5c467e9826e5eabbbccc65`. Rule list: `[]` (Enabled: `True`). {{(pid=81525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:56:12.184859 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-ca53f0f5-99c4-4df5-9fd4-a302e98a378d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:56:12.252227 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d52fa80-7fca-41ca-b526-3dece498dc27 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:56:12.273050 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121bf277-59af-49b0-978f-9dd7083c16e1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ac83d57fba841e0a666710732249c49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f148d39ced534860abfbe8fc3f98ace4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:56:12.273860 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121bf277-59af-49b0-978f-9dd7083c16e1 service nova] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:12.274265 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121bf277-59af-49b0-978f-9dd7083c16e1 service nova] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:12.275300 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121bf277-59af-49b0-978f-9dd7083c16e1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:12.285687 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-121bf277-59af-49b0-978f-9dd7083c16e1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:56:12.329806 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 845/1661] 10.222.0.15 () {58 vars in 958 bytes} [Sun Oct 9 00:56:12 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:56:12.379168 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2e19af-1927-4be3-ae83-3d4f426fd2ed None None] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:12.379168 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2e19af-1927-4be3-ae83-3d4f426fd2ed None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:12.379168 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2e19af-1927-4be3-ae83-3d4f426fd2ed None None] PATH_INFO: `/` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:12.382540 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 846/1662] 10.222.0.15 () {54 vars in 961 bytes} [Sun Oct 9 00:56:12 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:56:12.398465 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75050b3c-0fc5-41b9-bfb4-4ea2c57c4dbb None None] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:12.398914 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75050b3c-0fc5-41b9-bfb4-4ea2c57c4dbb None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:12.399421 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75050b3c-0fc5-41b9-bfb4-4ea2c57c4dbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:12.419961 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:56:12.475297 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.auth.core [None req-75050b3c-0fc5-41b9-bfb4-4ea2c57c4dbb None None] MFA Rules not processed for user `4ac83d57fba841e0a666710732249c49`. Rule list: `[]` (Enabled: `True`). {{(pid=81525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:56:12.480214 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-75050b3c-0fc5-41b9-bfb4-4ea2c57c4dbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:56:12.511631 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 847/1663] 10.222.0.15 () {58 vars in 1058 bytes} [Sun Oct 9 00:56:12 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Oct 09 00:56:12.512617 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75050b3c-0fc5-41b9-bfb4-4ea2c57c4dbb None None] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:56:12.535809 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121bf277-59af-49b0-978f-9dd7083c16e1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:56:12.537026 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75050b3c-0fc5-41b9-bfb4-4ea2c57c4dbb None None] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:56:12.537552 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121bf277-59af-49b0-978f-9dd7083c16e1 service nova] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:56:12.544068 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91cf834-d10f-4c2e-bdc6-28ab18a469fd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ac83d57fba841e0a666710732249c49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f148d39ced534860abfbe8fc3f98ace4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:56:12.545032 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91cf834-d10f-4c2e-bdc6-28ab18a469fd service nova] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:12.545313 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91cf834-d10f-4c2e-bdc6-28ab18a469fd service nova] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:12.545729 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91cf834-d10f-4c2e-bdc6-28ab18a469fd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:12.557953 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91cf834-d10f-4c2e-bdc6-28ab18a469fd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:56:12.559901 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91cf834-d10f-4c2e-bdc6-28ab18a469fd service nova] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:56:12.582242 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 817/1664] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Oct 9 00:56:12 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 574 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 09 00:56:12.591384 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 848/1665] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Oct 9 00:56:12 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 09 00:56:13.102319 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a5fbf9-df9a-4cb5-8f5c-f1a0f01bede2 None None] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:13.102593 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a5fbf9-df9a-4cb5-8f5c-f1a0f01bede2 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:13.102891 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a5fbf9-df9a-4cb5-8f5c-f1a0f01bede2 None None] PATH_INFO: `/` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:13.108986 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 818/1666] 10.222.0.15 () {54 vars in 912 bytes} [Sun Oct 9 00:56:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:56:13.114113 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e41731-f6a2-4123-925c-197012830ce3 None None] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:13.114450 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e41731-f6a2-4123-925c-197012830ce3 None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:13.114693 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e41731-f6a2-4123-925c-197012830ce3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:13.156666 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.auth.core [None req-d0e41731-f6a2-4123-925c-197012830ce3 None None] MFA Rules not processed for user `4ac83d57fba841e0a666710732249c49`. Rule list: `[]` (Enabled: `True`). {{(pid=81525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:56:13.160954 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-d0e41731-f6a2-4123-925c-197012830ce3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:56:13.184552 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 849/1667] 10.222.0.15 () {58 vars in 1009 bytes} [Sun Oct 9 00:56:13 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 09 00:56:13.198052 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a5fbf9-df9a-4cb5-8f5c-f1a0f01bede2 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:56:13.199993 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-b1a5fbf9-df9a-4cb5-8f5c-f1a0f01bede2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:56:13.430187 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a5fbf9-df9a-4cb5-8f5c-f1a0f01bede2 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:56:13.439066 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf983970-cdc9-4040-a16b-98fce26a3549 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd88a9f3d154c4cf98369972a0561b2b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f148d39ced534860abfbe8fc3f98ace4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:56:13.442622 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf983970-cdc9-4040-a16b-98fce26a3549 service glance] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:13.442918 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf983970-cdc9-4040-a16b-98fce26a3549 service glance] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:13.443243 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf983970-cdc9-4040-a16b-98fce26a3549 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:13.494487 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf983970-cdc9-4040-a16b-98fce26a3549 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:56:13.501679 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf983970-cdc9-4040-a16b-98fce26a3549 service glance] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:56:13.580735 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 819/1668] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Oct 9 00:56:13 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 09 00:56:13.754585 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e41731-f6a2-4123-925c-197012830ce3 None None] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:56:13.756645 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-d0e41731-f6a2-4123-925c-197012830ce3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:56:13.786537 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:56:13.889154 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e41731-f6a2-4123-925c-197012830ce3 None None] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:56:13.895555 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8bc80b-9ee6-438c-9183-6ad461a91031 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:56:13.896563 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8bc80b-9ee6-438c-9183-6ad461a91031 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:13.896716 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8bc80b-9ee6-438c-9183-6ad461a91031 admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:13.897041 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8bc80b-9ee6-438c-9183-6ad461a91031 admin admin] PATH_INFO: `/v3/users/9c1cdb07fd174a69bec973608836db9e` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:13.898531 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8bc80b-9ee6-438c-9183-6ad461a91031 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c1cdb07fd174a69bec973608836db9e)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:56:13.901244 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8bc80b-9ee6-438c-9183-6ad461a91031 admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:56:14.004186 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-9f8bc80b-9ee6-438c-9183-6ad461a91031 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c1cdb07fd174a69bec973608836db9e'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:56:14.022874 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-9f8bc80b-9ee6-438c-9183-6ad461a91031 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c1cdb07fd174a69bec973608836db9e'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:56:14.023526 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-9f8bc80b-9ee6-438c-9183-6ad461a91031 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c1cdb07fd174a69bec973608836db9e'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:56:14.024288 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-9f8bc80b-9ee6-438c-9183-6ad461a91031 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c1cdb07fd174a69bec973608836db9e'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:56:14.039949 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-9f8bc80b-9ee6-438c-9183-6ad461a91031 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c1cdb07fd174a69bec973608836db9e'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:56:14.078572 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 850/1669] 10.222.0.15 () {58 vars in 1224 bytes} [Sun Oct 9 00:56:13 2022] DELETE /identity/v3/users/9c1cdb07fd174a69bec973608836db9e => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 00:56:14.080449 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8691195f-8c81-416c-b5f2-a9c3f44a20cc None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:14.086952 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8691195f-8c81-416c-b5f2-a9c3f44a20cc None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:14.089234 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8691195f-8c81-416c-b5f2-a9c3f44a20cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:14.134388 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-8691195f-8c81-416c-b5f2-a9c3f44a20cc None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:56:14.135688 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-8691195f-8c81-416c-b5f2-a9c3f44a20cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:56:14.319777 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 820/1670] 10.222.0.15 () {58 vars in 958 bytes} [Sun Oct 9 00:56:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:56:14.346028 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8bc80b-9ee6-438c-9183-6ad461a91031 admin admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:56:14.347618 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-9f8bc80b-9ee6-438c-9183-6ad461a91031 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:56:14.489515 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8bc80b-9ee6-438c-9183-6ad461a91031 admin admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:56:14.498309 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b9a071-ded9-4b9d-875f-579f9cc3d27e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4ef90d456d2483e8ddafbe2d4d4fb5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f148d39ced534860abfbe8fc3f98ace4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:56:14.498959 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b9a071-ded9-4b9d-875f-579f9cc3d27e service neutron] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:14.499229 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b9a071-ded9-4b9d-875f-579f9cc3d27e service neutron] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:14.501045 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b9a071-ded9-4b9d-875f-579f9cc3d27e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:14.531125 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b9a071-ded9-4b9d-875f-579f9cc3d27e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:56:14.534172 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b9a071-ded9-4b9d-875f-579f9cc3d27e service neutron] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:56:14.561949 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 851/1671] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Oct 9 00:56:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 09 00:56:14.598727 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa11720-4f48-460c-b034-e7f9958d0214 None None] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:14.599230 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa11720-4f48-460c-b034-e7f9958d0214 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:14.599230 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa11720-4f48-460c-b034-e7f9958d0214 None None] PATH_INFO: `/` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:14.601212 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 821/1672] 10.222.0.15 () {54 vars in 912 bytes} [Sun Oct 9 00:56:14 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:56:14.610015 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1692a8-1a33-44a8-8f2b-4cf5021613d9 None None] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:14.610287 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1692a8-1a33-44a8-8f2b-4cf5021613d9 None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:14.610584 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1692a8-1a33-44a8-8f2b-4cf5021613d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:14.709233 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.auth.core [None req-7b1692a8-1a33-44a8-8f2b-4cf5021613d9 None None] MFA Rules not processed for user `f4ef90d456d2483e8ddafbe2d4d4fb5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:56:14.711064 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-7b1692a8-1a33-44a8-8f2b-4cf5021613d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:56:14.737442 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 852/1673] 10.222.0.15 () {58 vars in 1009 bytes} [Sun Oct 9 00:56:14 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:56:14.794903 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa11720-4f48-460c-b034-e7f9958d0214 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:56:14.822253 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa11720-4f48-460c-b034-e7f9958d0214 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:56:14.835779 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4317dc38-e427-400d-857d-d4ab596230f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4ef90d456d2483e8ddafbe2d4d4fb5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f148d39ced534860abfbe8fc3f98ace4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:56:14.836748 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4317dc38-e427-400d-857d-d4ab596230f4 service neutron] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:14.837232 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4317dc38-e427-400d-857d-d4ab596230f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:14.837704 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4317dc38-e427-400d-857d-d4ab596230f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:14.861365 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4317dc38-e427-400d-857d-d4ab596230f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:56:14.863540 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4317dc38-e427-400d-857d-d4ab596230f4 service neutron] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:56:14.884779 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 822/1674] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Oct 9 00:56:14 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 09 00:56:14.946629 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1692a8-1a33-44a8-8f2b-4cf5021613d9 None None] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:56:14.950939 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-7b1692a8-1a33-44a8-8f2b-4cf5021613d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:56:14.991402 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1692a8-1a33-44a8-8f2b-4cf5021613d9 None None] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:56:15.011457 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2694bf9-d6e1-4d0b-bb84-e76e79f3d9a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:56:15.012128 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2694bf9-d6e1-4d0b-bb84-e76e79f3d9a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:15.012401 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2694bf9-d6e1-4d0b-bb84-e76e79f3d9a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:15.012666 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2694bf9-d6e1-4d0b-bb84-e76e79f3d9a7 admin admin] PATH_INFO: `/v3/projects/da478b4d2144422f87958b13a067f5ae` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:15.016144 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2694bf9-d6e1-4d0b-bb84-e76e79f3d9a7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=da478b4d2144422f87958b13a067f5ae)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:56:15.022139 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2694bf9-d6e1-4d0b-bb84-e76e79f3d9a7 admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:56:15.058224 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:56:15.211982 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-d2694bf9-d6e1-4d0b-bb84-e76e79f3d9a7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da478b4d2144422f87958b13a067f5ae', 'request_id': 'req-d2694bf9-d6e1-4d0b-bb84-e76e79f3d9a7'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:56:15.246767 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-d2694bf9-d6e1-4d0b-bb84-e76e79f3d9a7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da478b4d2144422f87958b13a067f5ae', 'request_id': 'req-d2694bf9-d6e1-4d0b-bb84-e76e79f3d9a7'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:56:15.278663 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-d2694bf9-d6e1-4d0b-bb84-e76e79f3d9a7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da478b4d2144422f87958b13a067f5ae', 'request_id': 'req-d2694bf9-d6e1-4d0b-bb84-e76e79f3d9a7'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:56:15.294079 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-d2694bf9-d6e1-4d0b-bb84-e76e79f3d9a7 admin admin] The token cache is being invalidate because project da478b4d2144422f87958b13a067f5ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81525) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 09 00:56:15.295038 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-d2694bf9-d6e1-4d0b-bb84-e76e79f3d9a7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:56:15.295898 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-d2694bf9-d6e1-4d0b-bb84-e76e79f3d9a7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:56:15.302241 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 853/1675] 10.222.0.15 () {58 vars in 1233 bytes} [Sun Oct 9 00:56:14 2022] DELETE /identity/v3/projects/da478b4d2144422f87958b13a067f5ae => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 00:56:15.304005 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039ddc4f-0b67-4dbd-b616-2a3f9e8f01d8 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:15.304554 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039ddc4f-0b67-4dbd-b616-2a3f9e8f01d8 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:15.305033 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039ddc4f-0b67-4dbd-b616-2a3f9e8f01d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:15.349434 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-039ddc4f-0b67-4dbd-b616-2a3f9e8f01d8 None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:56:15.357213 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-039ddc4f-0b67-4dbd-b616-2a3f9e8f01d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:56:15.517259 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:56:15.558288 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 823/1676] 10.222.0.15 () {58 vars in 958 bytes} [Sun Oct 9 00:56:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 09 00:56:15.567994 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbf638b-707b-42fe-9984-c720ead651ef None None] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:15.568472 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbf638b-707b-42fe-9984-c720ead651ef None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:15.568569 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbf638b-707b-42fe-9984-c720ead651ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:15.619671 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.auth.core [None req-dcbf638b-707b-42fe-9984-c720ead651ef None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:56:15.621187 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-dcbf638b-707b-42fe-9984-c720ead651ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:56:15.644456 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 854/1677] 10.222.0.15 () {58 vars in 958 bytes} [Sun Oct 9 00:56:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:56:15.645347 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039ddc4f-0b67-4dbd-b616-2a3f9e8f01d8 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:56:15.657949 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039ddc4f-0b67-4dbd-b616-2a3f9e8f01d8 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:56:15.680107 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fb9578-7506-4333-a15b-d5d39452bbc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:56:15.680752 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fb9578-7506-4333-a15b-d5d39452bbc6 admin admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:15.681029 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fb9578-7506-4333-a15b-d5d39452bbc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:15.681301 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fb9578-7506-4333-a15b-d5d39452bbc6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:15.681982 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fb9578-7506-4333-a15b-d5d39452bbc6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:56:15.682292 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fb9578-7506-4333-a15b-d5d39452bbc6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:56:15.683958 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fb9578-7506-4333-a15b-d5d39452bbc6 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:56:15.736945 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 824/1678] 10.222.0.15 () {58 vars in 1153 bytes} [Sun Oct 9 00:56:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:56:15.748861 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbf638b-707b-42fe-9984-c720ead651ef None None] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:56:15.762253 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbf638b-707b-42fe-9984-c720ead651ef None None] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:56:15.778018 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f7d69b-162b-4911-80c3-d66191905eba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:56:15.778727 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f7d69b-162b-4911-80c3-d66191905eba admin admin] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:15.779594 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f7d69b-162b-4911-80c3-d66191905eba admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:15.780381 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f7d69b-162b-4911-80c3-d66191905eba admin admin] PATH_INFO: `/v3/projects` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:15.781130 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f7d69b-162b-4911-80c3-d66191905eba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:56:15.790853 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f7d69b-162b-4911-80c3-d66191905eba admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:56:15.855011 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 855/1679] 10.222.0.15 () {60 vars in 1153 bytes} [Sun Oct 9 00:56:15 2022] POST /identity/v3/projects => generated 391 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 09 00:56:15.855920 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fb9578-7506-4333-a15b-d5d39452bbc6 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:56:15.874515 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fb9578-7506-4333-a15b-d5d39452bbc6 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:56:16.024905 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f97784c-ef9d-4ca6-a290-cee4e0a53359 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:56:16.025548 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f97784c-ef9d-4ca6-a290-cee4e0a53359 admin admin] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:16.025842 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f97784c-ef9d-4ca6-a290-cee4e0a53359 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:16.026100 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f97784c-ef9d-4ca6-a290-cee4e0a53359 admin admin] PATH_INFO: `/v3/users` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:16.026760 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f97784c-ef9d-4ca6-a290-cee4e0a53359 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:56:16.028754 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f97784c-ef9d-4ca6-a290-cee4e0a53359 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:56:16.074307 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 825/1680] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Oct 9 00:56:15 2022] POST /identity/v3/users => generated 296 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 09 00:56:16.079249 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f7d69b-162b-4911-80c3-d66191905eba admin admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:56:16.097437 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f7d69b-162b-4911-80c3-d66191905eba admin admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:56:16.113073 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ce3d43-8eda-4ac9-88a3-195a14f4ac06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:56:16.113740 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ce3d43-8eda-4ac9-88a3-195a14f4ac06 admin admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:16.114632 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ce3d43-8eda-4ac9-88a3-195a14f4ac06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:16.114912 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ce3d43-8eda-4ac9-88a3-195a14f4ac06 admin admin] PATH_INFO: `/v3/roles` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:16.115607 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ce3d43-8eda-4ac9-88a3-195a14f4ac06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:56:16.117399 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ce3d43-8eda-4ac9-88a3-195a14f4ac06 admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:56:16.155350 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 856/1681] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Oct 9 00:56:16 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 09 00:56:16.156125 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f97784c-ef9d-4ca6-a290-cee4e0a53359 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:56:16.181811 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f97784c-ef9d-4ca6-a290-cee4e0a53359 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:56:16.193091 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121e0853-efa8-42ef-95f3-4bfbcfdbd6ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:56:16.193738 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121e0853-efa8-42ef-95f3-4bfbcfdbd6ce admin admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:16.194050 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121e0853-efa8-42ef-95f3-4bfbcfdbd6ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:16.194346 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121e0853-efa8-42ef-95f3-4bfbcfdbd6ce admin admin] PATH_INFO: `/v3/roles` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:16.195005 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121e0853-efa8-42ef-95f3-4bfbcfdbd6ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:56:16.196689 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121e0853-efa8-42ef-95f3-4bfbcfdbd6ce admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:56:16.239715 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 826/1682] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Oct 9 00:56:16 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 09 00:56:16.244608 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ce3d43-8eda-4ac9-88a3-195a14f4ac06 admin admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:56:16.282257 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ce3d43-8eda-4ac9-88a3-195a14f4ac06 admin admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:56:16.303046 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfff86a-ed4e-43f2-9097-d958c7af1438 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:56:16.303862 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfff86a-ed4e-43f2-9097-d958c7af1438 admin admin] REQUEST_METHOD: `PUT` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:16.304140 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfff86a-ed4e-43f2-9097-d958c7af1438 admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:16.304417 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfff86a-ed4e-43f2-9097-d958c7af1438 admin admin] PATH_INFO: `/v3/projects/ece6c8425fc94b0e879b9efee9ff5e27/users/334936bed98d40cc8298c6f995cdc5ed/roles/afb0a01183d9497795eaa4fa1a4046ae` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:16.377540 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfff86a-ed4e-43f2-9097-d958c7af1438 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ece6c8425fc94b0e879b9efee9ff5e27, user_id=334936bed98d40cc8298c6f995cdc5ed, role_id=afb0a01183d9497795eaa4fa1a4046ae)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:56:16.383782 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfff86a-ed4e-43f2-9097-d958c7af1438 admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:56:16.431493 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 857/1683] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Oct 9 00:56:16 2022] PUT /identity/v3/projects/ece6c8425fc94b0e879b9efee9ff5e27/users/334936bed98d40cc8298c6f995cdc5ed/roles/afb0a01183d9497795eaa4fa1a4046ae => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 00:56:16.441244 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09724ee-b9e3-401f-9a88-7a3f4a02c69c None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:16.442017 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09724ee-b9e3-401f-9a88-7a3f4a02c69c None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:16.442423 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09724ee-b9e3-401f-9a88-7a3f4a02c69c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:16.517698 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-c09724ee-b9e3-401f-9a88-7a3f4a02c69c None None] MFA Rules not processed for user `334936bed98d40cc8298c6f995cdc5ed`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:56:16.519192 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-c09724ee-b9e3-401f-9a88-7a3f4a02c69c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:56:16.735972 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 827/1684] 10.222.0.15 () {58 vars in 958 bytes} [Sun Oct 9 00:56:16 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:56:16.740516 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfff86a-ed4e-43f2-9097-d958c7af1438 admin admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:56:16.902504 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfff86a-ed4e-43f2-9097-d958c7af1438 admin admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:56:16.924598 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78969c9b-caa0-42b0-aaef-1bfe6b542fe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:56:16.926849 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78969c9b-caa0-42b0-aaef-1bfe6b542fe8 admin admin] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:16.926849 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78969c9b-caa0-42b0-aaef-1bfe6b542fe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:16.926849 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78969c9b-caa0-42b0-aaef-1bfe6b542fe8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:16.932026 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78969c9b-caa0-42b0-aaef-1bfe6b542fe8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:56:16.938077 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78969c9b-caa0-42b0-aaef-1bfe6b542fe8 admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:56:16.946728 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61efd91-0f3e-45b4-8cba-b1aed08bdad9 None None] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:16.946999 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61efd91-0f3e-45b4-8cba-b1aed08bdad9 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:16.947359 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61efd91-0f3e-45b4-8cba-b1aed08bdad9 None None] PATH_INFO: `/` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:16.948742 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 828/1685] 10.222.0.15 () {54 vars in 912 bytes} [Sun Oct 9 00:56:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:56:16.954392 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61efd91-0f3e-45b4-8cba-b1aed08bdad9 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:56:16.956182 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-c61efd91-0f3e-45b4-8cba-b1aed08bdad9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:56:16.994123 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61efd91-0f3e-45b4-8cba-b1aed08bdad9 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:56:17.002625 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599f656b-1edc-455a-9a64-f61626c7e670 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:56:17.003443 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599f656b-1edc-455a-9a64-f61626c7e670 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:17.003772 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599f656b-1edc-455a-9a64-f61626c7e670 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:17.004048 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599f656b-1edc-455a-9a64-f61626c7e670 admin admin] PATH_INFO: `/v3/projects/6f169c9ba50b4f47aaa0b58adc3d3672` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:17.008879 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599f656b-1edc-455a-9a64-f61626c7e670 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6f169c9ba50b4f47aaa0b58adc3d3672)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:56:17.023045 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599f656b-1edc-455a-9a64-f61626c7e670 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:56:17.023771 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 858/1686] 10.222.0.15 () {60 vars in 1153 bytes} [Sun Oct 9 00:56:16 2022] POST /identity/v3/projects => generated 391 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 09 00:56:17.026017 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78969c9b-caa0-42b0-aaef-1bfe6b542fe8 admin admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:56:17.032745 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-78969c9b-caa0-42b0-aaef-1bfe6b542fe8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:56:17.154322 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:56:17.168245 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=93,keystone:INSERT=3,keystone:DELETE=4 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:56:17.172020 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-599f656b-1edc-455a-9a64-f61626c7e670 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6f169c9ba50b4f47aaa0b58adc3d3672', 'request_id': 'req-599f656b-1edc-455a-9a64-f61626c7e670'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:56:17.212524 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-599f656b-1edc-455a-9a64-f61626c7e670 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6f169c9ba50b4f47aaa0b58adc3d3672', 'request_id': 'req-599f656b-1edc-455a-9a64-f61626c7e670'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:56:17.239298 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-599f656b-1edc-455a-9a64-f61626c7e670 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6f169c9ba50b4f47aaa0b58adc3d3672', 'request_id': 'req-599f656b-1edc-455a-9a64-f61626c7e670'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:56:17.285420 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-599f656b-1edc-455a-9a64-f61626c7e670 admin admin] The token cache is being invalidate because project 6f169c9ba50b4f47aaa0b58adc3d3672 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81524) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 09 00:56:17.286013 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-599f656b-1edc-455a-9a64-f61626c7e670 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:56:17.291879 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-599f656b-1edc-455a-9a64-f61626c7e670 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:56:17.294847 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 829/1687] 10.222.0.15 () {58 vars in 1233 bytes} [Sun Oct 9 00:56:16 2022] DELETE /identity/v3/projects/6f169c9ba50b4f47aaa0b58adc3d3672 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 09 00:56:17.296192 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60bef57-7818-4fe4-9a0e-3a417944ad64 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:17.296473 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60bef57-7818-4fe4-9a0e-3a417944ad64 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:17.296745 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60bef57-7818-4fe4-9a0e-3a417944ad64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:17.359441 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78969c9b-caa0-42b0-aaef-1bfe6b542fe8 admin admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:56:17.372557 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-e60bef57-7818-4fe4-9a0e-3a417944ad64 None None] MFA Rules not processed for user `4ac83d57fba841e0a666710732249c49`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:56:17.374099 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-e60bef57-7818-4fe4-9a0e-3a417944ad64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:56:17.583283 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344cf235-3136-40db-b943-77abfa89ca8a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64be9d44437e4247a72334b9bab3cdd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f148d39ced534860abfbe8fc3f98ace4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:56:17.584452 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344cf235-3136-40db-b943-77abfa89ca8a service placement] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:17.584793 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344cf235-3136-40db-b943-77abfa89ca8a service placement] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:17.585067 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344cf235-3136-40db-b943-77abfa89ca8a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:17.591091 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-344cf235-3136-40db-b943-77abfa89ca8a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:56:17.596490 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 830/1688] 10.222.0.15 () {58 vars in 1009 bytes} [Sun Oct 9 00:56:17 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:56:17.597384 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60bef57-7818-4fe4-9a0e-3a417944ad64 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:56:17.604036 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-e60bef57-7818-4fe4-9a0e-3a417944ad64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:56:17.611652 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344cf235-3136-40db-b943-77abfa89ca8a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:56:17.613602 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344cf235-3136-40db-b943-77abfa89ca8a service placement] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:56:17.638028 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 859/1689] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Oct 9 00:56:17 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 615 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 09 00:56:17.640801 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344cf235-3136-40db-b943-77abfa89ca8a service placement] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:56:17.649061 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-344cf235-3136-40db-b943-77abfa89ca8a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:56:17.760410 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60bef57-7818-4fe4-9a0e-3a417944ad64 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:56:17.788158 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee6e91a-2854-472c-b6fe-d9fc3fd3289a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:56:17.788894 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee6e91a-2854-472c-b6fe-d9fc3fd3289a admin admin] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:17.789177 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee6e91a-2854-472c-b6fe-d9fc3fd3289a admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:17.789489 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee6e91a-2854-472c-b6fe-d9fc3fd3289a admin admin] PATH_INFO: `/v3/users` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:17.792899 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee6e91a-2854-472c-b6fe-d9fc3fd3289a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:56:17.814802 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344cf235-3136-40db-b943-77abfa89ca8a service placement] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:56:17.818763 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee6e91a-2854-472c-b6fe-d9fc3fd3289a admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:56:17.822541 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa51889-31f9-4549-9c78-22b5c4650a51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:56:17.824058 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa51889-31f9-4549-9c78-22b5c4650a51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:17.824523 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa51889-31f9-4549-9c78-22b5c4650a51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:17.825403 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa51889-31f9-4549-9c78-22b5c4650a51 admin admin] PATH_INFO: `/v3/users/9cb40859a78d4df4b86fe5c5b20f968d` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:17.826898 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa51889-31f9-4549-9c78-22b5c4650a51 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9cb40859a78d4df4b86fe5c5b20f968d)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:56:17.829141 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa51889-31f9-4549-9c78-22b5c4650a51 admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:56:17.891458 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 831/1690] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Oct 9 00:56:17 2022] POST /identity/v3/users => generated 302 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 09 00:56:17.894165 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad4b721-2a78-4fcc-b642-c4dea2acf540 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:17.896045 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad4b721-2a78-4fcc-b642-c4dea2acf540 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:17.896687 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad4b721-2a78-4fcc-b642-c4dea2acf540 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:17.908097 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-caa51889-31f9-4549-9c78-22b5c4650a51 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9cb40859a78d4df4b86fe5c5b20f968d'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:56:17.925984 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-caa51889-31f9-4549-9c78-22b5c4650a51 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9cb40859a78d4df4b86fe5c5b20f968d'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:56:17.929793 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-caa51889-31f9-4549-9c78-22b5c4650a51 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9cb40859a78d4df4b86fe5c5b20f968d'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:56:17.940669 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-caa51889-31f9-4549-9c78-22b5c4650a51 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9cb40859a78d4df4b86fe5c5b20f968d'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:56:17.940669 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:56:17.957336 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-caa51889-31f9-4549-9c78-22b5c4650a51 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9cb40859a78d4df4b86fe5c5b20f968d'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:56:18.011234 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 860/1691] 10.222.0.15 () {58 vars in 1224 bytes} [Sun Oct 9 00:56:17 2022] DELETE /identity/v3/users/9cb40859a78d4df4b86fe5c5b20f968d => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 00:56:18.011234 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa51889-31f9-4549-9c78-22b5c4650a51 admin admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:56:18.021305 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-caa51889-31f9-4549-9c78-22b5c4650a51 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:56:18.022515 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-0ad4b721-2a78-4fcc-b642-c4dea2acf540 None None] MFA Rules not processed for user `c4df6b9e42314edcbee1710279d0aa5a`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:56:18.025788 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-0ad4b721-2a78-4fcc-b642-c4dea2acf540 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:56:18.161838 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:56:18.215989 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa51889-31f9-4549-9c78-22b5c4650a51 admin admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:56:18.229232 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37200bc7-bd1e-4959-99b0-5e16537b272a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4ef90d456d2483e8ddafbe2d4d4fb5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f148d39ced534860abfbe8fc3f98ace4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:56:18.229887 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37200bc7-bd1e-4959-99b0-5e16537b272a service neutron] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:18.230209 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37200bc7-bd1e-4959-99b0-5e16537b272a service neutron] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:18.230519 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37200bc7-bd1e-4959-99b0-5e16537b272a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:18.242884 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-37200bc7-bd1e-4959-99b0-5e16537b272a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:56:18.264612 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 832/1692] 10.222.0.15 () {58 vars in 958 bytes} [Sun Oct 9 00:56:17 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 371 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:56:18.267800 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad4b721-2a78-4fcc-b642-c4dea2acf540 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:56:18.274092 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-0ad4b721-2a78-4fcc-b642-c4dea2acf540 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:56:18.537306 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37200bc7-bd1e-4959-99b0-5e16537b272a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:56:18.539001 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37200bc7-bd1e-4959-99b0-5e16537b272a service neutron] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:56:18.541004 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad4b721-2a78-4fcc-b642-c4dea2acf540 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:56:18.556381 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e6c301-43dd-481d-8ead-0d7dbc1c7be1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:56:18.557126 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e6c301-43dd-481d-8ead-0d7dbc1c7be1 admin admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:18.559150 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e6c301-43dd-481d-8ead-0d7dbc1c7be1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:18.559675 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e6c301-43dd-481d-8ead-0d7dbc1c7be1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:18.560562 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e6c301-43dd-481d-8ead-0d7dbc1c7be1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:56:18.564127 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e6c301-43dd-481d-8ead-0d7dbc1c7be1 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:56:18.584991 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 861/1693] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Oct 9 00:56:18 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 575 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 09 00:56:18.587407 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8763cdcf-35ad-4fa7-a414-3fbb0b0c765e None None] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:18.589174 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8763cdcf-35ad-4fa7-a414-3fbb0b0c765e None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:18.589590 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8763cdcf-35ad-4fa7-a414-3fbb0b0c765e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:18.592940 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 833/1694] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Oct 9 00:56:18 2022] GET /identity/v3/roles => generated 1420 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 09 00:56:18.594008 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e6c301-43dd-481d-8ead-0d7dbc1c7be1 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:56:18.629852 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-47e6c301-43dd-481d-8ead-0d7dbc1c7be1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:56:18.692389 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.auth.core [None req-8763cdcf-35ad-4fa7-a414-3fbb0b0c765e None None] MFA Rules not processed for user `6e66ef13ab7f4fc99966752b351e845c`. Rule list: `[]` (Enabled: `True`). {{(pid=81525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:56:18.694122 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-8763cdcf-35ad-4fa7-a414-3fbb0b0c765e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:56:18.707699 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e6c301-43dd-481d-8ead-0d7dbc1c7be1 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:56:18.731740 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24b340b-3ccc-4475-9b9d-edfe390cd948 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ac83d57fba841e0a666710732249c49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f148d39ced534860abfbe8fc3f98ace4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:56:18.732501 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24b340b-3ccc-4475-9b9d-edfe390cd948 service nova] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:18.732941 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24b340b-3ccc-4475-9b9d-edfe390cd948 service nova] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:18.733307 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24b340b-3ccc-4475-9b9d-edfe390cd948 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:18.772925 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24b340b-3ccc-4475-9b9d-edfe390cd948 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:56:18.780953 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24b340b-3ccc-4475-9b9d-edfe390cd948 service nova] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:56:18.832644 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 834/1695] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Oct 9 00:56:18 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 09 00:56:18.840258 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24b340b-3ccc-4475-9b9d-edfe390cd948 service nova] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:56:18.875769 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24b340b-3ccc-4475-9b9d-edfe390cd948 service nova] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:56:18.887768 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c0d10f-86d7-4fe8-a069-00604382846b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:56:18.888758 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c0d10f-86d7-4fe8-a069-00604382846b admin admin] REQUEST_METHOD: `PUT` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:18.889129 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c0d10f-86d7-4fe8-a069-00604382846b admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:18.889497 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c0d10f-86d7-4fe8-a069-00604382846b admin admin] PATH_INFO: `/v3/projects/4ddf1b6bba254bc2905c6e4dad40aedf/users/2a38f6f8c7014a83a6f4440a846ac892/roles/f69dddf26daf4dd79d4c962beb877af5` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:18.963649 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c0d10f-86d7-4fe8-a069-00604382846b admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ddf1b6bba254bc2905c6e4dad40aedf, user_id=2a38f6f8c7014a83a6f4440a846ac892, role_id=f69dddf26daf4dd79d4c962beb877af5)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:56:18.966730 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c0d10f-86d7-4fe8-a069-00604382846b admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:56:19.005013 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 835/1696] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Oct 9 00:56:18 2022] PUT /identity/v3/projects/4ddf1b6bba254bc2905c6e4dad40aedf/users/2a38f6f8c7014a83a6f4440a846ac892/roles/f69dddf26daf4dd79d4c962beb877af5 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 00:56:19.009164 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c0d10f-86d7-4fe8-a069-00604382846b admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:56:19.041927 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 862/1697] 10.222.0.15 () {58 vars in 958 bytes} [Sun Oct 9 00:56:18 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 456 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:56:19.049878 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8763cdcf-35ad-4fa7-a414-3fbb0b0c765e None None] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:56:19.053768 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-8763cdcf-35ad-4fa7-a414-3fbb0b0c765e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:56:19.105365 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:INSERT=1,keystone:DELETE=3,keystone:SELECT=96 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:56:19.125902 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8763cdcf-35ad-4fa7-a414-3fbb0b0c765e None None] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:56:19.226418 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c0d10f-86d7-4fe8-a069-00604382846b admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:56:19.254437 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64794cf0-1feb-4311-b5e6-5aecfa3e0ef1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:56:19.255590 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64794cf0-1feb-4311-b5e6-5aecfa3e0ef1 admin admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:19.255976 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64794cf0-1feb-4311-b5e6-5aecfa3e0ef1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:19.264036 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64794cf0-1feb-4311-b5e6-5aecfa3e0ef1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:19.265319 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64794cf0-1feb-4311-b5e6-5aecfa3e0ef1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:56:19.267075 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64794cf0-1feb-4311-b5e6-5aecfa3e0ef1 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:56:19.345203 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 836/1698] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Oct 9 00:56:19 2022] GET /identity/v3/roles => generated 1420 bytes in 336 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 09 00:56:19.347541 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64794cf0-1feb-4311-b5e6-5aecfa3e0ef1 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:56:19.351735 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba01496c-5600-46e2-9ff8-80c64ca3cb4d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ac83d57fba841e0a666710732249c49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f148d39ced534860abfbe8fc3f98ace4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:56:19.352836 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba01496c-5600-46e2-9ff8-80c64ca3cb4d service nova] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:19.353293 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba01496c-5600-46e2-9ff8-80c64ca3cb4d service nova] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:19.353720 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba01496c-5600-46e2-9ff8-80c64ca3cb4d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:19.382016 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64794cf0-1feb-4311-b5e6-5aecfa3e0ef1 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:56:19.399768 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad076d8b-d00b-484e-944c-212a6ecb5f03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:56:19.400667 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad076d8b-d00b-484e-944c-212a6ecb5f03 admin admin] REQUEST_METHOD: `PUT` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:19.404332 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad076d8b-d00b-484e-944c-212a6ecb5f03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:19.404833 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad076d8b-d00b-484e-944c-212a6ecb5f03 admin admin] PATH_INFO: `/v3/projects/4ddf1b6bba254bc2905c6e4dad40aedf/users/2a38f6f8c7014a83a6f4440a846ac892/roles/f69dddf26daf4dd79d4c962beb877af5` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:19.408298 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad076d8b-d00b-484e-944c-212a6ecb5f03 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ddf1b6bba254bc2905c6e4dad40aedf, user_id=2a38f6f8c7014a83a6f4440a846ac892, role_id=f69dddf26daf4dd79d4c962beb877af5)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:56:19.420019 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad076d8b-d00b-484e-944c-212a6ecb5f03 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:56:19.453700 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 837/1699] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Oct 9 00:56:19 2022] PUT /identity/v3/projects/4ddf1b6bba254bc2905c6e4dad40aedf/users/2a38f6f8c7014a83a6f4440a846ac892/roles/f69dddf26daf4dd79d4c962beb877af5 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 00:56:19.465160 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2134efa4-d5d3-40fe-ae2f-03ce47fc05f3 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:19.466078 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2134efa4-d5d3-40fe-ae2f-03ce47fc05f3 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:19.466598 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2134efa4-d5d3-40fe-ae2f-03ce47fc05f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:19.524681 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba01496c-5600-46e2-9ff8-80c64ca3cb4d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:56:19.529915 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba01496c-5600-46e2-9ff8-80c64ca3cb4d service nova] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:56:19.542171 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-2134efa4-d5d3-40fe-ae2f-03ce47fc05f3 None None] MFA Rules not processed for user `2a38f6f8c7014a83a6f4440a846ac892`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:56:19.543634 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-2134efa4-d5d3-40fe-ae2f-03ce47fc05f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:56:19.573739 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 863/1700] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Oct 9 00:56:19 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 524 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 09 00:56:19.589617 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:56:19.772966 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 838/1701] 10.222.0.15 () {58 vars in 958 bytes} [Sun Oct 9 00:56:19 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 309 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 09 00:56:19.787289 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba01496c-5600-46e2-9ff8-80c64ca3cb4d service nova] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:56:19.789154 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-ba01496c-5600-46e2-9ff8-80c64ca3cb4d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:56:19.985588 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba01496c-5600-46e2-9ff8-80c64ca3cb4d service nova] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:56:20.130523 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f1ae90-588a-41a6-9b32-4e7395d25a5e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff7cb78bcd91467abe5c2e2b48aedd1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f148d39ced534860abfbe8fc3f98ace4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:56:20.131547 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f1ae90-588a-41a6-9b32-4e7395d25a5e service cinder] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:20.135028 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f1ae90-588a-41a6-9b32-4e7395d25a5e service cinder] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:20.135028 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f1ae90-588a-41a6-9b32-4e7395d25a5e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:20.178333 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f1ae90-588a-41a6-9b32-4e7395d25a5e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:56:20.182273 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f1ae90-588a-41a6-9b32-4e7395d25a5e service cinder] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:56:20.201738 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:56:20.206243 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546e7778-9dd5-4262-b859-4f1d87cda761 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:20.206883 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546e7778-9dd5-4262-b859-4f1d87cda761 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:20.207221 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546e7778-9dd5-4262-b859-4f1d87cda761 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:20.211633 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 864/1702] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Oct 9 00:56:19 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 09 00:56:20.268935 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f1ae90-588a-41a6-9b32-4e7395d25a5e service cinder] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:56:20.282577 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-43f1ae90-588a-41a6-9b32-4e7395d25a5e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:56:20.332829 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-546e7778-9dd5-4262-b859-4f1d87cda761 None None] MFA Rules not processed for user `5eaab5e4f7f14847b5c2ca8eb490d21c`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:56:20.334066 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-546e7778-9dd5-4262-b859-4f1d87cda761 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:56:20.502836 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f1ae90-588a-41a6-9b32-4e7395d25a5e service cinder] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:56:20.518189 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4407928c-f14c-414d-9c14-d2110e17c07a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:56:20.520829 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4407928c-f14c-414d-9c14-d2110e17c07a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:20.521189 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4407928c-f14c-414d-9c14-d2110e17c07a admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:20.523314 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4407928c-f14c-414d-9c14-d2110e17c07a admin admin] PATH_INFO: `/v3/projects/b8e7bf84f75242209ba6686e1d65a098` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:20.526878 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4407928c-f14c-414d-9c14-d2110e17c07a admin admin] RBAC: Authorizing `identity:delete_project(project_id=b8e7bf84f75242209ba6686e1d65a098)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:56:20.533919 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4407928c-f14c-414d-9c14-d2110e17c07a admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:56:20.567903 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 839/1703] 10.222.0.15 () {58 vars in 958 bytes} [Sun Oct 9 00:56:20 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 363 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:56:20.575608 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546e7778-9dd5-4262-b859-4f1d87cda761 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:56:20.584468 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-546e7778-9dd5-4262-b859-4f1d87cda761 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:56:20.630819 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-4407928c-f14c-414d-9c14-d2110e17c07a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b8e7bf84f75242209ba6686e1d65a098', 'request_id': 'req-4407928c-f14c-414d-9c14-d2110e17c07a'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:56:20.642295 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546e7778-9dd5-4262-b859-4f1d87cda761 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:56:20.644372 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-4407928c-f14c-414d-9c14-d2110e17c07a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b8e7bf84f75242209ba6686e1d65a098', 'request_id': 'req-4407928c-f14c-414d-9c14-d2110e17c07a'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:56:20.669454 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-4407928c-f14c-414d-9c14-d2110e17c07a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b8e7bf84f75242209ba6686e1d65a098', 'request_id': 'req-4407928c-f14c-414d-9c14-d2110e17c07a'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:56:20.699791 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-4407928c-f14c-414d-9c14-d2110e17c07a admin admin] The token cache is being invalidate because project b8e7bf84f75242209ba6686e1d65a098 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81525) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 09 00:56:20.700135 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-4407928c-f14c-414d-9c14-d2110e17c07a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:56:20.702844 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-4407928c-f14c-414d-9c14-d2110e17c07a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:56:20.707414 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 865/1704] 10.222.0.15 () {58 vars in 1233 bytes} [Sun Oct 9 00:56:20 2022] DELETE /identity/v3/projects/b8e7bf84f75242209ba6686e1d65a098 => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 00:56:20.708850 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b879880-c926-4198-b94d-79059c7ea987 None None] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:20.709130 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b879880-c926-4198-b94d-79059c7ea987 None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:20.709731 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b879880-c926-4198-b94d-79059c7ea987 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:20.740954 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.auth.core [None req-5b879880-c926-4198-b94d-79059c7ea987 None None] MFA Rules not processed for user `5eaab5e4f7f14847b5c2ca8eb490d21c`. Rule list: `[]` (Enabled: `True`). {{(pid=81525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:56:20.743458 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-5b879880-c926-4198-b94d-79059c7ea987 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:56:20.817459 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43977979-036e-4081-bd53-e0ca804719ee service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff7cb78bcd91467abe5c2e2b48aedd1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f148d39ced534860abfbe8fc3f98ace4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:56:20.818297 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43977979-036e-4081-bd53-e0ca804719ee service cinder] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:20.818711 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43977979-036e-4081-bd53-e0ca804719ee service cinder] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:20.819151 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43977979-036e-4081-bd53-e0ca804719ee service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:20.822526 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-43977979-036e-4081-bd53-e0ca804719ee service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:56:20.927665 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 866/1705] 10.222.0.15 () {58 vars in 958 bytes} [Sun Oct 9 00:56:20 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:56:20.935172 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1bc5e4-e352-4ca5-b392-911d19fb0fc3 None None] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:20.936944 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1bc5e4-e352-4ca5-b392-911d19fb0fc3 None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:20.937220 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1bc5e4-e352-4ca5-b392-911d19fb0fc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:20.958536 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43977979-036e-4081-bd53-e0ca804719ee service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:56:20.960420 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43977979-036e-4081-bd53-e0ca804719ee service cinder] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:56:20.967155 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.auth.core [None req-3c1bc5e4-e352-4ca5-b392-911d19fb0fc3 None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:56:20.969018 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-3c1bc5e4-e352-4ca5-b392-911d19fb0fc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:56:20.971377 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:56:20.984955 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 840/1706] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Oct 9 00:56:20 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 09 00:56:20.995496 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43977979-036e-4081-bd53-e0ca804719ee service cinder] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:56:20.999363 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-43977979-036e-4081-bd53-e0ca804719ee service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:56:21.102473 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:56:21.218077 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43977979-036e-4081-bd53-e0ca804719ee service cinder] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:56:21.235936 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 867/1707] 10.222.0.15 () {58 vars in 958 bytes} [Sun Oct 9 00:56:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:56:21.238102 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874ac1b2-5090-4351-aba0-e2e2336ddb23 None None] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:21.238421 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874ac1b2-5090-4351-aba0-e2e2336ddb23 None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:21.238698 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874ac1b2-5090-4351-aba0-e2e2336ddb23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:21.240979 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750b3af3-033b-4799-8d59-094c15fffb1b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ac83d57fba841e0a666710732249c49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f148d39ced534860abfbe8fc3f98ace4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:56:21.241617 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750b3af3-033b-4799-8d59-094c15fffb1b service nova] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:21.241895 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750b3af3-033b-4799-8d59-094c15fffb1b service nova] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:21.242163 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750b3af3-033b-4799-8d59-094c15fffb1b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:21.245932 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-750b3af3-033b-4799-8d59-094c15fffb1b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:56:21.272385 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750b3af3-033b-4799-8d59-094c15fffb1b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:56:21.274028 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750b3af3-033b-4799-8d59-094c15fffb1b service nova] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:56:21.289036 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.auth.core [None req-874ac1b2-5090-4351-aba0-e2e2336ddb23 None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:56:21.292538 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-874ac1b2-5090-4351-aba0-e2e2336ddb23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:56:21.299759 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 841/1708] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Oct 9 00:56:20 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 09 00:56:21.321051 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 868/1709] 10.222.0.15 () {58 vars in 958 bytes} [Sun Oct 9 00:56:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:56:21.321758 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750b3af3-033b-4799-8d59-094c15fffb1b service nova] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:56:21.347785 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750b3af3-033b-4799-8d59-094c15fffb1b service nova] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:56:21.364607 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f737c7-14b1-46c6-8660-88b6cd65c478 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:56:21.365249 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f737c7-14b1-46c6-8660-88b6cd65c478 admin admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:21.365526 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f737c7-14b1-46c6-8660-88b6cd65c478 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:21.365884 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f737c7-14b1-46c6-8660-88b6cd65c478 admin admin] PATH_INFO: `/v3/domains` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:21.366592 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f737c7-14b1-46c6-8660-88b6cd65c478 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:56:21.366897 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f737c7-14b1-46c6-8660-88b6cd65c478 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:56:21.368620 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f737c7-14b1-46c6-8660-88b6cd65c478 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:56:21.398738 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 842/1710] 10.222.0.15 () {58 vars in 1153 bytes} [Sun Oct 9 00:56:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:56:21.403487 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874ac1b2-5090-4351-aba0-e2e2336ddb23 None None] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:56:21.416455 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874ac1b2-5090-4351-aba0-e2e2336ddb23 None None] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:56:21.423925 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1375ee1d-c497-4463-9cf1-4a568be011bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:56:21.424666 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1375ee1d-c497-4463-9cf1-4a568be011bf admin admin] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:21.425045 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1375ee1d-c497-4463-9cf1-4a568be011bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:21.425414 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1375ee1d-c497-4463-9cf1-4a568be011bf admin admin] PATH_INFO: `/v3/projects` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:21.426168 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1375ee1d-c497-4463-9cf1-4a568be011bf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:56:21.428490 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1375ee1d-c497-4463-9cf1-4a568be011bf admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:56:21.525718 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 869/1711] 10.222.0.15 () {60 vars in 1153 bytes} [Sun Oct 9 00:56:21 2022] POST /identity/v3/projects => generated 379 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 09 00:56:21.530128 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f737c7-14b1-46c6-8660-88b6cd65c478 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:56:21.546251 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f737c7-14b1-46c6-8660-88b6cd65c478 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:56:21.855987 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820c6808-9749-47b9-b696-7635780b18e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:56:21.856861 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820c6808-9749-47b9-b696-7635780b18e3 admin admin] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:21.857170 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820c6808-9749-47b9-b696-7635780b18e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:21.857857 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820c6808-9749-47b9-b696-7635780b18e3 admin admin] PATH_INFO: `/v3/users` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:21.866287 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820c6808-9749-47b9-b696-7635780b18e3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:56:21.866287 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820c6808-9749-47b9-b696-7635780b18e3 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:56:21.959009 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 843/1712] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Oct 9 00:56:21 2022] POST /identity/v3/users => generated 290 bytes in 429 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 09 00:56:21.963188 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1375ee1d-c497-4463-9cf1-4a568be011bf admin admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:56:21.982216 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1375ee1d-c497-4463-9cf1-4a568be011bf admin admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:56:22.001995 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7000f523-5ea4-46f6-951c-9965f5451df4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:56:22.002750 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7000f523-5ea4-46f6-951c-9965f5451df4 admin admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:22.003022 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7000f523-5ea4-46f6-951c-9965f5451df4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:22.003347 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7000f523-5ea4-46f6-951c-9965f5451df4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:22.005198 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7000f523-5ea4-46f6-951c-9965f5451df4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:56:22.025200 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7000f523-5ea4-46f6-951c-9965f5451df4 admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:56:22.066086 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820c6808-9749-47b9-b696-7635780b18e3 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:56:22.067347 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 870/1713] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Oct 9 00:56:21 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 09 00:56:22.079331 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820c6808-9749-47b9-b696-7635780b18e3 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:56:22.086741 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131a0f96-2c8d-4ed4-a7e8-9203285132a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:56:22.087285 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131a0f96-2c8d-4ed4-a7e8-9203285132a0 admin admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:22.087731 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131a0f96-2c8d-4ed4-a7e8-9203285132a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:22.088130 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131a0f96-2c8d-4ed4-a7e8-9203285132a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:22.088992 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131a0f96-2c8d-4ed4-a7e8-9203285132a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:56:22.090773 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131a0f96-2c8d-4ed4-a7e8-9203285132a0 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:56:22.108497 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 844/1714] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Oct 9 00:56:22 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 09 00:56:22.109433 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7000f523-5ea4-46f6-951c-9965f5451df4 admin admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:56:22.127034 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7000f523-5ea4-46f6-951c-9965f5451df4 admin admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:56:22.134392 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e8b3a1-3c19-4d5f-8610-dc7264cc4143 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:56:22.135378 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e8b3a1-3c19-4d5f-8610-dc7264cc4143 admin admin] REQUEST_METHOD: `PUT` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:22.136139 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e8b3a1-3c19-4d5f-8610-dc7264cc4143 admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:22.136415 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e8b3a1-3c19-4d5f-8610-dc7264cc4143 admin admin] PATH_INFO: `/v3/projects/7badc3430b274c9d8d8dfec5ed3689a8/users/81826b66849e453cb3731e0544517fe0/roles/afb0a01183d9497795eaa4fa1a4046ae` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:22.157731 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e8b3a1-3c19-4d5f-8610-dc7264cc4143 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7badc3430b274c9d8d8dfec5ed3689a8, user_id=81826b66849e453cb3731e0544517fe0, role_id=afb0a01183d9497795eaa4fa1a4046ae)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:56:22.162287 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e8b3a1-3c19-4d5f-8610-dc7264cc4143 admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:56:22.201996 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 871/1715] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Oct 9 00:56:22 2022] PUT /identity/v3/projects/7badc3430b274c9d8d8dfec5ed3689a8/users/81826b66849e453cb3731e0544517fe0/roles/afb0a01183d9497795eaa4fa1a4046ae => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 00:56:22.208317 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e8685d-91a4-4b39-9a77-075e35330a3a None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:22.208685 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e8685d-91a4-4b39-9a77-075e35330a3a None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:22.209105 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e8685d-91a4-4b39-9a77-075e35330a3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:22.253223 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-85e8685d-91a4-4b39-9a77-075e35330a3a None None] MFA Rules not processed for user `81826b66849e453cb3731e0544517fe0`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:56:22.254808 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-85e8685d-91a4-4b39-9a77-075e35330a3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:56:22.344176 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:56:22.366258 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5182793a-8861-4180-b419-3016db25bb9f None None] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:22.367062 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5182793a-8861-4180-b419-3016db25bb9f None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:22.367062 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5182793a-8861-4180-b419-3016db25bb9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:22.415686 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.auth.core [None req-5182793a-8861-4180-b419-3016db25bb9f None None] MFA Rules not processed for user `3a6cfef106c84f759ce0874be77f7380`. Rule list: `[]` (Enabled: `True`). {{(pid=81525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:56:22.417220 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-5182793a-8861-4180-b419-3016db25bb9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:56:22.430796 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 845/1716] 10.222.0.15 () {58 vars in 958 bytes} [Sun Oct 9 00:56:22 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:56:22.435415 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e8685d-91a4-4b39-9a77-075e35330a3a None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:56:22.567205 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e8685d-91a4-4b39-9a77-075e35330a3a None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:56:22.577797 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e420305-552f-474a-a096-8615454d9484 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:56:22.578756 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e420305-552f-474a-a096-8615454d9484 admin admin] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:22.579134 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e420305-552f-474a-a096-8615454d9484 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:22.579533 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e420305-552f-474a-a096-8615454d9484 admin admin] PATH_INFO: `/v3/projects` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:22.580479 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e420305-552f-474a-a096-8615454d9484 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:56:22.588347 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 872/1717] 10.222.0.15 () {58 vars in 1009 bytes} [Sun Oct 9 00:56:22 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 09 00:56:22.594649 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e420305-552f-474a-a096-8615454d9484 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:56:22.604307 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5182793a-8861-4180-b419-3016db25bb9f None None] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:56:22.606312 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-5182793a-8861-4180-b419-3016db25bb9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:56:22.672067 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 846/1718] 10.222.0.15 () {60 vars in 1153 bytes} [Sun Oct 9 00:56:22 2022] POST /identity/v3/projects => generated 379 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 09 00:56:22.675966 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e420305-552f-474a-a096-8615454d9484 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:56:22.790229 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5182793a-8861-4180-b419-3016db25bb9f None None] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:56:22.824044 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e420305-552f-474a-a096-8615454d9484 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:56:22.832665 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc5263c-2a1d-4f4e-b884-13fe587bf822 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:56:22.833463 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc5263c-2a1d-4f4e-b884-13fe587bf822 admin admin] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:22.833847 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc5263c-2a1d-4f4e-b884-13fe587bf822 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:22.834209 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc5263c-2a1d-4f4e-b884-13fe587bf822 admin admin] PATH_INFO: `/v3/users` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:22.835099 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc5263c-2a1d-4f4e-b884-13fe587bf822 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:56:22.837332 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc5263c-2a1d-4f4e-b884-13fe587bf822 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:56:22.842139 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:56:22.870071 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 847/1719] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Oct 9 00:56:22 2022] POST /identity/v3/users => generated 296 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 09 00:56:22.871341 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd492737-1a8a-4e17-a2db-4de9f682bc8f None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:22.871773 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd492737-1a8a-4e17-a2db-4de9f682bc8f None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:22.872152 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd492737-1a8a-4e17-a2db-4de9f682bc8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:22.901665 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-dd492737-1a8a-4e17-a2db-4de9f682bc8f None None] MFA Rules not processed for user `6a2d7675a1fe4301b2920c86a35312dd`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:56:22.904899 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-dd492737-1a8a-4e17-a2db-4de9f682bc8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:56:22.930001 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277ff277-1e67-4ebd-8a96-c8a57240f799 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4c467943b8f4d31a2f067ca6ed3b25c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f148d39ced534860abfbe8fc3f98ace4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:56:22.931150 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277ff277-1e67-4ebd-8a96-c8a57240f799 service swift] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:22.931617 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277ff277-1e67-4ebd-8a96-c8a57240f799 service swift] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:22.932424 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277ff277-1e67-4ebd-8a96-c8a57240f799 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:23.039477 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:56:23.060563 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277ff277-1e67-4ebd-8a96-c8a57240f799 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:56:23.062076 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 848/1720] 10.222.0.15 () {58 vars in 958 bytes} [Sun Oct 9 00:56:22 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:56:23.062431 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277ff277-1e67-4ebd-8a96-c8a57240f799 service swift] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:56:23.064152 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bab2a58-85fe-4823-bbd7-81752d856f49 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:23.066069 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bab2a58-85fe-4823-bbd7-81752d856f49 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:23.066709 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bab2a58-85fe-4823-bbd7-81752d856f49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:23.091597 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 873/1721] 10.222.0.15 () {60 vars in 1384 bytes} [Sun Oct 9 00:56:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 488 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 09 00:56:23.105798 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277ff277-1e67-4ebd-8a96-c8a57240f799 service swift] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:56:23.121066 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-8bab2a58-85fe-4823-bbd7-81752d856f49 None None] MFA Rules not processed for user `f4ef90d456d2483e8ddafbe2d4d4fb5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:56:23.125409 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-8bab2a58-85fe-4823-bbd7-81752d856f49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:56:23.158780 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277ff277-1e67-4ebd-8a96-c8a57240f799 service swift] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:56:23.175508 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930ca5b1-eb35-4cc4-b63c-a0db4603a1ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:56:23.176230 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930ca5b1-eb35-4cc4-b63c-a0db4603a1ac admin admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:23.176544 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930ca5b1-eb35-4cc4-b63c-a0db4603a1ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:23.183987 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930ca5b1-eb35-4cc4-b63c-a0db4603a1ac admin admin] PATH_INFO: `/v3/roles` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:23.184916 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930ca5b1-eb35-4cc4-b63c-a0db4603a1ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:56:23.186726 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930ca5b1-eb35-4cc4-b63c-a0db4603a1ac admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:56:23.240044 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 874/1722] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Oct 9 00:56:23 2022] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 09 00:56:23.272266 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930ca5b1-eb35-4cc4-b63c-a0db4603a1ac admin admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:56:23.295709 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930ca5b1-eb35-4cc4-b63c-a0db4603a1ac admin admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:56:23.309440 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9dd693-fcd2-42c7-8ebe-453bbe9d146b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:56:23.310064 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9dd693-fcd2-42c7-8ebe-453bbe9d146b admin admin] REQUEST_METHOD: `PUT` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:23.310290 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9dd693-fcd2-42c7-8ebe-453bbe9d146b admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:23.310562 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9dd693-fcd2-42c7-8ebe-453bbe9d146b admin admin] PATH_INFO: `/v3/projects/5c31c8b6cb8b4e7cb42caa31c9cff2fe/users/11955cdc464942bf8e7e66b5f2e0cb33/roles/f69dddf26daf4dd79d4c962beb877af5` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:23.331249 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9dd693-fcd2-42c7-8ebe-453bbe9d146b admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c31c8b6cb8b4e7cb42caa31c9cff2fe, user_id=11955cdc464942bf8e7e66b5f2e0cb33, role_id=f69dddf26daf4dd79d4c962beb877af5)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:56:23.336208 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9dd693-fcd2-42c7-8ebe-453bbe9d146b admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:56:23.378144 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 875/1723] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Oct 9 00:56:23 2022] PUT /identity/v3/projects/5c31c8b6cb8b4e7cb42caa31c9cff2fe/users/11955cdc464942bf8e7e66b5f2e0cb33/roles/f69dddf26daf4dd79d4c962beb877af5 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 00:56:23.380777 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 849/1724] 10.222.0.15 () {58 vars in 1009 bytes} [Sun Oct 9 00:56:23 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 318 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:56:23.387351 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9dd693-fcd2-42c7-8ebe-453bbe9d146b admin admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:56:23.394853 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bab2a58-85fe-4823-bbd7-81752d856f49 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:56:23.398832 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-8bab2a58-85fe-4823-bbd7-81752d856f49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:56:23.425306 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bab2a58-85fe-4823-bbd7-81752d856f49 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:56:23.570182 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9dd693-fcd2-42c7-8ebe-453bbe9d146b admin admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:56:23.583797 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481b5f6c-7ae8-4c1d-85c9-36b9889d3dc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:56:23.584546 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481b5f6c-7ae8-4c1d-85c9-36b9889d3dc8 admin admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:23.587286 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481b5f6c-7ae8-4c1d-85c9-36b9889d3dc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:23.587563 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481b5f6c-7ae8-4c1d-85c9-36b9889d3dc8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:23.588303 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481b5f6c-7ae8-4c1d-85c9-36b9889d3dc8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:56:23.591980 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481b5f6c-7ae8-4c1d-85c9-36b9889d3dc8 admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:56:23.625829 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 876/1725] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Oct 9 00:56:23 2022] GET /identity/v3/roles => generated 1420 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 09 00:56:23.634304 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481b5f6c-7ae8-4c1d-85c9-36b9889d3dc8 admin admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:56:23.643848 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31ee8bd-03a4-410b-9103-e76ca415fdd2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4ef90d456d2483e8ddafbe2d4d4fb5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f148d39ced534860abfbe8fc3f98ace4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:56:23.649146 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31ee8bd-03a4-410b-9103-e76ca415fdd2 service neutron] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:23.652699 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31ee8bd-03a4-410b-9103-e76ca415fdd2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:23.653240 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31ee8bd-03a4-410b-9103-e76ca415fdd2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:23.663531 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481b5f6c-7ae8-4c1d-85c9-36b9889d3dc8 admin admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:56:23.678623 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91669b60-e7d1-4271-80f3-ef2e578a174c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:56:23.680381 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31ee8bd-03a4-410b-9103-e76ca415fdd2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:56:23.681751 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91669b60-e7d1-4271-80f3-ef2e578a174c admin admin] REQUEST_METHOD: `PUT` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:23.682205 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31ee8bd-03a4-410b-9103-e76ca415fdd2 service neutron] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:56:23.683089 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91669b60-e7d1-4271-80f3-ef2e578a174c admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:23.683089 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91669b60-e7d1-4271-80f3-ef2e578a174c admin admin] PATH_INFO: `/v3/projects/5c31c8b6cb8b4e7cb42caa31c9cff2fe/users/11955cdc464942bf8e7e66b5f2e0cb33/roles/f69dddf26daf4dd79d4c962beb877af5` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:23.690559 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91669b60-e7d1-4271-80f3-ef2e578a174c admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c31c8b6cb8b4e7cb42caa31c9cff2fe, user_id=11955cdc464942bf8e7e66b5f2e0cb33, role_id=f69dddf26daf4dd79d4c962beb877af5)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:56:23.695758 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91669b60-e7d1-4271-80f3-ef2e578a174c admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:56:23.698189 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 850/1726] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Oct 9 00:56:23 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 09 00:56:23.788699 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 877/1727] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Oct 9 00:56:23 2022] PUT /identity/v3/projects/5c31c8b6cb8b4e7cb42caa31c9cff2fe/users/11955cdc464942bf8e7e66b5f2e0cb33/roles/f69dddf26daf4dd79d4c962beb877af5 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 00:56:23.800000 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaea8c8-a043-49cc-8379-063810e29ee4 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:23.800291 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaea8c8-a043-49cc-8379-063810e29ee4 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:23.800570 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaea8c8-a043-49cc-8379-063810e29ee4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:23.863807 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-3aaea8c8-a043-49cc-8379-063810e29ee4 None None] MFA Rules not processed for user `11955cdc464942bf8e7e66b5f2e0cb33`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:56:23.865000 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-3aaea8c8-a043-49cc-8379-063810e29ee4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:56:23.961687 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 851/1728] 10.222.0.15 () {58 vars in 958 bytes} [Sun Oct 9 00:56:23 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 09 00:56:24.003359 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91669b60-e7d1-4271-80f3-ef2e578a174c admin admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:56:24.007172 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-91669b60-e7d1-4271-80f3-ef2e578a174c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:56:24.043102 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:56:24.315494 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91669b60-e7d1-4271-80f3-ef2e578a174c admin admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:56:24.351133 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d4d07d-6d73-4b1a-b42d-634b43aaad0f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff7cb78bcd91467abe5c2e2b48aedd1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f148d39ced534860abfbe8fc3f98ace4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:56:24.354002 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d4d07d-6d73-4b1a-b42d-634b43aaad0f service cinder] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:24.367832 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d4d07d-6d73-4b1a-b42d-634b43aaad0f service cinder] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:24.368350 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d4d07d-6d73-4b1a-b42d-634b43aaad0f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:24.558028 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d4d07d-6d73-4b1a-b42d-634b43aaad0f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:56:24.563679 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d4d07d-6d73-4b1a-b42d-634b43aaad0f service cinder] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:56:24.602763 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 878/1729] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Oct 9 00:56:24 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 600 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 09 00:56:25.918691 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ad2489-b530-4226-970e-ac32149b18f6 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:25.919371 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ad2489-b530-4226-970e-ac32149b18f6 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:25.920761 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ad2489-b530-4226-970e-ac32149b18f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:25.996028 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-13ad2489-b530-4226-970e-ac32149b18f6 None None] MFA Rules not processed for user `5eaab5e4f7f14847b5c2ca8eb490d21c`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:56:25.999862 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-13ad2489-b530-4226-970e-ac32149b18f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:56:26.100380 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:56:26.170233 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 852/1730] 10.222.0.15 () {58 vars in 958 bytes} [Sun Oct 9 00:56:25 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:56:26.637771 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b829fcc-e537-40fd-807b-967ce02c6419 None None] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:26.638774 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b829fcc-e537-40fd-807b-967ce02c6419 None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:26.639205 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b829fcc-e537-40fd-807b-967ce02c6419 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:26.641142 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b57f44d-dc67-48be-bcf0-c94d1fdcaa99 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:26.641723 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b57f44d-dc67-48be-bcf0-c94d1fdcaa99 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:26.642130 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b57f44d-dc67-48be-bcf0-c94d1fdcaa99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:26.721686 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-8b57f44d-dc67-48be-bcf0-c94d1fdcaa99 None None] MFA Rules not processed for user `6e66ef13ab7f4fc99966752b351e845c`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:56:26.723006 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-8b57f44d-dc67-48be-bcf0-c94d1fdcaa99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:56:26.732919 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.auth.core [None req-3b829fcc-e537-40fd-807b-967ce02c6419 None None] MFA Rules not processed for user `f4ef90d456d2483e8ddafbe2d4d4fb5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:56:26.739036 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-3b829fcc-e537-40fd-807b-967ce02c6419 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:56:26.952737 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 853/1731] 10.222.0.15 () {58 vars in 958 bytes} [Sun Oct 9 00:56:26 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 312 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:56:26.953771 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b57f44d-dc67-48be-bcf0-c94d1fdcaa99 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:56:26.955190 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-8b57f44d-dc67-48be-bcf0-c94d1fdcaa99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:56:26.969225 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 879/1732] 10.222.0.48 () {58 vars in 1015 bytes} [Sun Oct 9 00:56:26 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 332 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:56:26.988194 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b57f44d-dc67-48be-bcf0-c94d1fdcaa99 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:56:27.001150 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54cc5f6-e19f-48cc-8849-48ed34eb65e7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff7cb78bcd91467abe5c2e2b48aedd1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f148d39ced534860abfbe8fc3f98ace4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:56:27.001802 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54cc5f6-e19f-48cc-8849-48ed34eb65e7 service cinder] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:27.002078 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54cc5f6-e19f-48cc-8849-48ed34eb65e7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:27.002355 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54cc5f6-e19f-48cc-8849-48ed34eb65e7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:27.015140 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b829fcc-e537-40fd-807b-967ce02c6419 None None] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:56:27.016661 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-3b829fcc-e537-40fd-807b-967ce02c6419 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:56:27.026436 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54cc5f6-e19f-48cc-8849-48ed34eb65e7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:56:27.028738 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54cc5f6-e19f-48cc-8849-48ed34eb65e7 service cinder] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:56:27.043367 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b829fcc-e537-40fd-807b-967ce02c6419 None None] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:56:27.063765 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ae0921-4fd3-4c03-9bab-26cc20bca241 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4ef90d456d2483e8ddafbe2d4d4fb5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f148d39ced534860abfbe8fc3f98ace4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:56:27.069634 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ae0921-4fd3-4c03-9bab-26cc20bca241 service neutron] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:27.070001 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ae0921-4fd3-4c03-9bab-26cc20bca241 service neutron] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:27.070281 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ae0921-4fd3-4c03-9bab-26cc20bca241 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:27.072560 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 854/1733] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Oct 9 00:56:26 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 09 00:56:27.118367 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ae0921-4fd3-4c03-9bab-26cc20bca241 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:56:27.135613 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ae0921-4fd3-4c03-9bab-26cc20bca241 service neutron] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:56:27.177233 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 880/1734] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Oct 9 00:56:27 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 09 00:56:27.186334 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54cc5f6-e19f-48cc-8849-48ed34eb65e7 service cinder] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:56:27.188580 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-f54cc5f6-e19f-48cc-8849-48ed34eb65e7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:56:27.486766 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54cc5f6-e19f-48cc-8849-48ed34eb65e7 service cinder] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:56:27.499764 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a86959b-797b-446d-a019-1bc204ea61d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:56:27.500521 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a86959b-797b-446d-a019-1bc204ea61d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:27.500800 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a86959b-797b-446d-a019-1bc204ea61d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:27.501071 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a86959b-797b-446d-a019-1bc204ea61d7 admin admin] PATH_INFO: `/v3/users/334936bed98d40cc8298c6f995cdc5ed` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:27.508645 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a86959b-797b-446d-a019-1bc204ea61d7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=334936bed98d40cc8298c6f995cdc5ed)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:56:27.517497 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a86959b-797b-446d-a019-1bc204ea61d7 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:56:27.716750 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-9a86959b-797b-446d-a019-1bc204ea61d7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '334936bed98d40cc8298c6f995cdc5ed'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:56:27.730206 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-9a86959b-797b-446d-a019-1bc204ea61d7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '334936bed98d40cc8298c6f995cdc5ed'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:56:27.731408 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-9a86959b-797b-446d-a019-1bc204ea61d7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '334936bed98d40cc8298c6f995cdc5ed'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:56:27.732432 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-9a86959b-797b-446d-a019-1bc204ea61d7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '334936bed98d40cc8298c6f995cdc5ed'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:56:27.759621 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-9a86959b-797b-446d-a019-1bc204ea61d7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '334936bed98d40cc8298c6f995cdc5ed'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:56:27.796997 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:56:27.829135 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 855/1735] 10.222.0.15 () {58 vars in 1224 bytes} [Sun Oct 9 00:56:27 2022] DELETE /identity/v3/users/334936bed98d40cc8298c6f995cdc5ed => generated 0 bytes in 643 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 00:56:27.833986 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af15cb65-c854-4450-b433-1e02e55767e5 None None] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:27.834950 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af15cb65-c854-4450-b433-1e02e55767e5 None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:27.835741 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af15cb65-c854-4450-b433-1e02e55767e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:27.878816 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83d773f-a2d2-4a39-9911-62d209a7aafd None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:27.880452 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83d773f-a2d2-4a39-9911-62d209a7aafd None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:27.880944 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83d773f-a2d2-4a39-9911-62d209a7aafd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:27.908759 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.auth.core [None req-af15cb65-c854-4450-b433-1e02e55767e5 None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:56:27.915867 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-af15cb65-c854-4450-b433-1e02e55767e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:56:27.961384 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-d83d773f-a2d2-4a39-9911-62d209a7aafd None None] MFA Rules not processed for user `c4df6b9e42314edcbee1710279d0aa5a`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:56:27.964916 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-d83d773f-a2d2-4a39-9911-62d209a7aafd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:56:28.130777 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:56:28.162150 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 881/1736] 10.222.0.15 () {58 vars in 958 bytes} [Sun Oct 9 00:56:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 329 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:56:28.165749 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 856/1737] 10.222.0.15 () {58 vars in 958 bytes} [Sun Oct 9 00:56:27 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:56:28.174329 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af15cb65-c854-4450-b433-1e02e55767e5 None None] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:56:28.177503 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-af15cb65-c854-4450-b433-1e02e55767e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:56:28.348198 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af15cb65-c854-4450-b433-1e02e55767e5 None None] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:56:28.359451 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75419c8f-1b5c-41a4-84ab-e880fb9baf17 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4ef90d456d2483e8ddafbe2d4d4fb5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f148d39ced534860abfbe8fc3f98ace4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:56:28.361182 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75419c8f-1b5c-41a4-84ab-e880fb9baf17 service neutron] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:28.362242 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75419c8f-1b5c-41a4-84ab-e880fb9baf17 service neutron] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:28.362607 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75419c8f-1b5c-41a4-84ab-e880fb9baf17 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:28.383741 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75419c8f-1b5c-41a4-84ab-e880fb9baf17 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:56:28.385516 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75419c8f-1b5c-41a4-84ab-e880fb9baf17 service neutron] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:56:28.424520 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 882/1738] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Oct 9 00:56:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 09 00:56:29.702647 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c8a73a-30db-40f0-82c6-12152b944345 None None] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:29.703320 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c8a73a-30db-40f0-82c6-12152b944345 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:29.703786 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c8a73a-30db-40f0-82c6-12152b944345 None None] PATH_INFO: `/` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:29.705380 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 857/1739] 10.222.0.15 () {54 vars in 921 bytes} [Sun Oct 9 00:56:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:56:29.778217 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad481ed7-979f-4d9d-b87c-a9818dc806d8 None None] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:29.778770 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad481ed7-979f-4d9d-b87c-a9818dc806d8 None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:29.778770 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad481ed7-979f-4d9d-b87c-a9818dc806d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:29.826492 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.auth.core [None req-ad481ed7-979f-4d9d-b87c-a9818dc806d8 None None] MFA Rules not processed for user `4ac83d57fba841e0a666710732249c49`. Rule list: `[]` (Enabled: `True`). {{(pid=81525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:56:29.827768 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-ad481ed7-979f-4d9d-b87c-a9818dc806d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:56:30.027333 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 883/1740] 10.222.0.15 () {58 vars in 1018 bytes} [Sun Oct 9 00:56:29 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:56:30.065173 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c8a73a-30db-40f0-82c6-12152b944345 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:56:30.067801 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-b9c8a73a-30db-40f0-82c6-12152b944345 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:56:30.127510 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c8a73a-30db-40f0-82c6-12152b944345 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:56:30.151475 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03b6a0c-f5c3-406e-adb1-5683894e2b42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:56:30.160432 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03b6a0c-f5c3-406e-adb1-5683894e2b42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:30.161079 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03b6a0c-f5c3-406e-adb1-5683894e2b42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:30.161554 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03b6a0c-f5c3-406e-adb1-5683894e2b42 admin admin] PATH_INFO: `/v3/projects/ece6c8425fc94b0e879b9efee9ff5e27` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:30.169166 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03b6a0c-f5c3-406e-adb1-5683894e2b42 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ece6c8425fc94b0e879b9efee9ff5e27)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:56:30.177295 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03b6a0c-f5c3-406e-adb1-5683894e2b42 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:56:30.310782 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-f03b6a0c-f5c3-406e-adb1-5683894e2b42 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ece6c8425fc94b0e879b9efee9ff5e27', 'request_id': 'req-f03b6a0c-f5c3-406e-adb1-5683894e2b42'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:56:30.325253 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-f03b6a0c-f5c3-406e-adb1-5683894e2b42 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ece6c8425fc94b0e879b9efee9ff5e27', 'request_id': 'req-f03b6a0c-f5c3-406e-adb1-5683894e2b42'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:56:30.340384 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-f03b6a0c-f5c3-406e-adb1-5683894e2b42 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ece6c8425fc94b0e879b9efee9ff5e27', 'request_id': 'req-f03b6a0c-f5c3-406e-adb1-5683894e2b42'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:56:30.378818 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-f03b6a0c-f5c3-406e-adb1-5683894e2b42 admin admin] The token cache is being invalidate because project ece6c8425fc94b0e879b9efee9ff5e27 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81524) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 09 00:56:30.379322 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-f03b6a0c-f5c3-406e-adb1-5683894e2b42 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:56:30.382023 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-f03b6a0c-f5c3-406e-adb1-5683894e2b42 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:56:30.387299 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 858/1741] 10.222.0.15 () {58 vars in 1233 bytes} [Sun Oct 9 00:56:30 2022] DELETE /identity/v3/projects/ece6c8425fc94b0e879b9efee9ff5e27 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 00:56:30.392149 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad481ed7-979f-4d9d-b87c-a9818dc806d8 None None] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:56:30.409217 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad481ed7-979f-4d9d-b87c-a9818dc806d8 None None] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:56:30.551907 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071f069a-0459-455d-8656-d7c4b78b4814 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:56:30.552900 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071f069a-0459-455d-8656-d7c4b78b4814 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:30.553272 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071f069a-0459-455d-8656-d7c4b78b4814 admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:30.553635 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071f069a-0459-455d-8656-d7c4b78b4814 admin admin] PATH_INFO: `/v3/users/2a38f6f8c7014a83a6f4440a846ac892` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:30.555044 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071f069a-0459-455d-8656-d7c4b78b4814 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2a38f6f8c7014a83a6f4440a846ac892)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:56:30.565689 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071f069a-0459-455d-8656-d7c4b78b4814 admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:56:30.675928 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:56:30.699813 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-071f069a-0459-455d-8656-d7c4b78b4814 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2a38f6f8c7014a83a6f4440a846ac892'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:56:30.710661 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-071f069a-0459-455d-8656-d7c4b78b4814 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2a38f6f8c7014a83a6f4440a846ac892'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:56:30.711704 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-071f069a-0459-455d-8656-d7c4b78b4814 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2a38f6f8c7014a83a6f4440a846ac892'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:56:30.712403 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-071f069a-0459-455d-8656-d7c4b78b4814 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2a38f6f8c7014a83a6f4440a846ac892'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:56:30.727591 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-071f069a-0459-455d-8656-d7c4b78b4814 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2a38f6f8c7014a83a6f4440a846ac892'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:56:30.768067 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 884/1742] 10.222.0.15 () {58 vars in 1224 bytes} [Sun Oct 9 00:56:30 2022] DELETE /identity/v3/users/2a38f6f8c7014a83a6f4440a846ac892 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 00:56:31.219548 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03b6a0c-f5c3-406e-adb1-5683894e2b42 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:56:31.221011 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-f03b6a0c-f5c3-406e-adb1-5683894e2b42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:56:31.257726 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03b6a0c-f5c3-406e-adb1-5683894e2b42 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:56:31.425629 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a9108a-f0c4-44ed-8743-35b555ad2a3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:56:31.427658 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a9108a-f0c4-44ed-8743-35b555ad2a3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:31.429481 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a9108a-f0c4-44ed-8743-35b555ad2a3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:31.430010 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a9108a-f0c4-44ed-8743-35b555ad2a3b admin admin] PATH_INFO: `/v3/users/81826b66849e453cb3731e0544517fe0` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:31.436363 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a9108a-f0c4-44ed-8743-35b555ad2a3b admin admin] RBAC: Authorizing `identity:delete_user(user_id=81826b66849e453cb3731e0544517fe0)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:56:31.445943 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a9108a-f0c4-44ed-8743-35b555ad2a3b admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:56:31.511036 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:56:31.576153 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-01a9108a-f0c4-44ed-8743-35b555ad2a3b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '81826b66849e453cb3731e0544517fe0'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:56:31.596932 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-01a9108a-f0c4-44ed-8743-35b555ad2a3b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '81826b66849e453cb3731e0544517fe0'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:56:31.599399 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-01a9108a-f0c4-44ed-8743-35b555ad2a3b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '81826b66849e453cb3731e0544517fe0'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:56:31.601125 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-01a9108a-f0c4-44ed-8743-35b555ad2a3b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '81826b66849e453cb3731e0544517fe0'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:56:31.621685 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-01a9108a-f0c4-44ed-8743-35b555ad2a3b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '81826b66849e453cb3731e0544517fe0'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:56:31.666706 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 859/1743] 10.222.0.15 () {58 vars in 1224 bytes} [Sun Oct 9 00:56:31 2022] DELETE /identity/v3/users/81826b66849e453cb3731e0544517fe0 => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 00:56:31.672066 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4ed0d2-daae-418e-aa63-4aa58712dc4e None None] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:31.673103 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4ed0d2-daae-418e-aa63-4aa58712dc4e None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:31.673851 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4ed0d2-daae-418e-aa63-4aa58712dc4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:31.708934 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a9108a-f0c4-44ed-8743-35b555ad2a3b admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:56:31.711020 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-01a9108a-f0c4-44ed-8743-35b555ad2a3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:56:31.715277 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.auth.core [None req-ac4ed0d2-daae-418e-aa63-4aa58712dc4e None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:56:31.718445 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-ac4ed0d2-daae-418e-aa63-4aa58712dc4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:56:31.877652 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a9108a-f0c4-44ed-8743-35b555ad2a3b admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:56:31.884255 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 885/1744] 10.222.0.15 () {58 vars in 958 bytes} [Sun Oct 9 00:56:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:56:31.887012 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6beddaaf-65c2-4d7c-afae-a122acac9c31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:56:31.887777 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6beddaaf-65c2-4d7c-afae-a122acac9c31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:31.888031 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6beddaaf-65c2-4d7c-afae-a122acac9c31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:31.888419 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6beddaaf-65c2-4d7c-afae-a122acac9c31 admin admin] PATH_INFO: `/v3/projects/4ddf1b6bba254bc2905c6e4dad40aedf` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:31.893090 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4ed0d2-daae-418e-aa63-4aa58712dc4e None None] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:56:31.894363 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6beddaaf-65c2-4d7c-afae-a122acac9c31 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ddf1b6bba254bc2905c6e4dad40aedf)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:56:31.894712 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-ac4ed0d2-daae-418e-aa63-4aa58712dc4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:56:31.900519 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6beddaaf-65c2-4d7c-afae-a122acac9c31 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:56:32.080700 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4ed0d2-daae-418e-aa63-4aa58712dc4e None None] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:56:32.081514 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-6beddaaf-65c2-4d7c-afae-a122acac9c31 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ddf1b6bba254bc2905c6e4dad40aedf', 'request_id': 'req-6beddaaf-65c2-4d7c-afae-a122acac9c31'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:56:32.106651 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-6beddaaf-65c2-4d7c-afae-a122acac9c31 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ddf1b6bba254bc2905c6e4dad40aedf', 'request_id': 'req-6beddaaf-65c2-4d7c-afae-a122acac9c31'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:56:32.127546 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-6beddaaf-65c2-4d7c-afae-a122acac9c31 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ddf1b6bba254bc2905c6e4dad40aedf', 'request_id': 'req-6beddaaf-65c2-4d7c-afae-a122acac9c31'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:56:32.152928 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-6beddaaf-65c2-4d7c-afae-a122acac9c31 admin admin] The token cache is being invalidate because project 4ddf1b6bba254bc2905c6e4dad40aedf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81524) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 09 00:56:32.153202 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-6beddaaf-65c2-4d7c-afae-a122acac9c31 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:56:32.158853 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-6beddaaf-65c2-4d7c-afae-a122acac9c31 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:56:32.165210 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 860/1745] 10.222.0.15 () {58 vars in 1233 bytes} [Sun Oct 9 00:56:31 2022] DELETE /identity/v3/projects/4ddf1b6bba254bc2905c6e4dad40aedf => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 00:56:32.167816 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34fa05e-2f71-42be-b549-bbc0cd1bceb9 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:32.168361 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34fa05e-2f71-42be-b549-bbc0cd1bceb9 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:32.168361 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34fa05e-2f71-42be-b549-bbc0cd1bceb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:32.235305 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99693ecb-621b-49d4-962c-90a8c4f6d6fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4ef90d456d2483e8ddafbe2d4d4fb5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f148d39ced534860abfbe8fc3f98ace4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:56:32.235692 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99693ecb-621b-49d4-962c-90a8c4f6d6fa service neutron] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:32.235896 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99693ecb-621b-49d4-962c-90a8c4f6d6fa service neutron] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:32.236362 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99693ecb-621b-49d4-962c-90a8c4f6d6fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:32.238031 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-99693ecb-621b-49d4-962c-90a8c4f6d6fa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:56:32.245581 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-d34fa05e-2f71-42be-b549-bbc0cd1bceb9 None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:56:32.246901 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-d34fa05e-2f71-42be-b549-bbc0cd1bceb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:56:32.280821 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:56:32.317061 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:56:32.338480 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99693ecb-621b-49d4-962c-90a8c4f6d6fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:56:32.340286 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99693ecb-621b-49d4-962c-90a8c4f6d6fa service neutron] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:56:32.355837 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 886/1746] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Oct 9 00:56:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 463 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 09 00:56:32.415377 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 861/1747] 10.222.0.15 () {58 vars in 958 bytes} [Sun Oct 9 00:56:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:56:32.423284 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4388708c-0820-465e-9ac8-0cfa3a6c3a3a None None] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:32.423913 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4388708c-0820-465e-9ac8-0cfa3a6c3a3a None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:32.424404 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4388708c-0820-465e-9ac8-0cfa3a6c3a3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:32.476171 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.auth.core [None req-4388708c-0820-465e-9ac8-0cfa3a6c3a3a None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:56:32.478684 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-4388708c-0820-465e-9ac8-0cfa3a6c3a3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:56:32.493451 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 887/1748] 10.222.0.15 () {58 vars in 958 bytes} [Sun Oct 9 00:56:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:56:32.498373 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34fa05e-2f71-42be-b549-bbc0cd1bceb9 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:56:32.513471 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34fa05e-2f71-42be-b549-bbc0cd1bceb9 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:56:32.519246 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c9d5ae-3385-48a0-a351-b88f83f73980 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:56:32.520061 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c9d5ae-3385-48a0-a351-b88f83f73980 admin admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:32.520484 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c9d5ae-3385-48a0-a351-b88f83f73980 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:32.520874 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c9d5ae-3385-48a0-a351-b88f83f73980 admin admin] PATH_INFO: `/v3/domains` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:32.522016 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c9d5ae-3385-48a0-a351-b88f83f73980 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:56:32.522676 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c9d5ae-3385-48a0-a351-b88f83f73980 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:56:32.524540 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c9d5ae-3385-48a0-a351-b88f83f73980 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:56:32.549376 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 862/1749] 10.222.0.15 () {58 vars in 1153 bytes} [Sun Oct 9 00:56:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:56:32.550662 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4388708c-0820-465e-9ac8-0cfa3a6c3a3a None None] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:56:32.565255 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4388708c-0820-465e-9ac8-0cfa3a6c3a3a None None] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:56:32.575491 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c04d9d5-14c3-4af3-ac38-1fac1927db9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:56:32.576294 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c04d9d5-14c3-4af3-ac38-1fac1927db9b admin admin] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:32.576672 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c04d9d5-14c3-4af3-ac38-1fac1927db9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:32.577040 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c04d9d5-14c3-4af3-ac38-1fac1927db9b admin admin] PATH_INFO: `/v3/projects` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:32.577815 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c04d9d5-14c3-4af3-ac38-1fac1927db9b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:56:32.582478 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c04d9d5-14c3-4af3-ac38-1fac1927db9b admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:56:32.675423 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 888/1750] 10.222.0.15 () {60 vars in 1153 bytes} [Sun Oct 9 00:56:32 2022] POST /identity/v3/projects => generated 383 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 09 00:56:32.680209 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c9d5ae-3385-48a0-a351-b88f83f73980 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:56:32.710698 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c9d5ae-3385-48a0-a351-b88f83f73980 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:56:32.888784 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f666065-2bc8-43c4-a467-adc042e6bbe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:56:32.889608 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f666065-2bc8-43c4-a467-adc042e6bbe8 admin admin] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:32.889887 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f666065-2bc8-43c4-a467-adc042e6bbe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:32.890297 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f666065-2bc8-43c4-a467-adc042e6bbe8 admin admin] PATH_INFO: `/v3/users` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:32.890807 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f666065-2bc8-43c4-a467-adc042e6bbe8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:56:32.892833 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f666065-2bc8-43c4-a467-adc042e6bbe8 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:56:32.950824 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 863/1751] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Oct 9 00:56:32 2022] POST /identity/v3/users => generated 292 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 09 00:56:32.952877 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c04d9d5-14c3-4af3-ac38-1fac1927db9b admin admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:56:32.983321 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c04d9d5-14c3-4af3-ac38-1fac1927db9b admin admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:56:33.002631 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dd0a7e-a280-4236-9d22-6a6af7aeee44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:56:33.006638 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dd0a7e-a280-4236-9d22-6a6af7aeee44 admin admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:33.007736 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dd0a7e-a280-4236-9d22-6a6af7aeee44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:33.011726 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dd0a7e-a280-4236-9d22-6a6af7aeee44 admin admin] PATH_INFO: `/v3/roles` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:33.012665 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92dd0a7e-a280-4236-9d22-6a6af7aeee44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:56:33.019795 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92dd0a7e-a280-4236-9d22-6a6af7aeee44 admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:56:33.084936 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f666065-2bc8-43c4-a467-adc042e6bbe8 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:56:33.085474 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 889/1752] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Oct 9 00:56:32 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 09 00:56:33.099315 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f666065-2bc8-43c4-a467-adc042e6bbe8 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:56:33.120193 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a7abb7-cc97-4e99-b547-67988ecab759 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:56:33.120931 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a7abb7-cc97-4e99-b547-67988ecab759 admin admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:33.121258 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a7abb7-cc97-4e99-b547-67988ecab759 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:33.121538 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a7abb7-cc97-4e99-b547-67988ecab759 admin admin] PATH_INFO: `/v3/roles` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:33.122211 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a7abb7-cc97-4e99-b547-67988ecab759 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:56:33.127317 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a7abb7-cc97-4e99-b547-67988ecab759 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:56:33.177257 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 864/1753] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Oct 9 00:56:33 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 09 00:56:33.178904 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dd0a7e-a280-4236-9d22-6a6af7aeee44 admin admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:56:33.201840 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dd0a7e-a280-4236-9d22-6a6af7aeee44 admin admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:56:33.217721 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c47eb0-3f3d-4e64-9ba5-9a398ff48b29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:56:33.219457 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c47eb0-3f3d-4e64-9ba5-9a398ff48b29 admin admin] REQUEST_METHOD: `PUT` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:33.220457 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c47eb0-3f3d-4e64-9ba5-9a398ff48b29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:33.220869 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c47eb0-3f3d-4e64-9ba5-9a398ff48b29 admin admin] PATH_INFO: `/v3/projects/aad0ec5f85c6402b8b862e91f135d3da/users/ebb4148db2e5404899a85d77476c5930/roles/afb0a01183d9497795eaa4fa1a4046ae` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:33.297257 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c47eb0-3f3d-4e64-9ba5-9a398ff48b29 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aad0ec5f85c6402b8b862e91f135d3da, user_id=ebb4148db2e5404899a85d77476c5930, role_id=afb0a01183d9497795eaa4fa1a4046ae)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:56:33.300232 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c47eb0-3f3d-4e64-9ba5-9a398ff48b29 admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:56:33.346768 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 890/1754] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Oct 9 00:56:33 2022] PUT /identity/v3/projects/aad0ec5f85c6402b8b862e91f135d3da/users/ebb4148db2e5404899a85d77476c5930/roles/afb0a01183d9497795eaa4fa1a4046ae => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 00:56:33.358835 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65fded7-aded-4bff-a305-6632594c43ee None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:33.359952 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65fded7-aded-4bff-a305-6632594c43ee None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:33.360444 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65fded7-aded-4bff-a305-6632594c43ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:33.411351 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-a65fded7-aded-4bff-a305-6632594c43ee None None] MFA Rules not processed for user `ebb4148db2e5404899a85d77476c5930`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:56:33.413197 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-a65fded7-aded-4bff-a305-6632594c43ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:56:33.641362 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 865/1755] 10.222.0.15 () {58 vars in 958 bytes} [Sun Oct 9 00:56:33 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:56:33.646182 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c47eb0-3f3d-4e64-9ba5-9a398ff48b29 admin admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:56:33.674802 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65fded7-aded-4bff-a305-6632594c43ee None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:56:33.676489 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-a65fded7-aded-4bff-a305-6632594c43ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:56:33.775732 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:56:33.865851 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c47eb0-3f3d-4e64-9ba5-9a398ff48b29 admin admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:56:33.873488 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65fded7-aded-4bff-a305-6632594c43ee None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:56:33.881795 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e14cad0-9099-479a-ab83-44baf742402b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:56:33.882451 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e14cad0-9099-479a-ab83-44baf742402b admin admin] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:33.882731 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e14cad0-9099-479a-ab83-44baf742402b admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:33.883003 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e14cad0-9099-479a-ab83-44baf742402b admin admin] PATH_INFO: `/v3/projects` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:33.884204 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e14cad0-9099-479a-ab83-44baf742402b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:56:33.887375 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fae82b-07c9-4fe9-9834-b3dcc25708c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:56:33.888050 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fae82b-07c9-4fe9-9834-b3dcc25708c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:33.888475 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fae82b-07c9-4fe9-9834-b3dcc25708c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:33.888763 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fae82b-07c9-4fe9-9834-b3dcc25708c0 admin admin] PATH_INFO: `/v3/projects/7badc3430b274c9d8d8dfec5ed3689a8` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:33.890626 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e14cad0-9099-479a-ab83-44baf742402b admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:56:33.892008 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fae82b-07c9-4fe9-9834-b3dcc25708c0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7badc3430b274c9d8d8dfec5ed3689a8)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:56:33.898828 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fae82b-07c9-4fe9-9834-b3dcc25708c0 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:56:33.977810 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 891/1756] 10.222.0.15 () {60 vars in 1153 bytes} [Sun Oct 9 00:56:33 2022] POST /identity/v3/projects => generated 381 bytes in 332 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 09 00:56:33.980614 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e14cad0-9099-479a-ab83-44baf742402b admin admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:56:34.077696 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-46fae82b-07c9-4fe9-9834-b3dcc25708c0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7badc3430b274c9d8d8dfec5ed3689a8', 'request_id': 'req-46fae82b-07c9-4fe9-9834-b3dcc25708c0'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:56:34.106928 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-46fae82b-07c9-4fe9-9834-b3dcc25708c0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7badc3430b274c9d8d8dfec5ed3689a8', 'request_id': 'req-46fae82b-07c9-4fe9-9834-b3dcc25708c0'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:56:34.118689 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-46fae82b-07c9-4fe9-9834-b3dcc25708c0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7badc3430b274c9d8d8dfec5ed3689a8', 'request_id': 'req-46fae82b-07c9-4fe9-9834-b3dcc25708c0'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:56:34.158064 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-46fae82b-07c9-4fe9-9834-b3dcc25708c0 admin admin] The token cache is being invalidate because project 7badc3430b274c9d8d8dfec5ed3689a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81524) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 09 00:56:34.158405 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-46fae82b-07c9-4fe9-9834-b3dcc25708c0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:56:34.159566 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-46fae82b-07c9-4fe9-9834-b3dcc25708c0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:56:34.169917 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 866/1757] 10.222.0.15 () {58 vars in 1233 bytes} [Sun Oct 9 00:56:33 2022] DELETE /identity/v3/projects/7badc3430b274c9d8d8dfec5ed3689a8 => generated 0 bytes in 492 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 09 00:56:34.171302 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fae82b-07c9-4fe9-9834-b3dcc25708c0 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:56:34.173502 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-46fae82b-07c9-4fe9-9834-b3dcc25708c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:56:34.184441 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:56:34.255658 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e14cad0-9099-479a-ab83-44baf742402b admin admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:56:34.345443 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fae82b-07c9-4fe9-9834-b3dcc25708c0 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:56:34.352613 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa62fa6-53c6-4777-98e6-16ec9617107f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:56:34.353484 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa62fa6-53c6-4777-98e6-16ec9617107f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:34.353857 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa62fa6-53c6-4777-98e6-16ec9617107f admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:34.354133 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa62fa6-53c6-4777-98e6-16ec9617107f admin admin] PATH_INFO: `/v3/users/11955cdc464942bf8e7e66b5f2e0cb33` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:34.355589 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa62fa6-53c6-4777-98e6-16ec9617107f admin admin] RBAC: Authorizing `identity:delete_user(user_id=11955cdc464942bf8e7e66b5f2e0cb33)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:56:34.357829 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa62fa6-53c6-4777-98e6-16ec9617107f admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:56:34.379381 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9ff61f-7924-4bd3-891b-554c1fe28332 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:56:34.380551 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9ff61f-7924-4bd3-891b-554c1fe28332 admin admin] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:34.380551 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9ff61f-7924-4bd3-891b-554c1fe28332 admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:34.380944 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9ff61f-7924-4bd3-891b-554c1fe28332 admin admin] PATH_INFO: `/v3/users` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:34.381615 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9ff61f-7924-4bd3-891b-554c1fe28332 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:56:34.389551 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9ff61f-7924-4bd3-891b-554c1fe28332 admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:56:34.430231 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 892/1758] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Oct 9 00:56:33 2022] POST /identity/v3/users => generated 297 bytes in 450 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 09 00:56:34.435194 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9ff61f-7924-4bd3-891b-554c1fe28332 admin admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:56:34.443564 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-1f9ff61f-7924-4bd3-891b-554c1fe28332 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:56:34.476734 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9ff61f-7924-4bd3-891b-554c1fe28332 admin admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:56:34.481123 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-7fa62fa6-53c6-4777-98e6-16ec9617107f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '11955cdc464942bf8e7e66b5f2e0cb33'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:56:34.488789 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5613d9-d7a1-43ec-86fc-a27eeb408095 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:56:34.489297 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5613d9-d7a1-43ec-86fc-a27eeb408095 admin admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:34.491137 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5613d9-d7a1-43ec-86fc-a27eeb408095 admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:34.491508 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5613d9-d7a1-43ec-86fc-a27eeb408095 admin admin] PATH_INFO: `/v3/roles` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:34.492185 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5613d9-d7a1-43ec-86fc-a27eeb408095 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:56:34.496543 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5613d9-d7a1-43ec-86fc-a27eeb408095 admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:56:34.498919 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-7fa62fa6-53c6-4777-98e6-16ec9617107f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '11955cdc464942bf8e7e66b5f2e0cb33'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:56:34.499710 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-7fa62fa6-53c6-4777-98e6-16ec9617107f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '11955cdc464942bf8e7e66b5f2e0cb33'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:56:34.500315 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-7fa62fa6-53c6-4777-98e6-16ec9617107f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '11955cdc464942bf8e7e66b5f2e0cb33'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:56:34.503667 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:56:34.525551 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-7fa62fa6-53c6-4777-98e6-16ec9617107f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '11955cdc464942bf8e7e66b5f2e0cb33'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:56:34.534474 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 893/1759] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Oct 9 00:56:34 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 09 00:56:34.541566 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5613d9-d7a1-43ec-86fc-a27eeb408095 admin admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:56:34.547626 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-8d5613d9-d7a1-43ec-86fc-a27eeb408095 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:56:34.582943 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 867/1760] 10.222.0.15 () {58 vars in 1224 bytes} [Sun Oct 9 00:56:34 2022] DELETE /identity/v3/users/11955cdc464942bf8e7e66b5f2e0cb33 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 00:56:34.602929 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5613d9-d7a1-43ec-86fc-a27eeb408095 admin admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:56:34.608435 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d282cd5f-9555-4ef6-be04-c04573ec43ae None None] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:34.608966 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d282cd5f-9555-4ef6-be04-c04573ec43ae None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:34.610606 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d282cd5f-9555-4ef6-be04-c04573ec43ae None None] PATH_INFO: `/` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:34.613121 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 868/1761] 10.222.0.15 () {54 vars in 921 bytes} [Sun Oct 9 00:56:34 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:56:34.670629 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2e9f25-d5e8-4ad6-84f2-252ad48a1155 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:34.671076 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2e9f25-d5e8-4ad6-84f2-252ad48a1155 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:34.671567 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2e9f25-d5e8-4ad6-84f2-252ad48a1155 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:34.725710 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ab68dd-0bc3-4f59-9bcb-3d1e5217a222 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:56:34.726407 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ab68dd-0bc3-4f59-9bcb-3d1e5217a222 admin admin] REQUEST_METHOD: `PUT` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:34.726759 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ab68dd-0bc3-4f59-9bcb-3d1e5217a222 admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:34.727067 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ab68dd-0bc3-4f59-9bcb-3d1e5217a222 admin admin] PATH_INFO: `/v3/projects/c4dec193ffb545d082dbb33d932967b0/users/69782c79e01d4d8dab97a95028fe4430/roles/f69dddf26daf4dd79d4c962beb877af5` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:34.769908 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-ba2e9f25-d5e8-4ad6-84f2-252ad48a1155 None None] MFA Rules not processed for user `4ac83d57fba841e0a666710732249c49`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:56:34.771163 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ab68dd-0bc3-4f59-9bcb-3d1e5217a222 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4dec193ffb545d082dbb33d932967b0, user_id=69782c79e01d4d8dab97a95028fe4430, role_id=f69dddf26daf4dd79d4c962beb877af5)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:56:34.773869 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-ba2e9f25-d5e8-4ad6-84f2-252ad48a1155 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:56:34.776632 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ab68dd-0bc3-4f59-9bcb-3d1e5217a222 admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:56:34.820219 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 894/1762] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Oct 9 00:56:34 2022] PUT /identity/v3/projects/c4dec193ffb545d082dbb33d932967b0/users/69782c79e01d4d8dab97a95028fe4430/roles/f69dddf26daf4dd79d4c962beb877af5 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 09 00:56:34.821520 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ab68dd-0bc3-4f59-9bcb-3d1e5217a222 admin admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:56:34.959097 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:56:34.973202 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 869/1763] 10.222.0.15 () {58 vars in 1018 bytes} [Sun Oct 9 00:56:34 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 307 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:56:34.983704 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ab68dd-0bc3-4f59-9bcb-3d1e5217a222 admin admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:56:34.996953 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9627f47-f2ee-484d-a759-76c301e25208 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:56:34.997899 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9627f47-f2ee-484d-a759-76c301e25208 admin admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:34.998184 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9627f47-f2ee-484d-a759-76c301e25208 admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:34.998451 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9627f47-f2ee-484d-a759-76c301e25208 admin admin] PATH_INFO: `/v3/roles` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:34.999188 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9627f47-f2ee-484d-a759-76c301e25208 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:56:35.000924 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9627f47-f2ee-484d-a759-76c301e25208 admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:56:35.030474 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 895/1764] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Oct 9 00:56:34 2022] GET /identity/v3/roles => generated 1420 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 09 00:56:35.035638 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2e9f25-d5e8-4ad6-84f2-252ad48a1155 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:56:35.054644 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2e9f25-d5e8-4ad6-84f2-252ad48a1155 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:56:35.068850 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6d2527-9d4c-4091-b1ca-bd4575f93a5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:56:35.069553 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6d2527-9d4c-4091-b1ca-bd4575f93a5e admin admin] REQUEST_METHOD: `PUT` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:35.069856 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6d2527-9d4c-4091-b1ca-bd4575f93a5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:35.070112 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6d2527-9d4c-4091-b1ca-bd4575f93a5e admin admin] PATH_INFO: `/v3/projects/c4dec193ffb545d082dbb33d932967b0/users/69782c79e01d4d8dab97a95028fe4430/roles/f69dddf26daf4dd79d4c962beb877af5` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:35.074402 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6d2527-9d4c-4091-b1ca-bd4575f93a5e admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4dec193ffb545d082dbb33d932967b0, user_id=69782c79e01d4d8dab97a95028fe4430, role_id=f69dddf26daf4dd79d4c962beb877af5)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:56:35.082385 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6d2527-9d4c-4091-b1ca-bd4575f93a5e admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:56:35.108792 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 870/1765] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Oct 9 00:56:35 2022] PUT /identity/v3/projects/c4dec193ffb545d082dbb33d932967b0/users/69782c79e01d4d8dab97a95028fe4430/roles/f69dddf26daf4dd79d4c962beb877af5 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 00:56:35.111067 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854fe755-5fd5-4ff7-ba74-37e14af61d25 None None] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:35.112005 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854fe755-5fd5-4ff7-ba74-37e14af61d25 None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:35.112595 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854fe755-5fd5-4ff7-ba74-37e14af61d25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:35.186850 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.auth.core [None req-854fe755-5fd5-4ff7-ba74-37e14af61d25 None None] MFA Rules not processed for user `69782c79e01d4d8dab97a95028fe4430`. Rule list: `[]` (Enabled: `True`). {{(pid=81525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:56:35.195928 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-854fe755-5fd5-4ff7-ba74-37e14af61d25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:56:35.421512 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 896/1766] 10.222.0.15 () {58 vars in 958 bytes} [Sun Oct 9 00:56:35 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 310 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:56:35.434355 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6d2527-9d4c-4091-b1ca-bd4575f93a5e admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:56:35.454103 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-0e6d2527-9d4c-4091-b1ca-bd4575f93a5e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:56:35.485488 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854fe755-5fd5-4ff7-ba74-37e14af61d25 None None] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:56:35.487364 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-854fe755-5fd5-4ff7-ba74-37e14af61d25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:56:35.628133 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6d2527-9d4c-4091-b1ca-bd4575f93a5e admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:56:35.649656 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046ba727-653c-4217-96c1-0f4b462de9ab service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff7cb78bcd91467abe5c2e2b48aedd1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f148d39ced534860abfbe8fc3f98ace4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:56:35.651252 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046ba727-653c-4217-96c1-0f4b462de9ab service cinder] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:35.652925 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046ba727-653c-4217-96c1-0f4b462de9ab service cinder] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:35.653950 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046ba727-653c-4217-96c1-0f4b462de9ab service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:35.666030 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854fe755-5fd5-4ff7-ba74-37e14af61d25 None None] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:56:35.681357 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046ba727-653c-4217-96c1-0f4b462de9ab service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:56:35.681740 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1302d683-525b-42b3-922d-8677e0e04d1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:56:35.683778 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1302d683-525b-42b3-922d-8677e0e04d1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:35.684154 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1302d683-525b-42b3-922d-8677e0e04d1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:35.685050 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046ba727-653c-4217-96c1-0f4b462de9ab service cinder] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:56:35.685376 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1302d683-525b-42b3-922d-8677e0e04d1e admin admin] PATH_INFO: `/v3/projects/5c31c8b6cb8b4e7cb42caa31c9cff2fe` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:35.690296 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1302d683-525b-42b3-922d-8677e0e04d1e admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c31c8b6cb8b4e7cb42caa31c9cff2fe)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:56:35.695817 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1302d683-525b-42b3-922d-8677e0e04d1e admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:56:35.720396 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 871/1767] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Oct 9 00:56:35 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 09 00:56:35.838949 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-1302d683-525b-42b3-922d-8677e0e04d1e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c31c8b6cb8b4e7cb42caa31c9cff2fe', 'request_id': 'req-1302d683-525b-42b3-922d-8677e0e04d1e'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:56:35.856767 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-1302d683-525b-42b3-922d-8677e0e04d1e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c31c8b6cb8b4e7cb42caa31c9cff2fe', 'request_id': 'req-1302d683-525b-42b3-922d-8677e0e04d1e'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:56:35.866648 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-1302d683-525b-42b3-922d-8677e0e04d1e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c31c8b6cb8b4e7cb42caa31c9cff2fe', 'request_id': 'req-1302d683-525b-42b3-922d-8677e0e04d1e'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:56:35.911375 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-1302d683-525b-42b3-922d-8677e0e04d1e admin admin] The token cache is being invalidate because project 5c31c8b6cb8b4e7cb42caa31c9cff2fe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81525) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 09 00:56:35.913262 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-1302d683-525b-42b3-922d-8677e0e04d1e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:56:35.918429 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-1302d683-525b-42b3-922d-8677e0e04d1e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:56:35.921438 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 897/1768] 10.222.0.15 () {58 vars in 1233 bytes} [Sun Oct 9 00:56:35 2022] DELETE /identity/v3/projects/5c31c8b6cb8b4e7cb42caa31c9cff2fe => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 00:56:35.926563 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549d503b-80aa-47d2-8356-9638271423a1 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:35.926893 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549d503b-80aa-47d2-8356-9638271423a1 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:35.927407 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549d503b-80aa-47d2-8356-9638271423a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:35.960607 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1302d683-525b-42b3-922d-8677e0e04d1e admin admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:56:35.962588 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-1302d683-525b-42b3-922d-8677e0e04d1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:56:35.969142 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:56:35.981187 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-549d503b-80aa-47d2-8356-9638271423a1 None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:56:35.985390 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-549d503b-80aa-47d2-8356-9638271423a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:56:36.057281 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1302d683-525b-42b3-922d-8677e0e04d1e admin admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:56:36.066567 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:INSERT=2,keystone:DELETE=3,keystone:SELECT=95 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:56:36.066780 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5eddd09-ea76-429d-b891-fc5a5218a01c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff7cb78bcd91467abe5c2e2b48aedd1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f148d39ced534860abfbe8fc3f98ace4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:56:36.067376 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5eddd09-ea76-429d-b891-fc5a5218a01c service cinder] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:36.067550 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5eddd09-ea76-429d-b891-fc5a5218a01c service cinder] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:36.067803 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5eddd09-ea76-429d-b891-fc5a5218a01c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:36.073455 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-a5eddd09-ea76-429d-b891-fc5a5218a01c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:56:36.092545 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 872/1769] 10.222.0.15 () {58 vars in 958 bytes} [Sun Oct 9 00:56:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:56:36.101383 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d543bf-3960-4909-9cc2-9306b274d925 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:36.101687 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d543bf-3960-4909-9cc2-9306b274d925 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:36.101922 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d543bf-3960-4909-9cc2-9306b274d925 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:36.152030 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-c4d543bf-3960-4909-9cc2-9306b274d925 None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:56:36.153395 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-c4d543bf-3960-4909-9cc2-9306b274d925 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:56:36.178442 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 873/1770] 10.222.0.15 () {58 vars in 958 bytes} [Sun Oct 9 00:56:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:56:36.183029 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d543bf-3960-4909-9cc2-9306b274d925 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:56:36.197299 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d543bf-3960-4909-9cc2-9306b274d925 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:56:36.215177 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0281c88-d369-4d7d-a3c8-0a4b8eddfba5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:56:36.215869 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0281c88-d369-4d7d-a3c8-0a4b8eddfba5 admin admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:36.216119 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0281c88-d369-4d7d-a3c8-0a4b8eddfba5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:36.216425 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0281c88-d369-4d7d-a3c8-0a4b8eddfba5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:36.217051 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0281c88-d369-4d7d-a3c8-0a4b8eddfba5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:56:36.217349 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0281c88-d369-4d7d-a3c8-0a4b8eddfba5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:56:36.219005 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0281c88-d369-4d7d-a3c8-0a4b8eddfba5 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:56:36.223768 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5eddd09-ea76-429d-b891-fc5a5218a01c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:56:36.225270 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5eddd09-ea76-429d-b891-fc5a5218a01c service cinder] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:56:36.250672 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 898/1771] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Oct 9 00:56:35 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 09 00:56:36.252006 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5eddd09-ea76-429d-b891-fc5a5218a01c service cinder] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:56:36.252264 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 874/1772] 10.222.0.15 () {58 vars in 1153 bytes} [Sun Oct 9 00:56:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:56:36.264609 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5eddd09-ea76-429d-b891-fc5a5218a01c service cinder] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:56:36.270192 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d070a84-4e5c-4125-92dd-0628384f7fa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:56:36.270902 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d070a84-4e5c-4125-92dd-0628384f7fa1 admin admin] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:36.272238 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d070a84-4e5c-4125-92dd-0628384f7fa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:36.272594 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d070a84-4e5c-4125-92dd-0628384f7fa1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:36.273320 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d070a84-4e5c-4125-92dd-0628384f7fa1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:56:36.275483 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d070a84-4e5c-4125-92dd-0628384f7fa1 admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:56:36.325884 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0281c88-d369-4d7d-a3c8-0a4b8eddfba5 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:56:36.328160 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 899/1773] 10.222.0.15 () {60 vars in 1153 bytes} [Sun Oct 9 00:56:36 2022] POST /identity/v3/projects => generated 381 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 09 00:56:36.340499 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0281c88-d369-4d7d-a3c8-0a4b8eddfba5 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:56:36.437526 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798f0371-93e6-47f3-a5d6-b6ae7b2e25cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:56:36.438656 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798f0371-93e6-47f3-a5d6-b6ae7b2e25cb admin admin] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:36.439137 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798f0371-93e6-47f3-a5d6-b6ae7b2e25cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:36.439615 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798f0371-93e6-47f3-a5d6-b6ae7b2e25cb admin admin] PATH_INFO: `/v3/users` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:36.440602 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798f0371-93e6-47f3-a5d6-b6ae7b2e25cb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:56:36.444064 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798f0371-93e6-47f3-a5d6-b6ae7b2e25cb admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:56:36.494921 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 875/1774] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Oct 9 00:56:36 2022] POST /identity/v3/users => generated 291 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 09 00:56:36.498064 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d070a84-4e5c-4125-92dd-0628384f7fa1 admin admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:56:36.512421 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d070a84-4e5c-4125-92dd-0628384f7fa1 admin admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:56:36.534404 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b5f1d7-4424-4848-b5cb-4300736c461e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:56:36.535291 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b5f1d7-4424-4848-b5cb-4300736c461e admin admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:36.537183 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b5f1d7-4424-4848-b5cb-4300736c461e admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:36.538111 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b5f1d7-4424-4848-b5cb-4300736c461e admin admin] PATH_INFO: `/v3/roles` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:36.539878 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b5f1d7-4424-4848-b5cb-4300736c461e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:56:36.550045 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b5f1d7-4424-4848-b5cb-4300736c461e admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:56:36.568532 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798f0371-93e6-47f3-a5d6-b6ae7b2e25cb admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:56:36.576528 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 900/1775] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Oct 9 00:56:36 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 09 00:56:36.586478 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798f0371-93e6-47f3-a5d6-b6ae7b2e25cb admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:56:36.592728 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa03232e-0c25-4c98-bbb4-e68980032bb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:56:36.593466 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa03232e-0c25-4c98-bbb4-e68980032bb5 admin admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:36.594163 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa03232e-0c25-4c98-bbb4-e68980032bb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:36.594514 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa03232e-0c25-4c98-bbb4-e68980032bb5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:36.595359 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa03232e-0c25-4c98-bbb4-e68980032bb5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:56:36.597338 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa03232e-0c25-4c98-bbb4-e68980032bb5 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:56:36.619196 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b5f1d7-4424-4848-b5cb-4300736c461e admin admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:56:36.635494 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 876/1776] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Oct 9 00:56:36 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 09 00:56:36.639295 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b5f1d7-4424-4848-b5cb-4300736c461e admin admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:56:36.654114 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9213803-2eb0-4838-a96d-63d62582f337 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:56:36.655739 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9213803-2eb0-4838-a96d-63d62582f337 admin admin] REQUEST_METHOD: `PUT` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:36.655739 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9213803-2eb0-4838-a96d-63d62582f337 admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:36.655739 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9213803-2eb0-4838-a96d-63d62582f337 admin admin] PATH_INFO: `/v3/projects/f63546bfb609468b8cc2732d1c84ba09/users/be6ca136d1284741bbc83854dcad3d9d/roles/afb0a01183d9497795eaa4fa1a4046ae` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:36.697988 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9213803-2eb0-4838-a96d-63d62582f337 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f63546bfb609468b8cc2732d1c84ba09, user_id=be6ca136d1284741bbc83854dcad3d9d, role_id=afb0a01183d9497795eaa4fa1a4046ae)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:56:36.707202 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9213803-2eb0-4838-a96d-63d62582f337 admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:56:36.738098 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 901/1777] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Oct 9 00:56:36 2022] PUT /identity/v3/projects/f63546bfb609468b8cc2732d1c84ba09/users/be6ca136d1284741bbc83854dcad3d9d/roles/afb0a01183d9497795eaa4fa1a4046ae => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 00:56:36.748864 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126ee1bd-608f-4b3e-8bbd-f78a23120269 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:36.749158 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126ee1bd-608f-4b3e-8bbd-f78a23120269 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:36.749390 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126ee1bd-608f-4b3e-8bbd-f78a23120269 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:36.844966 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-126ee1bd-608f-4b3e-8bbd-f78a23120269 None None] MFA Rules not processed for user `be6ca136d1284741bbc83854dcad3d9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:56:36.847168 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-126ee1bd-608f-4b3e-8bbd-f78a23120269 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:56:37.016089 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 877/1778] 10.222.0.15 () {58 vars in 958 bytes} [Sun Oct 9 00:56:36 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:56:37.016926 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9213803-2eb0-4838-a96d-63d62582f337 admin admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:56:37.105369 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9213803-2eb0-4838-a96d-63d62582f337 admin admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:56:37.117817 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed29186d-ded6-4778-8060-ae18181ca6f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:56:37.118423 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed29186d-ded6-4778-8060-ae18181ca6f1 admin admin] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:37.118703 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed29186d-ded6-4778-8060-ae18181ca6f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:37.118970 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed29186d-ded6-4778-8060-ae18181ca6f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:37.120000 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed29186d-ded6-4778-8060-ae18181ca6f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:56:37.123656 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed29186d-ded6-4778-8060-ae18181ca6f1 admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:56:37.129109 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:56:37.172473 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 902/1779] 10.222.0.15 () {60 vars in 1153 bytes} [Sun Oct 9 00:56:37 2022] POST /identity/v3/projects => generated 379 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 09 00:56:37.174859 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126ee1bd-608f-4b3e-8bbd-f78a23120269 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:56:37.191746 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126ee1bd-608f-4b3e-8bbd-f78a23120269 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:56:37.259081 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:56:37.291531 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27768193-cc11-4701-9846-4bc5120bbbb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:56:37.293423 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27768193-cc11-4701-9846-4bc5120bbbb9 admin admin] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:37.294095 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27768193-cc11-4701-9846-4bc5120bbbb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:37.295297 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27768193-cc11-4701-9846-4bc5120bbbb9 admin admin] PATH_INFO: `/v3/users` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:37.296298 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27768193-cc11-4701-9846-4bc5120bbbb9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:56:37.298573 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27768193-cc11-4701-9846-4bc5120bbbb9 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:56:37.339538 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 878/1780] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Oct 9 00:56:37 2022] POST /identity/v3/users => generated 296 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 09 00:56:37.340505 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed29186d-ded6-4778-8060-ae18181ca6f1 admin admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:56:37.360360 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed29186d-ded6-4778-8060-ae18181ca6f1 admin admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:56:37.366173 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d77002-a04e-4dd3-980b-159c282063b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:56:37.367394 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d77002-a04e-4dd3-980b-159c282063b2 admin admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:37.367523 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d77002-a04e-4dd3-980b-159c282063b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:37.367934 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d77002-a04e-4dd3-980b-159c282063b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:37.369917 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d77002-a04e-4dd3-980b-159c282063b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:56:37.372331 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d77002-a04e-4dd3-980b-159c282063b2 admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:56:37.393113 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 903/1781] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Oct 9 00:56:37 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 09 00:56:37.396981 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27768193-cc11-4701-9846-4bc5120bbbb9 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:56:37.418519 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27768193-cc11-4701-9846-4bc5120bbbb9 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:56:37.440129 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f65b34-cf83-48a2-af7f-616f80a1bb5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:56:37.443702 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f65b34-cf83-48a2-af7f-616f80a1bb5f admin admin] REQUEST_METHOD: `PUT` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:37.445286 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f65b34-cf83-48a2-af7f-616f80a1bb5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:37.445775 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f65b34-cf83-48a2-af7f-616f80a1bb5f admin admin] PATH_INFO: `/v3/projects/f5e255b00cc244cd979597d2eb7da423/users/e70e1d4cfaa24514bb1c18bb3280989c/roles/f69dddf26daf4dd79d4c962beb877af5` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:37.500617 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f65b34-cf83-48a2-af7f-616f80a1bb5f admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5e255b00cc244cd979597d2eb7da423, user_id=e70e1d4cfaa24514bb1c18bb3280989c, role_id=f69dddf26daf4dd79d4c962beb877af5)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:56:37.503888 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f65b34-cf83-48a2-af7f-616f80a1bb5f admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:56:37.530828 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 879/1782] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Oct 9 00:56:37 2022] PUT /identity/v3/projects/f5e255b00cc244cd979597d2eb7da423/users/e70e1d4cfaa24514bb1c18bb3280989c/roles/f69dddf26daf4dd79d4c962beb877af5 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 00:56:37.536501 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d77002-a04e-4dd3-980b-159c282063b2 admin admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:56:37.564245 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d77002-a04e-4dd3-980b-159c282063b2 admin admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:56:37.753920 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1252fdc1-3ba2-4427-8885-bb02f63de336 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:56:37.754671 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1252fdc1-3ba2-4427-8885-bb02f63de336 admin admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:37.754952 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1252fdc1-3ba2-4427-8885-bb02f63de336 admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:37.755219 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1252fdc1-3ba2-4427-8885-bb02f63de336 admin admin] PATH_INFO: `/v3/roles` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:37.756220 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1252fdc1-3ba2-4427-8885-bb02f63de336 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:56:37.758216 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1252fdc1-3ba2-4427-8885-bb02f63de336 admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:56:37.797031 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 904/1783] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Oct 9 00:56:37 2022] GET /identity/v3/roles => generated 1420 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 09 00:56:37.798279 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f65b34-cf83-48a2-af7f-616f80a1bb5f admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:56:37.814421 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f65b34-cf83-48a2-af7f-616f80a1bb5f admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:56:37.833038 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1b0703-64c6-4639-aafe-53b58a0356a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:56:37.833861 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1b0703-64c6-4639-aafe-53b58a0356a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:37.834267 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1b0703-64c6-4639-aafe-53b58a0356a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:37.834642 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1b0703-64c6-4639-aafe-53b58a0356a1 admin admin] PATH_INFO: `/v3/projects/f5e255b00cc244cd979597d2eb7da423/users/e70e1d4cfaa24514bb1c18bb3280989c/roles/f69dddf26daf4dd79d4c962beb877af5` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:37.849207 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1b0703-64c6-4639-aafe-53b58a0356a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5e255b00cc244cd979597d2eb7da423, user_id=e70e1d4cfaa24514bb1c18bb3280989c, role_id=f69dddf26daf4dd79d4c962beb877af5)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:56:37.861963 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1b0703-64c6-4639-aafe-53b58a0356a1 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:56:37.913297 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 880/1784] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Oct 9 00:56:37 2022] PUT /identity/v3/projects/f5e255b00cc244cd979597d2eb7da423/users/e70e1d4cfaa24514bb1c18bb3280989c/roles/f69dddf26daf4dd79d4c962beb877af5 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 00:56:37.915484 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dec93e5-a18b-4cca-957b-6f0fab106187 None None] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:37.916043 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dec93e5-a18b-4cca-957b-6f0fab106187 None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:37.916400 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dec93e5-a18b-4cca-957b-6f0fab106187 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:38.024267 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.auth.core [None req-1dec93e5-a18b-4cca-957b-6f0fab106187 None None] MFA Rules not processed for user `e70e1d4cfaa24514bb1c18bb3280989c`. Rule list: `[]` (Enabled: `True`). {{(pid=81525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:56:38.026475 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-1dec93e5-a18b-4cca-957b-6f0fab106187 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:56:38.260201 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 905/1785] 10.222.0.15 () {58 vars in 958 bytes} [Sun Oct 9 00:56:37 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 346 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:56:38.289790 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1b0703-64c6-4639-aafe-53b58a0356a1 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:56:38.292632 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-ed1b0703-64c6-4639-aafe-53b58a0356a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:56:38.403469 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1b0703-64c6-4639-aafe-53b58a0356a1 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:56:38.408452 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1911dca2-c7ff-47d2-9cfc-2cb7f60139db service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff7cb78bcd91467abe5c2e2b48aedd1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f148d39ced534860abfbe8fc3f98ace4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:56:38.409241 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1911dca2-c7ff-47d2-9cfc-2cb7f60139db service cinder] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:38.409636 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1911dca2-c7ff-47d2-9cfc-2cb7f60139db service cinder] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:38.410119 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1911dca2-c7ff-47d2-9cfc-2cb7f60139db service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:38.435590 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1911dca2-c7ff-47d2-9cfc-2cb7f60139db service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:56:38.437069 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1911dca2-c7ff-47d2-9cfc-2cb7f60139db service cinder] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:56:38.457024 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 881/1786] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Oct 9 00:56:38 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 09 00:56:39.037609 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dec93e5-a18b-4cca-957b-6f0fab106187 None None] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:56:39.047477 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dec93e5-a18b-4cca-957b-6f0fab106187 None None] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:56:39.052549 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbd1c7b-df76-4ff9-878c-b402d35258a2 tempest-VolumeQuotaClassesTest-793451574 tempest-VolumeQuotaClassesTest-793451574-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70e1d4cfaa24514bb1c18bb3280989c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5e255b00cc244cd979597d2eb7da423', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:56:39.053288 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbd1c7b-df76-4ff9-878c-b402d35258a2 tempest-VolumeQuotaClassesTest-793451574 tempest-VolumeQuotaClassesTest-793451574-project-admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:39.053610 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbd1c7b-df76-4ff9-878c-b402d35258a2 tempest-VolumeQuotaClassesTest-793451574 tempest-VolumeQuotaClassesTest-793451574-project-admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:39.053727 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbd1c7b-df76-4ff9-878c-b402d35258a2 tempest-VolumeQuotaClassesTest-793451574 tempest-VolumeQuotaClassesTest-793451574-project-admin] PATH_INFO: `/v3/domains` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:39.054500 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbd1c7b-df76-4ff9-878c-b402d35258a2 tempest-VolumeQuotaClassesTest-793451574 tempest-VolumeQuotaClassesTest-793451574-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:56:39.054686 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbd1c7b-df76-4ff9-878c-b402d35258a2 tempest-VolumeQuotaClassesTest-793451574 tempest-VolumeQuotaClassesTest-793451574-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:56:39.056335 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbd1c7b-df76-4ff9-878c-b402d35258a2 tempest-VolumeQuotaClassesTest-793451574 tempest-VolumeQuotaClassesTest-793451574-project-admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:56:39.074266 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 906/1787] 10.222.0.15 () {58 vars in 1153 bytes} [Sun Oct 9 00:56:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:56:39.076630 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1911dca2-c7ff-47d2-9cfc-2cb7f60139db service cinder] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:56:39.087382 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1911dca2-c7ff-47d2-9cfc-2cb7f60139db service cinder] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:56:39.092583 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55af6d9-b261-43cf-854e-fad3155b6d58 tempest-VolumeQuotaClassesTest-793451574 tempest-VolumeQuotaClassesTest-793451574-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70e1d4cfaa24514bb1c18bb3280989c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5e255b00cc244cd979597d2eb7da423', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:56:39.093195 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55af6d9-b261-43cf-854e-fad3155b6d58 tempest-VolumeQuotaClassesTest-793451574 tempest-VolumeQuotaClassesTest-793451574-project-admin] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:39.093470 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55af6d9-b261-43cf-854e-fad3155b6d58 tempest-VolumeQuotaClassesTest-793451574 tempest-VolumeQuotaClassesTest-793451574-project-admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:39.093738 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55af6d9-b261-43cf-854e-fad3155b6d58 tempest-VolumeQuotaClassesTest-793451574 tempest-VolumeQuotaClassesTest-793451574-project-admin] PATH_INFO: `/v3/projects` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:39.094372 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55af6d9-b261-43cf-854e-fad3155b6d58 tempest-VolumeQuotaClassesTest-793451574 tempest-VolumeQuotaClassesTest-793451574-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:56:39.096405 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55af6d9-b261-43cf-854e-fad3155b6d58 tempest-VolumeQuotaClassesTest-793451574 tempest-VolumeQuotaClassesTest-793451574-project-admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:56:39.139833 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 882/1788] 10.222.0.15 () {60 vars in 1153 bytes} [Sun Oct 9 00:56:39 2022] POST /identity/v3/projects => generated 354 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 09 00:56:39.141414 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbd1c7b-df76-4ff9-878c-b402d35258a2 tempest-VolumeQuotaClassesTest-793451574 tempest-VolumeQuotaClassesTest-793451574-project-admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:56:39.160016 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbd1c7b-df76-4ff9-878c-b402d35258a2 tempest-VolumeQuotaClassesTest-793451574 tempest-VolumeQuotaClassesTest-793451574-project-admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:56:39.266286 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:56:39.316063 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721eddd2-f25e-4d7a-b50a-0eb06c015312 tempest-VolumeQuotaClassesTest-793451574 tempest-VolumeQuotaClassesTest-793451574-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70e1d4cfaa24514bb1c18bb3280989c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5e255b00cc244cd979597d2eb7da423', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:56:39.316861 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721eddd2-f25e-4d7a-b50a-0eb06c015312 tempest-VolumeQuotaClassesTest-793451574 tempest-VolumeQuotaClassesTest-793451574-project-admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:39.317117 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721eddd2-f25e-4d7a-b50a-0eb06c015312 tempest-VolumeQuotaClassesTest-793451574 tempest-VolumeQuotaClassesTest-793451574-project-admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:39.317516 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721eddd2-f25e-4d7a-b50a-0eb06c015312 tempest-VolumeQuotaClassesTest-793451574 tempest-VolumeQuotaClassesTest-793451574-project-admin] PATH_INFO: `/v3/domains` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:39.318038 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721eddd2-f25e-4d7a-b50a-0eb06c015312 tempest-VolumeQuotaClassesTest-793451574 tempest-VolumeQuotaClassesTest-793451574-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:56:39.318479 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721eddd2-f25e-4d7a-b50a-0eb06c015312 tempest-VolumeQuotaClassesTest-793451574 tempest-VolumeQuotaClassesTest-793451574-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:56:39.320338 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721eddd2-f25e-4d7a-b50a-0eb06c015312 tempest-VolumeQuotaClassesTest-793451574 tempest-VolumeQuotaClassesTest-793451574-project-admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:56:39.338763 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 907/1789] 10.222.0.15 () {58 vars in 1153 bytes} [Sun Oct 9 00:56:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:56:39.368997 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55af6d9-b261-43cf-854e-fad3155b6d58 tempest-VolumeQuotaClassesTest-793451574 tempest-VolumeQuotaClassesTest-793451574-project-admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:56:39.371436 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-d55af6d9-b261-43cf-854e-fad3155b6d58 tempest-VolumeQuotaClassesTest-793451574 tempest-VolumeQuotaClassesTest-793451574-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:56:39.408327 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721eddd2-f25e-4d7a-b50a-0eb06c015312 tempest-VolumeQuotaClassesTest-793451574 tempest-VolumeQuotaClassesTest-793451574-project-admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:56:39.420633 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721eddd2-f25e-4d7a-b50a-0eb06c015312 tempest-VolumeQuotaClassesTest-793451574 tempest-VolumeQuotaClassesTest-793451574-project-admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:56:39.425758 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61740237-d043-4de8-bea8-ef9d07a4b618 tempest-VolumeQuotaClassesTest-793451574 tempest-VolumeQuotaClassesTest-793451574-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70e1d4cfaa24514bb1c18bb3280989c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f5e255b00cc244cd979597d2eb7da423', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:56:39.427191 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61740237-d043-4de8-bea8-ef9d07a4b618 tempest-VolumeQuotaClassesTest-793451574 tempest-VolumeQuotaClassesTest-793451574-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:39.427797 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61740237-d043-4de8-bea8-ef9d07a4b618 tempest-VolumeQuotaClassesTest-793451574 tempest-VolumeQuotaClassesTest-793451574-project-admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:39.428488 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61740237-d043-4de8-bea8-ef9d07a4b618 tempest-VolumeQuotaClassesTest-793451574 tempest-VolumeQuotaClassesTest-793451574-project-admin] PATH_INFO: `/v3/projects/bd734571dfaf46e08f8ca680921db72c` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:39.431703 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61740237-d043-4de8-bea8-ef9d07a4b618 tempest-VolumeQuotaClassesTest-793451574 tempest-VolumeQuotaClassesTest-793451574-project-admin] RBAC: Authorizing `identity:delete_project(project_id=bd734571dfaf46e08f8ca680921db72c)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:56:39.433736 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61740237-d043-4de8-bea8-ef9d07a4b618 tempest-VolumeQuotaClassesTest-793451574 tempest-VolumeQuotaClassesTest-793451574-project-admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:56:39.515120 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-61740237-d043-4de8-bea8-ef9d07a4b618 tempest-VolumeQuotaClassesTest-793451574 tempest-VolumeQuotaClassesTest-793451574-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd734571dfaf46e08f8ca680921db72c', 'request_id': 'req-61740237-d043-4de8-bea8-ef9d07a4b618'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:56:39.528097 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55af6d9-b261-43cf-854e-fad3155b6d58 tempest-VolumeQuotaClassesTest-793451574 tempest-VolumeQuotaClassesTest-793451574-project-admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:56:39.538435 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-61740237-d043-4de8-bea8-ef9d07a4b618 tempest-VolumeQuotaClassesTest-793451574 tempest-VolumeQuotaClassesTest-793451574-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd734571dfaf46e08f8ca680921db72c', 'request_id': 'req-61740237-d043-4de8-bea8-ef9d07a4b618'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:56:39.551073 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-61740237-d043-4de8-bea8-ef9d07a4b618 tempest-VolumeQuotaClassesTest-793451574 tempest-VolumeQuotaClassesTest-793451574-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd734571dfaf46e08f8ca680921db72c', 'request_id': 'req-61740237-d043-4de8-bea8-ef9d07a4b618'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:56:39.552613 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:56:39.572343 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-61740237-d043-4de8-bea8-ef9d07a4b618 tempest-VolumeQuotaClassesTest-793451574 tempest-VolumeQuotaClassesTest-793451574-project-admin] The token cache is being invalidate because project bd734571dfaf46e08f8ca680921db72c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81525) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 09 00:56:39.572720 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-61740237-d043-4de8-bea8-ef9d07a4b618 tempest-VolumeQuotaClassesTest-793451574 tempest-VolumeQuotaClassesTest-793451574-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:56:39.573532 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-61740237-d043-4de8-bea8-ef9d07a4b618 tempest-VolumeQuotaClassesTest-793451574 tempest-VolumeQuotaClassesTest-793451574-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:56:39.578474 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 908/1790] 10.222.0.15 () {58 vars in 1233 bytes} [Sun Oct 9 00:56:39 2022] DELETE /identity/v3/projects/bd734571dfaf46e08f8ca680921db72c => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 09 00:56:39.578474 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61740237-d043-4de8-bea8-ef9d07a4b618 tempest-VolumeQuotaClassesTest-793451574 tempest-VolumeQuotaClassesTest-793451574-project-admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:56:39.579966 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-61740237-d043-4de8-bea8-ef9d07a4b618 tempest-VolumeQuotaClassesTest-793451574 tempest-VolumeQuotaClassesTest-793451574-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:56:39.709331 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61740237-d043-4de8-bea8-ef9d07a4b618 tempest-VolumeQuotaClassesTest-793451574 tempest-VolumeQuotaClassesTest-793451574-project-admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:56:39.712400 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6aa45b2-a1b2-446b-ae95-de571065cb2e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ac83d57fba841e0a666710732249c49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f148d39ced534860abfbe8fc3f98ace4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:56:39.713670 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6aa45b2-a1b2-446b-ae95-de571065cb2e service nova] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:39.716866 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6aa45b2-a1b2-446b-ae95-de571065cb2e service nova] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:39.717195 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6aa45b2-a1b2-446b-ae95-de571065cb2e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:39.719240 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f053470-bb65-484c-9fb3-4e578c54f275 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ac83d57fba841e0a666710732249c49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f148d39ced534860abfbe8fc3f98ace4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:56:39.720158 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f053470-bb65-484c-9fb3-4e578c54f275 service nova] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:39.720366 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-d6aa45b2-a1b2-446b-ae95-de571065cb2e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:56:39.720801 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f053470-bb65-484c-9fb3-4e578c54f275 service nova] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:39.721332 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f053470-bb65-484c-9fb3-4e578c54f275 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:39.723756 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-9f053470-bb65-484c-9fb3-4e578c54f275 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:56:39.742521 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6aa45b2-a1b2-446b-ae95-de571065cb2e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:56:39.745264 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6aa45b2-a1b2-446b-ae95-de571065cb2e service nova] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:56:39.746451 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f053470-bb65-484c-9fb3-4e578c54f275 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:56:39.750767 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f053470-bb65-484c-9fb3-4e578c54f275 service nova] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:56:39.784761 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 883/1791] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Oct 9 00:56:39 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 09 00:56:39.786188 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6aa45b2-a1b2-446b-ae95-de571065cb2e service nova] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:56:39.788907 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-d6aa45b2-a1b2-446b-ae95-de571065cb2e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:56:39.827775 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 909/1792] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Oct 9 00:56:39 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 09 00:56:40.111742 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6aa45b2-a1b2-446b-ae95-de571065cb2e service nova] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:56:40.127682 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c856d49e-c39a-4216-9adc-5f29345c1b28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:56:40.129387 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c856d49e-c39a-4216-9adc-5f29345c1b28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:40.129514 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c856d49e-c39a-4216-9adc-5f29345c1b28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:40.130910 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c856d49e-c39a-4216-9adc-5f29345c1b28 admin admin] PATH_INFO: `/v3/users/ebb4148db2e5404899a85d77476c5930` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:40.135286 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c856d49e-c39a-4216-9adc-5f29345c1b28 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ebb4148db2e5404899a85d77476c5930)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:56:40.139538 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c856d49e-c39a-4216-9adc-5f29345c1b28 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:56:40.298782 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f053470-bb65-484c-9fb3-4e578c54f275 service nova] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:56:40.301769 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-9f053470-bb65-484c-9fb3-4e578c54f275 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:56:40.348326 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f053470-bb65-484c-9fb3-4e578c54f275 service nova] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:56:40.366252 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40cc396-3bad-41f8-a981-5d02fc75ee25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:56:40.366914 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40cc396-3bad-41f8-a981-5d02fc75ee25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:40.367186 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40cc396-3bad-41f8-a981-5d02fc75ee25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:40.367521 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40cc396-3bad-41f8-a981-5d02fc75ee25 admin admin] PATH_INFO: `/v3/users/be6ca136d1284741bbc83854dcad3d9d` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:40.369432 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40cc396-3bad-41f8-a981-5d02fc75ee25 admin admin] RBAC: Authorizing `identity:delete_user(user_id=be6ca136d1284741bbc83854dcad3d9d)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:56:40.372352 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40cc396-3bad-41f8-a981-5d02fc75ee25 admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:56:40.388913 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-c856d49e-c39a-4216-9adc-5f29345c1b28 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ebb4148db2e5404899a85d77476c5930'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:56:40.410422 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-c856d49e-c39a-4216-9adc-5f29345c1b28 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ebb4148db2e5404899a85d77476c5930'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:56:40.412064 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-c856d49e-c39a-4216-9adc-5f29345c1b28 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ebb4148db2e5404899a85d77476c5930'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:56:40.424072 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-c856d49e-c39a-4216-9adc-5f29345c1b28 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ebb4148db2e5404899a85d77476c5930'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:56:40.466392 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-c856d49e-c39a-4216-9adc-5f29345c1b28 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ebb4148db2e5404899a85d77476c5930'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:56:40.509852 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 884/1793] 10.222.0.15 () {58 vars in 1224 bytes} [Sun Oct 9 00:56:39 2022] DELETE /identity/v3/users/ebb4148db2e5404899a85d77476c5930 => generated 0 bytes in 725 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 00:56:40.513357 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:56:40.514464 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888455ae-e943-4613-9354-c75eed9b1647 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:40.514750 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888455ae-e943-4613-9354-c75eed9b1647 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:40.515018 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888455ae-e943-4613-9354-c75eed9b1647 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:40.535420 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-b40cc396-3bad-41f8-a981-5d02fc75ee25 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'be6ca136d1284741bbc83854dcad3d9d'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:56:40.557165 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-b40cc396-3bad-41f8-a981-5d02fc75ee25 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'be6ca136d1284741bbc83854dcad3d9d'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:56:40.558348 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-b40cc396-3bad-41f8-a981-5d02fc75ee25 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'be6ca136d1284741bbc83854dcad3d9d'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:56:40.559084 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-b40cc396-3bad-41f8-a981-5d02fc75ee25 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'be6ca136d1284741bbc83854dcad3d9d'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:56:40.573176 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-b40cc396-3bad-41f8-a981-5d02fc75ee25 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'be6ca136d1284741bbc83854dcad3d9d'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:56:40.591198 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-888455ae-e943-4613-9354-c75eed9b1647 None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:56:40.592391 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-888455ae-e943-4613-9354-c75eed9b1647 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:56:40.618384 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 910/1794] 10.222.0.15 () {58 vars in 1224 bytes} [Sun Oct 9 00:56:40 2022] DELETE /identity/v3/users/be6ca136d1284741bbc83854dcad3d9d => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 00:56:40.623253 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ac3af6-45c2-4180-aefa-efbca8e617d9 None None] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:40.623573 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ac3af6-45c2-4180-aefa-efbca8e617d9 None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:40.623910 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ac3af6-45c2-4180-aefa-efbca8e617d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:40.644351 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:56:40.669134 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.auth.core [None req-77ac3af6-45c2-4180-aefa-efbca8e617d9 None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:56:40.673740 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-77ac3af6-45c2-4180-aefa-efbca8e617d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:56:40.809419 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 885/1795] 10.222.0.15 () {58 vars in 958 bytes} [Sun Oct 9 00:56:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:56:40.851911 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 911/1796] 10.222.0.15 () {58 vars in 958 bytes} [Sun Oct 9 00:56:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 09 00:56:40.921662 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888455ae-e943-4613-9354-c75eed9b1647 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:56:40.923606 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-888455ae-e943-4613-9354-c75eed9b1647 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:56:40.948860 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ac3af6-45c2-4180-aefa-efbca8e617d9 None None] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:56:40.952288 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-77ac3af6-45c2-4180-aefa-efbca8e617d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:56:41.092494 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ac3af6-45c2-4180-aefa-efbca8e617d9 None None] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:56:41.100739 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888455ae-e943-4613-9354-c75eed9b1647 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:56:41.107112 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882184dc-21ab-4357-b8ce-bb10d6ed9b35 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4ef90d456d2483e8ddafbe2d4d4fb5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f148d39ced534860abfbe8fc3f98ace4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:56:41.107796 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882184dc-21ab-4357-b8ce-bb10d6ed9b35 service neutron] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:41.108069 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882184dc-21ab-4357-b8ce-bb10d6ed9b35 service neutron] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:41.108622 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882184dc-21ab-4357-b8ce-bb10d6ed9b35 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:41.112801 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee63eb7-5b2c-4b49-96d9-5d6ca7ce98f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4ef90d456d2483e8ddafbe2d4d4fb5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f148d39ced534860abfbe8fc3f98ace4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:56:41.114941 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee63eb7-5b2c-4b49-96d9-5d6ca7ce98f3 service neutron] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:41.115325 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee63eb7-5b2c-4b49-96d9-5d6ca7ce98f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:41.115617 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee63eb7-5b2c-4b49-96d9-5d6ca7ce98f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:41.132705 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882184dc-21ab-4357-b8ce-bb10d6ed9b35 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:56:41.134197 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882184dc-21ab-4357-b8ce-bb10d6ed9b35 service neutron] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:56:41.154042 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee63eb7-5b2c-4b49-96d9-5d6ca7ce98f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:56:41.155769 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee63eb7-5b2c-4b49-96d9-5d6ca7ce98f3 service neutron] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:56:41.156313 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 912/1797] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Oct 9 00:56:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 09 00:56:41.180210 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 886/1798] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Oct 9 00:56:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 09 00:56:41.821116 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882184dc-21ab-4357-b8ce-bb10d6ed9b35 service neutron] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:56:41.824803 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-882184dc-21ab-4357-b8ce-bb10d6ed9b35 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:56:41.866864 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882184dc-21ab-4357-b8ce-bb10d6ed9b35 service neutron] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:56:41.887906 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50acc8d-b6b0-4814-97a4-e02332f4221d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:56:41.888048 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50acc8d-b6b0-4814-97a4-e02332f4221d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:41.888421 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50acc8d-b6b0-4814-97a4-e02332f4221d admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:41.888785 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50acc8d-b6b0-4814-97a4-e02332f4221d admin admin] PATH_INFO: `/v3/projects/f63546bfb609468b8cc2732d1c84ba09` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:41.890434 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50acc8d-b6b0-4814-97a4-e02332f4221d admin admin] RBAC: Authorizing `identity:delete_project(project_id=f63546bfb609468b8cc2732d1c84ba09)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:56:41.892694 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50acc8d-b6b0-4814-97a4-e02332f4221d admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:56:42.004429 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-f50acc8d-b6b0-4814-97a4-e02332f4221d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f63546bfb609468b8cc2732d1c84ba09', 'request_id': 'req-f50acc8d-b6b0-4814-97a4-e02332f4221d'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:56:42.015896 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:DELETE=10,keystone:SELECT=88,keystone:INSERT=2 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:56:42.024547 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-f50acc8d-b6b0-4814-97a4-e02332f4221d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f63546bfb609468b8cc2732d1c84ba09', 'request_id': 'req-f50acc8d-b6b0-4814-97a4-e02332f4221d'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:56:42.034748 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-f50acc8d-b6b0-4814-97a4-e02332f4221d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f63546bfb609468b8cc2732d1c84ba09', 'request_id': 'req-f50acc8d-b6b0-4814-97a4-e02332f4221d'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:56:42.056787 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-f50acc8d-b6b0-4814-97a4-e02332f4221d admin admin] The token cache is being invalidate because project f63546bfb609468b8cc2732d1c84ba09 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81525) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 09 00:56:42.057232 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-f50acc8d-b6b0-4814-97a4-e02332f4221d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:56:42.058811 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-f50acc8d-b6b0-4814-97a4-e02332f4221d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:56:42.065513 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 913/1799] 10.222.0.15 () {58 vars in 1233 bytes} [Sun Oct 9 00:56:41 2022] DELETE /identity/v3/projects/f63546bfb609468b8cc2732d1c84ba09 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 00:56:42.066396 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee63eb7-5b2c-4b49-96d9-5d6ca7ce98f3 service neutron] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:56:42.082879 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee63eb7-5b2c-4b49-96d9-5d6ca7ce98f3 service neutron] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:56:42.243724 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569dcde0-7658-4035-8eb2-1962c44df5ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:56:42.244611 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569dcde0-7658-4035-8eb2-1962c44df5ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:42.244895 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569dcde0-7658-4035-8eb2-1962c44df5ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:42.245170 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569dcde0-7658-4035-8eb2-1962c44df5ea admin admin] PATH_INFO: `/v3/users/e70e1d4cfaa24514bb1c18bb3280989c` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:42.247127 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569dcde0-7658-4035-8eb2-1962c44df5ea admin admin] RBAC: Authorizing `identity:delete_user(user_id=e70e1d4cfaa24514bb1c18bb3280989c)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:56:42.250184 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569dcde0-7658-4035-8eb2-1962c44df5ea admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:56:42.360880 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-569dcde0-7658-4035-8eb2-1962c44df5ea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e70e1d4cfaa24514bb1c18bb3280989c'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:56:42.385883 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-569dcde0-7658-4035-8eb2-1962c44df5ea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e70e1d4cfaa24514bb1c18bb3280989c'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:56:42.388459 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-569dcde0-7658-4035-8eb2-1962c44df5ea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e70e1d4cfaa24514bb1c18bb3280989c'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:56:42.389547 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-569dcde0-7658-4035-8eb2-1962c44df5ea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e70e1d4cfaa24514bb1c18bb3280989c'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:56:42.439084 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-569dcde0-7658-4035-8eb2-1962c44df5ea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e70e1d4cfaa24514bb1c18bb3280989c'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:56:42.472842 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:56:42.519332 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 887/1800] 10.222.0.15 () {58 vars in 1224 bytes} [Sun Oct 9 00:56:42 2022] DELETE /identity/v3/users/e70e1d4cfaa24514bb1c18bb3280989c => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 00:56:43.216985 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50acc8d-b6b0-4814-97a4-e02332f4221d admin admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:56:43.218712 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-f50acc8d-b6b0-4814-97a4-e02332f4221d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:56:43.266665 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50acc8d-b6b0-4814-97a4-e02332f4221d admin admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:56:43.426351 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb766e6e-a3f7-4934-b42a-8a3bb4de72e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:56:43.427123 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb766e6e-a3f7-4934-b42a-8a3bb4de72e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:43.427532 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb766e6e-a3f7-4934-b42a-8a3bb4de72e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:43.428633 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb766e6e-a3f7-4934-b42a-8a3bb4de72e3 admin admin] PATH_INFO: `/v3/projects/aad0ec5f85c6402b8b862e91f135d3da` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:43.430437 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb766e6e-a3f7-4934-b42a-8a3bb4de72e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aad0ec5f85c6402b8b862e91f135d3da)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:56:43.432993 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb766e6e-a3f7-4934-b42a-8a3bb4de72e3 admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:56:43.499230 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-cb766e6e-a3f7-4934-b42a-8a3bb4de72e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aad0ec5f85c6402b8b862e91f135d3da', 'request_id': 'req-cb766e6e-a3f7-4934-b42a-8a3bb4de72e3'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:56:43.525972 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-cb766e6e-a3f7-4934-b42a-8a3bb4de72e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aad0ec5f85c6402b8b862e91f135d3da', 'request_id': 'req-cb766e6e-a3f7-4934-b42a-8a3bb4de72e3'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:56:43.533330 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-cb766e6e-a3f7-4934-b42a-8a3bb4de72e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aad0ec5f85c6402b8b862e91f135d3da', 'request_id': 'req-cb766e6e-a3f7-4934-b42a-8a3bb4de72e3'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:56:43.555062 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-cb766e6e-a3f7-4934-b42a-8a3bb4de72e3 admin admin] The token cache is being invalidate because project aad0ec5f85c6402b8b862e91f135d3da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81525) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 09 00:56:43.555442 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-cb766e6e-a3f7-4934-b42a-8a3bb4de72e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:56:43.556355 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-cb766e6e-a3f7-4934-b42a-8a3bb4de72e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:56:43.559131 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 914/1801] 10.222.0.15 () {58 vars in 1233 bytes} [Sun Oct 9 00:56:43 2022] DELETE /identity/v3/projects/aad0ec5f85c6402b8b862e91f135d3da => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 00:56:43.562800 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569dcde0-7658-4035-8eb2-1962c44df5ea admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:56:43.564306 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-569dcde0-7658-4035-8eb2-1962c44df5ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:56:43.578456 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569dcde0-7658-4035-8eb2-1962c44df5ea admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:56:43.650373 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6c22cd-4890-47a9-966c-7e29044cd442 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:56:43.651038 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6c22cd-4890-47a9-966c-7e29044cd442 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:43.651351 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6c22cd-4890-47a9-966c-7e29044cd442 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:43.651625 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6c22cd-4890-47a9-966c-7e29044cd442 admin admin] PATH_INFO: `/v3/users/69782c79e01d4d8dab97a95028fe4430` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:43.652828 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6c22cd-4890-47a9-966c-7e29044cd442 admin admin] RBAC: Authorizing `identity:delete_user(user_id=69782c79e01d4d8dab97a95028fe4430)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:56:43.654767 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6c22cd-4890-47a9-966c-7e29044cd442 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:56:43.745770 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-9b6c22cd-4890-47a9-966c-7e29044cd442 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '69782c79e01d4d8dab97a95028fe4430'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:56:43.788135 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-9b6c22cd-4890-47a9-966c-7e29044cd442 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '69782c79e01d4d8dab97a95028fe4430'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:56:43.788887 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-9b6c22cd-4890-47a9-966c-7e29044cd442 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '69782c79e01d4d8dab97a95028fe4430'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:56:43.789497 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-9b6c22cd-4890-47a9-966c-7e29044cd442 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '69782c79e01d4d8dab97a95028fe4430'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:56:43.800739 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-9b6c22cd-4890-47a9-966c-7e29044cd442 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '69782c79e01d4d8dab97a95028fe4430'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:56:43.825347 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 888/1802] 10.222.0.15 () {58 vars in 1224 bytes} [Sun Oct 9 00:56:43 2022] DELETE /identity/v3/users/69782c79e01d4d8dab97a95028fe4430 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 00:56:43.834193 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb766e6e-a3f7-4934-b42a-8a3bb4de72e3 admin admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:56:43.835725 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-cb766e6e-a3f7-4934-b42a-8a3bb4de72e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:56:43.848410 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb766e6e-a3f7-4934-b42a-8a3bb4de72e3 admin admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:56:43.941257 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4a57bf-28bc-4fea-a4d3-76d10a7a3310 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:56:43.945269 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4a57bf-28bc-4fea-a4d3-76d10a7a3310 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:43.945721 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4a57bf-28bc-4fea-a4d3-76d10a7a3310 admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:43.945721 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4a57bf-28bc-4fea-a4d3-76d10a7a3310 admin admin] PATH_INFO: `/v3/projects/f5e255b00cc244cd979597d2eb7da423` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:43.951469 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4a57bf-28bc-4fea-a4d3-76d10a7a3310 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f5e255b00cc244cd979597d2eb7da423)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:56:43.951469 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4a57bf-28bc-4fea-a4d3-76d10a7a3310 admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:56:43.980644 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:56:44.047510 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-cc4a57bf-28bc-4fea-a4d3-76d10a7a3310 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f5e255b00cc244cd979597d2eb7da423', 'request_id': 'req-cc4a57bf-28bc-4fea-a4d3-76d10a7a3310'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:56:44.057657 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-cc4a57bf-28bc-4fea-a4d3-76d10a7a3310 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f5e255b00cc244cd979597d2eb7da423', 'request_id': 'req-cc4a57bf-28bc-4fea-a4d3-76d10a7a3310'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:56:44.065211 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-cc4a57bf-28bc-4fea-a4d3-76d10a7a3310 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f5e255b00cc244cd979597d2eb7da423', 'request_id': 'req-cc4a57bf-28bc-4fea-a4d3-76d10a7a3310'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:56:44.104607 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-cc4a57bf-28bc-4fea-a4d3-76d10a7a3310 admin admin] The token cache is being invalidate because project f5e255b00cc244cd979597d2eb7da423 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81525) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 09 00:56:44.106873 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-cc4a57bf-28bc-4fea-a4d3-76d10a7a3310 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:56:44.109581 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-cc4a57bf-28bc-4fea-a4d3-76d10a7a3310 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:56:44.115768 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 915/1803] 10.222.0.15 () {58 vars in 1233 bytes} [Sun Oct 9 00:56:43 2022] DELETE /identity/v3/projects/f5e255b00cc244cd979597d2eb7da423 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 00:56:44.121444 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc69c243-3b48-42f9-ba7f-4741c2b9c04a None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:44.121738 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc69c243-3b48-42f9-ba7f-4741c2b9c04a None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:44.122016 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc69c243-3b48-42f9-ba7f-4741c2b9c04a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:44.182843 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-bc69c243-3b48-42f9-ba7f-4741c2b9c04a None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:56:44.186612 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-bc69c243-3b48-42f9-ba7f-4741c2b9c04a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:56:44.313831 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9cbf99-80c5-4d52-b395-193eb7d9679f None None] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:44.314736 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9cbf99-80c5-4d52-b395-193eb7d9679f None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:44.315252 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9cbf99-80c5-4d52-b395-193eb7d9679f None None] PATH_INFO: `/` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:44.317230 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 916/1804] 10.222.0.15 () {54 vars in 921 bytes} [Sun Oct 9 00:56:44 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 09 00:56:44.330871 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a696ceaf-ecd7-4eb1-90e0-53d45ea9209d None None] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:44.331454 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a696ceaf-ecd7-4eb1-90e0-53d45ea9209d None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:44.331989 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a696ceaf-ecd7-4eb1-90e0-53d45ea9209d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:44.365198 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 889/1805] 10.222.0.15 () {58 vars in 958 bytes} [Sun Oct 9 00:56:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:56:44.367013 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35b0398-c1e6-43fa-a2ca-dd233dfc49af None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:44.367390 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35b0398-c1e6-43fa-a2ca-dd233dfc49af None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:44.367658 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35b0398-c1e6-43fa-a2ca-dd233dfc49af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:44.377262 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:56:44.380087 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.auth.core [None req-a696ceaf-ecd7-4eb1-90e0-53d45ea9209d None None] MFA Rules not processed for user `4ac83d57fba841e0a666710732249c49`. Rule list: `[]` (Enabled: `True`). {{(pid=81525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:56:44.382211 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-a696ceaf-ecd7-4eb1-90e0-53d45ea9209d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:56:44.401402 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-a35b0398-c1e6-43fa-a2ca-dd233dfc49af None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:56:44.402931 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-a35b0398-c1e6-43fa-a2ca-dd233dfc49af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:56:44.417301 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 890/1806] 10.222.0.15 () {58 vars in 958 bytes} [Sun Oct 9 00:56:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:56:44.418227 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35b0398-c1e6-43fa-a2ca-dd233dfc49af None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:56:44.429712 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35b0398-c1e6-43fa-a2ca-dd233dfc49af None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:56:44.435538 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b1507f-d387-4ef7-a62b-ab89c7f0e46f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:56:44.456434 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b1507f-d387-4ef7-a62b-ab89c7f0e46f admin admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:44.456766 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b1507f-d387-4ef7-a62b-ab89c7f0e46f admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:44.457098 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b1507f-d387-4ef7-a62b-ab89c7f0e46f admin admin] PATH_INFO: `/v3/domains` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:44.458276 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b1507f-d387-4ef7-a62b-ab89c7f0e46f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:56:44.458643 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b1507f-d387-4ef7-a62b-ab89c7f0e46f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:56:44.460735 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b1507f-d387-4ef7-a62b-ab89c7f0e46f admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:56:44.479149 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 891/1807] 10.222.0.15 () {58 vars in 1153 bytes} [Sun Oct 9 00:56:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:56:44.487234 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b1507f-d387-4ef7-a62b-ab89c7f0e46f admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:56:44.524935 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b1507f-d387-4ef7-a62b-ab89c7f0e46f admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:56:44.537679 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae468dc-aa1c-4515-96bf-cad5956d0622 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:56:44.538315 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae468dc-aa1c-4515-96bf-cad5956d0622 admin admin] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:44.540112 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae468dc-aa1c-4515-96bf-cad5956d0622 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:44.540789 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae468dc-aa1c-4515-96bf-cad5956d0622 admin admin] PATH_INFO: `/v3/projects` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:44.542653 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae468dc-aa1c-4515-96bf-cad5956d0622 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:56:44.545058 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae468dc-aa1c-4515-96bf-cad5956d0622 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:56:44.553037 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 917/1808] 10.222.0.15 () {58 vars in 1018 bytes} [Sun Oct 9 00:56:44 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:56:44.584556 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 892/1809] 10.222.0.15 () {60 vars in 1153 bytes} [Sun Oct 9 00:56:44 2022] POST /identity/v3/projects => generated 397 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 09 00:56:44.588533 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a696ceaf-ecd7-4eb1-90e0-53d45ea9209d None None] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:56:44.600327 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a696ceaf-ecd7-4eb1-90e0-53d45ea9209d None None] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:56:44.704513 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae468dc-aa1c-4515-96bf-cad5956d0622 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:56:44.705206 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be02e5b7-33e7-4a4b-ad7f-90a66f6b316a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:56:44.706035 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be02e5b7-33e7-4a4b-ad7f-90a66f6b316a admin admin] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:44.706392 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be02e5b7-33e7-4a4b-ad7f-90a66f6b316a admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:44.706755 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be02e5b7-33e7-4a4b-ad7f-90a66f6b316a admin admin] PATH_INFO: `/v3/users` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:44.707646 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be02e5b7-33e7-4a4b-ad7f-90a66f6b316a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:56:44.709888 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be02e5b7-33e7-4a4b-ad7f-90a66f6b316a admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:56:44.715751 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-eae468dc-aa1c-4515-96bf-cad5956d0622 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:56:44.768596 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 918/1810] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Oct 9 00:56:44 2022] POST /identity/v3/users => generated 299 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 09 00:56:44.773428 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be02e5b7-33e7-4a4b-ad7f-90a66f6b316a admin admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:56:44.790114 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be02e5b7-33e7-4a4b-ad7f-90a66f6b316a admin admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:56:44.796271 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08320b78-12c0-41d1-a6b1-4ed666d87212 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:56:44.797634 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08320b78-12c0-41d1-a6b1-4ed666d87212 admin admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:44.799011 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08320b78-12c0-41d1-a6b1-4ed666d87212 admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:44.799608 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08320b78-12c0-41d1-a6b1-4ed666d87212 admin admin] PATH_INFO: `/v3/roles` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:44.801221 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08320b78-12c0-41d1-a6b1-4ed666d87212 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:56:44.805338 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08320b78-12c0-41d1-a6b1-4ed666d87212 admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:56:44.828211 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 919/1811] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Oct 9 00:56:44 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 09 00:56:44.832283 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08320b78-12c0-41d1-a6b1-4ed666d87212 admin admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:56:44.850482 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08320b78-12c0-41d1-a6b1-4ed666d87212 admin admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:56:44.860486 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fff5c7-b8cb-4b7d-95fb-7626f39e314c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:56:44.861387 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fff5c7-b8cb-4b7d-95fb-7626f39e314c admin admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:44.861740 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fff5c7-b8cb-4b7d-95fb-7626f39e314c admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:44.862071 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fff5c7-b8cb-4b7d-95fb-7626f39e314c admin admin] PATH_INFO: `/v3/roles` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:44.866258 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fff5c7-b8cb-4b7d-95fb-7626f39e314c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:56:44.868142 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fff5c7-b8cb-4b7d-95fb-7626f39e314c admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:56:44.882907 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 920/1812] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Oct 9 00:56:44 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 09 00:56:44.887377 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fff5c7-b8cb-4b7d-95fb-7626f39e314c admin admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:56:44.907463 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae468dc-aa1c-4515-96bf-cad5956d0622 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:56:44.915464 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3e4984-ce13-4787-905e-77666b6fac64 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ac83d57fba841e0a666710732249c49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f148d39ced534860abfbe8fc3f98ace4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:56:44.917311 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3e4984-ce13-4787-905e-77666b6fac64 service nova] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:44.917788 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3e4984-ce13-4787-905e-77666b6fac64 service nova] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:44.918497 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3e4984-ce13-4787-905e-77666b6fac64 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:44.919132 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:56:44.922961 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fff5c7-b8cb-4b7d-95fb-7626f39e314c admin admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:56:44.930762 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644587da-e6b9-4280-b3e7-157410a4f5d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:56:44.932138 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644587da-e6b9-4280-b3e7-157410a4f5d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:44.932501 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3e4984-ce13-4787-905e-77666b6fac64 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:56:44.932898 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644587da-e6b9-4280-b3e7-157410a4f5d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:44.933367 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644587da-e6b9-4280-b3e7-157410a4f5d9 admin admin] PATH_INFO: `/v3/projects/d9bf67a710d24bed9b5dc4c89bf00a16/users/a8810bd2de5a40bcb10dc51a9a429f12/roles/afb0a01183d9497795eaa4fa1a4046ae` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:44.935391 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3e4984-ce13-4787-905e-77666b6fac64 service nova] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:56:44.954780 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 893/1813] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Oct 9 00:56:44 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 09 00:56:44.956553 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644587da-e6b9-4280-b3e7-157410a4f5d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9bf67a710d24bed9b5dc4c89bf00a16, user_id=a8810bd2de5a40bcb10dc51a9a429f12, role_id=afb0a01183d9497795eaa4fa1a4046ae)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:56:44.969316 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644587da-e6b9-4280-b3e7-157410a4f5d9 admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:56:45.008815 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 921/1814] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Oct 9 00:56:44 2022] PUT /identity/v3/projects/d9bf67a710d24bed9b5dc4c89bf00a16/users/a8810bd2de5a40bcb10dc51a9a429f12/roles/afb0a01183d9497795eaa4fa1a4046ae => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 00:56:45.020574 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74beca71-9809-4d86-a290-33956ee01937 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:45.020928 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74beca71-9809-4d86-a290-33956ee01937 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:45.021331 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74beca71-9809-4d86-a290-33956ee01937 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:45.077154 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-74beca71-9809-4d86-a290-33956ee01937 None None] MFA Rules not processed for user `a8810bd2de5a40bcb10dc51a9a429f12`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:56:45.077778 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-74beca71-9809-4d86-a290-33956ee01937 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:56:45.252728 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 894/1815] 10.222.0.15 () {58 vars in 958 bytes} [Sun Oct 9 00:56:45 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:56:45.257845 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644587da-e6b9-4280-b3e7-157410a4f5d9 admin admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:56:45.367174 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644587da-e6b9-4280-b3e7-157410a4f5d9 admin admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:56:45.392289 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b41142-77fb-4c4e-b5d5-239cba40c7b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:56:45.393038 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b41142-77fb-4c4e-b5d5-239cba40c7b7 admin admin] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:45.393375 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b41142-77fb-4c4e-b5d5-239cba40c7b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:45.394365 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b41142-77fb-4c4e-b5d5-239cba40c7b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:45.395947 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b41142-77fb-4c4e-b5d5-239cba40c7b7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:56:45.400139 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b41142-77fb-4c4e-b5d5-239cba40c7b7 admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:56:45.462201 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 922/1816] 10.222.0.15 () {60 vars in 1153 bytes} [Sun Oct 9 00:56:45 2022] POST /identity/v3/projects => generated 401 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 09 00:56:45.465276 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74beca71-9809-4d86-a290-33956ee01937 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:56:45.483188 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74beca71-9809-4d86-a290-33956ee01937 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:56:45.537928 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:56:45.584868 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d18396-55ba-4a49-bfc5-4819d0956fcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:56:45.588074 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d18396-55ba-4a49-bfc5-4819d0956fcf admin admin] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:45.588364 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d18396-55ba-4a49-bfc5-4819d0956fcf admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:45.588647 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d18396-55ba-4a49-bfc5-4819d0956fcf admin admin] PATH_INFO: `/v3/users` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:45.589316 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d18396-55ba-4a49-bfc5-4819d0956fcf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:56:45.592773 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d18396-55ba-4a49-bfc5-4819d0956fcf admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:56:45.629960 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 895/1817] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Oct 9 00:56:45 2022] POST /identity/v3/users => generated 307 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 09 00:56:45.634155 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b41142-77fb-4c4e-b5d5-239cba40c7b7 admin admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:56:45.648254 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b41142-77fb-4c4e-b5d5-239cba40c7b7 admin admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:56:45.653454 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dade5ba7-e52b-4e14-9e69-afbb5f10ff35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:56:45.654182 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dade5ba7-e52b-4e14-9e69-afbb5f10ff35 admin admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:45.654514 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dade5ba7-e52b-4e14-9e69-afbb5f10ff35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:45.654785 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dade5ba7-e52b-4e14-9e69-afbb5f10ff35 admin admin] PATH_INFO: `/v3/roles` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:45.658030 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dade5ba7-e52b-4e14-9e69-afbb5f10ff35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:56:45.661570 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dade5ba7-e52b-4e14-9e69-afbb5f10ff35 admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:56:45.678528 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 923/1818] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Oct 9 00:56:45 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 09 00:56:45.684201 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d18396-55ba-4a49-bfc5-4819d0956fcf admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:56:45.712927 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d18396-55ba-4a49-bfc5-4819d0956fcf admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:56:45.719006 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff32e0c4-5d03-46a7-bde0-4b9b084629ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:56:45.719727 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff32e0c4-5d03-46a7-bde0-4b9b084629ee admin admin] REQUEST_METHOD: `PUT` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:45.720005 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff32e0c4-5d03-46a7-bde0-4b9b084629ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:45.720281 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff32e0c4-5d03-46a7-bde0-4b9b084629ee admin admin] PATH_INFO: `/v3/projects/f0e58e2eab15408aac55ba589b3b5f3f/users/4b4868af82294b3b97e012aca36acfb1/roles/f69dddf26daf4dd79d4c962beb877af5` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:45.737544 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff32e0c4-5d03-46a7-bde0-4b9b084629ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0e58e2eab15408aac55ba589b3b5f3f, user_id=4b4868af82294b3b97e012aca36acfb1, role_id=f69dddf26daf4dd79d4c962beb877af5)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:56:45.740345 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff32e0c4-5d03-46a7-bde0-4b9b084629ee admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:56:45.765148 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 896/1819] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Oct 9 00:56:45 2022] PUT /identity/v3/projects/f0e58e2eab15408aac55ba589b3b5f3f/users/4b4868af82294b3b97e012aca36acfb1/roles/f69dddf26daf4dd79d4c962beb877af5 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 00:56:45.769153 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dade5ba7-e52b-4e14-9e69-afbb5f10ff35 admin admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:56:45.780734 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dade5ba7-e52b-4e14-9e69-afbb5f10ff35 admin admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:56:45.873431 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc8f40d-b7a0-4c7d-9a3b-898dfe7b0939 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:56:45.874265 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc8f40d-b7a0-4c7d-9a3b-898dfe7b0939 admin admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:45.874636 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc8f40d-b7a0-4c7d-9a3b-898dfe7b0939 admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:45.875004 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc8f40d-b7a0-4c7d-9a3b-898dfe7b0939 admin admin] PATH_INFO: `/v3/roles` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:45.876041 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc8f40d-b7a0-4c7d-9a3b-898dfe7b0939 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:56:45.878109 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc8f40d-b7a0-4c7d-9a3b-898dfe7b0939 admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:56:45.897131 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff32e0c4-5d03-46a7-bde0-4b9b084629ee admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:56:45.902375 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 924/1820] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Oct 9 00:56:45 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 09 00:56:45.910766 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff32e0c4-5d03-46a7-bde0-4b9b084629ee admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:56:45.920766 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7d5af7-3fff-4e24-8d4b-448f623bac0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:56:45.921567 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7d5af7-3fff-4e24-8d4b-448f623bac0d admin admin] REQUEST_METHOD: `PUT` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:45.921840 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7d5af7-3fff-4e24-8d4b-448f623bac0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:45.922181 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7d5af7-3fff-4e24-8d4b-448f623bac0d admin admin] PATH_INFO: `/v3/projects/f0e58e2eab15408aac55ba589b3b5f3f/users/4b4868af82294b3b97e012aca36acfb1/roles/f69dddf26daf4dd79d4c962beb877af5` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:45.924370 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7d5af7-3fff-4e24-8d4b-448f623bac0d admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0e58e2eab15408aac55ba589b3b5f3f, user_id=4b4868af82294b3b97e012aca36acfb1, role_id=f69dddf26daf4dd79d4c962beb877af5)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:56:45.927564 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7d5af7-3fff-4e24-8d4b-448f623bac0d admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:56:45.949560 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 897/1821] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Oct 9 00:56:45 2022] PUT /identity/v3/projects/f0e58e2eab15408aac55ba589b3b5f3f/users/4b4868af82294b3b97e012aca36acfb1/roles/f69dddf26daf4dd79d4c962beb877af5 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 09 00:56:45.952039 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b24fa6-8f8a-48c8-a7fc-a299635a261f None None] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:45.952210 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b24fa6-8f8a-48c8-a7fc-a299635a261f None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:45.952479 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b24fa6-8f8a-48c8-a7fc-a299635a261f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:45.992168 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7d5af7-3fff-4e24-8d4b-448f623bac0d admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:56:45.993928 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-8c7d5af7-3fff-4e24-8d4b-448f623bac0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:56:46.007194 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.auth.core [None req-53b24fa6-8f8a-48c8-a7fc-a299635a261f None None] MFA Rules not processed for user `4b4868af82294b3b97e012aca36acfb1`. Rule list: `[]` (Enabled: `True`). {{(pid=81525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:56:46.009497 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-53b24fa6-8f8a-48c8-a7fc-a299635a261f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:56:46.102678 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:56:46.130255 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7d5af7-3fff-4e24-8d4b-448f623bac0d admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:56:46.144449 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c2a660-4470-4751-8e17-bc08bc2b17bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:56:46.145029 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c2a660-4470-4751-8e17-bc08bc2b17bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:46.145300 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c2a660-4470-4751-8e17-bc08bc2b17bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:46.147926 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c2a660-4470-4751-8e17-bc08bc2b17bc admin admin] PATH_INFO: `/v3/projects/c4dec193ffb545d082dbb33d932967b0` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:46.149086 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c2a660-4470-4751-8e17-bc08bc2b17bc admin admin] RBAC: Authorizing `identity:delete_project(project_id=c4dec193ffb545d082dbb33d932967b0)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:56:46.151892 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c2a660-4470-4751-8e17-bc08bc2b17bc admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:56:46.173111 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 925/1822] 10.222.0.15 () {58 vars in 958 bytes} [Sun Oct 9 00:56:45 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:56:46.199686 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b24fa6-8f8a-48c8-a7fc-a299635a261f None None] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:56:46.201335 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-53b24fa6-8f8a-48c8-a7fc-a299635a261f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:56:46.287136 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-66c2a660-4470-4751-8e17-bc08bc2b17bc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c4dec193ffb545d082dbb33d932967b0', 'request_id': 'req-66c2a660-4470-4751-8e17-bc08bc2b17bc'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:56:46.303759 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b24fa6-8f8a-48c8-a7fc-a299635a261f None None] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:56:46.304319 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-66c2a660-4470-4751-8e17-bc08bc2b17bc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c4dec193ffb545d082dbb33d932967b0', 'request_id': 'req-66c2a660-4470-4751-8e17-bc08bc2b17bc'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:56:46.315235 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-66c2a660-4470-4751-8e17-bc08bc2b17bc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c4dec193ffb545d082dbb33d932967b0', 'request_id': 'req-66c2a660-4470-4751-8e17-bc08bc2b17bc'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:56:46.339444 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-66c2a660-4470-4751-8e17-bc08bc2b17bc admin admin] The token cache is being invalidate because project c4dec193ffb545d082dbb33d932967b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81524) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 09 00:56:46.339751 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-66c2a660-4470-4751-8e17-bc08bc2b17bc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:56:46.340656 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-66c2a660-4470-4751-8e17-bc08bc2b17bc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:56:46.346865 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 898/1823] 10.222.0.15 () {58 vars in 1233 bytes} [Sun Oct 9 00:56:45 2022] DELETE /identity/v3/projects/c4dec193ffb545d082dbb33d932967b0 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 00:56:46.348501 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ca84a7-31e1-4e0c-ae20-def27179c0cc None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:46.348782 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ca84a7-31e1-4e0c-ae20-def27179c0cc None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:46.349054 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ca84a7-31e1-4e0c-ae20-def27179c0cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:46.375244 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-89ca84a7-31e1-4e0c-ae20-def27179c0cc None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:56:46.376524 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-89ca84a7-31e1-4e0c-ae20-def27179c0cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:56:46.388014 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26fbbb9-f0f0-437e-904d-78c9673d26e4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff7cb78bcd91467abe5c2e2b48aedd1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f148d39ced534860abfbe8fc3f98ace4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:56:46.388642 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26fbbb9-f0f0-437e-904d-78c9673d26e4 service cinder] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:46.389749 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26fbbb9-f0f0-437e-904d-78c9673d26e4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:46.390067 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26fbbb9-f0f0-437e-904d-78c9673d26e4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:46.392411 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-a26fbbb9-f0f0-437e-904d-78c9673d26e4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:56:46.392925 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=87,keystone:INSERT=6,keystone:DELETE=7 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:56:46.523299 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26fbbb9-f0f0-437e-904d-78c9673d26e4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:56:46.527356 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26fbbb9-f0f0-437e-904d-78c9673d26e4 service cinder] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:56:46.553074 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 899/1824] 10.222.0.15 () {58 vars in 958 bytes} [Sun Oct 9 00:56:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:56:46.557119 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 926/1825] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Oct 9 00:56:46 2022] GET /identity/v3/auth/tokens => generated 3345 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 09 00:56:46.561260 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b7c19f-d9a6-46aa-bd75-acc1f2dd0bc5 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:46.561747 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b7c19f-d9a6-46aa-bd75-acc1f2dd0bc5 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:46.562196 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b7c19f-d9a6-46aa-bd75-acc1f2dd0bc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:46.626334 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-b8b7c19f-d9a6-46aa-bd75-acc1f2dd0bc5 None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:56:46.627640 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-b8b7c19f-d9a6-46aa-bd75-acc1f2dd0bc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:56:46.651846 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 900/1826] 10.222.0.15 () {58 vars in 958 bytes} [Sun Oct 9 00:56:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:56:46.653358 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26fbbb9-f0f0-437e-904d-78c9673d26e4 service cinder] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:56:46.673373 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26fbbb9-f0f0-437e-904d-78c9673d26e4 service cinder] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:56:46.680458 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f97df3-1cb9-4ecc-853a-d0b342342930 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:56:46.681228 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f97df3-1cb9-4ecc-853a-d0b342342930 admin admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:46.683459 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b7c19f-d9a6-46aa-bd75-acc1f2dd0bc5 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:56:46.683607 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f97df3-1cb9-4ecc-853a-d0b342342930 admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:46.684066 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f97df3-1cb9-4ecc-853a-d0b342342930 admin admin] PATH_INFO: `/v3/domains` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:46.684886 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f97df3-1cb9-4ecc-853a-d0b342342930 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:56:46.685288 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f97df3-1cb9-4ecc-853a-d0b342342930 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:56:46.685612 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-b8b7c19f-d9a6-46aa-bd75-acc1f2dd0bc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:56:46.687391 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f97df3-1cb9-4ecc-853a-d0b342342930 admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:56:46.706128 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b7c19f-d9a6-46aa-bd75-acc1f2dd0bc5 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:56:46.713158 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0af862-4339-4aba-b7ff-ef98a2c28319 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff7cb78bcd91467abe5c2e2b48aedd1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f148d39ced534860abfbe8fc3f98ace4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:56:46.715126 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0af862-4339-4aba-b7ff-ef98a2c28319 service cinder] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:46.715787 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0af862-4339-4aba-b7ff-ef98a2c28319 service cinder] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:46.716212 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0af862-4339-4aba-b7ff-ef98a2c28319 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:46.718766 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-cb0af862-4339-4aba-b7ff-ef98a2c28319 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:56:46.759939 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 927/1827] 10.222.0.15 () {58 vars in 1153 bytes} [Sun Oct 9 00:56:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:56:46.765028 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f97df3-1cb9-4ecc-853a-d0b342342930 admin admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:56:46.787540 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f97df3-1cb9-4ecc-853a-d0b342342930 admin admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:56:46.802204 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a178a073-5e27-4d88-970f-2028acbbf51e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:56:46.802924 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a178a073-5e27-4d88-970f-2028acbbf51e admin admin] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:46.803200 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a178a073-5e27-4d88-970f-2028acbbf51e admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:46.804288 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a178a073-5e27-4d88-970f-2028acbbf51e admin admin] PATH_INFO: `/v3/projects` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:46.804995 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a178a073-5e27-4d88-970f-2028acbbf51e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:56:46.809102 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a178a073-5e27-4d88-970f-2028acbbf51e admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:56:46.837832 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0af862-4339-4aba-b7ff-ef98a2c28319 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:56:46.839355 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0af862-4339-4aba-b7ff-ef98a2c28319 service cinder] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:56:46.863042 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 901/1828] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Oct 9 00:56:46 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 09 00:56:46.917056 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 928/1829] 10.222.0.15 () {60 vars in 1153 bytes} [Sun Oct 9 00:56:46 2022] POST /identity/v3/projects => generated 377 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 09 00:56:46.921345 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0af862-4339-4aba-b7ff-ef98a2c28319 service cinder] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:56:46.947915 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0af862-4339-4aba-b7ff-ef98a2c28319 service cinder] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:56:47.108506 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae75736d-8a0f-4ed3-8bb8-a7fe1b3721c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:56:47.110911 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae75736d-8a0f-4ed3-8bb8-a7fe1b3721c1 admin admin] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:47.111060 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae75736d-8a0f-4ed3-8bb8-a7fe1b3721c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:47.111917 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae75736d-8a0f-4ed3-8bb8-a7fe1b3721c1 admin admin] PATH_INFO: `/v3/users` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:47.113727 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae75736d-8a0f-4ed3-8bb8-a7fe1b3721c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:56:47.118096 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae75736d-8a0f-4ed3-8bb8-a7fe1b3721c1 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:56:47.169063 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 902/1830] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Oct 9 00:56:46 2022] POST /identity/v3/users => generated 289 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 09 00:56:47.172589 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a178a073-5e27-4d88-970f-2028acbbf51e admin admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:56:47.183760 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:56:47.195138 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a178a073-5e27-4d88-970f-2028acbbf51e admin admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:56:47.219023 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12373c2d-bce2-493c-a898-a8bad0895a6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:56:47.220096 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12373c2d-bce2-493c-a898-a8bad0895a6f admin admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:47.220375 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12373c2d-bce2-493c-a898-a8bad0895a6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:47.220783 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12373c2d-bce2-493c-a898-a8bad0895a6f admin admin] PATH_INFO: `/v3/roles` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:47.221641 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12373c2d-bce2-493c-a898-a8bad0895a6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:56:47.223383 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12373c2d-bce2-493c-a898-a8bad0895a6f admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:56:47.238233 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 929/1831] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Oct 9 00:56:47 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 09 00:56:47.242998 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae75736d-8a0f-4ed3-8bb8-a7fe1b3721c1 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:56:47.258041 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae75736d-8a0f-4ed3-8bb8-a7fe1b3721c1 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:56:47.267546 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad77fd03-3b03-4f70-8025-c36cf8ba6178 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:56:47.267798 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad77fd03-3b03-4f70-8025-c36cf8ba6178 admin admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:47.268113 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad77fd03-3b03-4f70-8025-c36cf8ba6178 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:47.268378 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad77fd03-3b03-4f70-8025-c36cf8ba6178 admin admin] PATH_INFO: `/v3/roles` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:47.269088 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad77fd03-3b03-4f70-8025-c36cf8ba6178 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:56:47.270756 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad77fd03-3b03-4f70-8025-c36cf8ba6178 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:56:47.282397 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 903/1832] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Oct 9 00:56:47 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 09 00:56:47.287036 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12373c2d-bce2-493c-a898-a8bad0895a6f admin admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:56:47.300810 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12373c2d-bce2-493c-a898-a8bad0895a6f admin admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:56:47.317350 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f870abe5-ecce-4dcc-a420-096a87aa6d62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:56:47.318581 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f870abe5-ecce-4dcc-a420-096a87aa6d62 admin admin] REQUEST_METHOD: `PUT` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:47.319662 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f870abe5-ecce-4dcc-a420-096a87aa6d62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:47.320013 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f870abe5-ecce-4dcc-a420-096a87aa6d62 admin admin] PATH_INFO: `/v3/projects/8e6641689a744f24867cf322fec1af00/users/39c1d689269f443a87d3d7e91d5986e4/roles/afb0a01183d9497795eaa4fa1a4046ae` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:47.344546 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f870abe5-ecce-4dcc-a420-096a87aa6d62 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e6641689a744f24867cf322fec1af00, user_id=39c1d689269f443a87d3d7e91d5986e4, role_id=afb0a01183d9497795eaa4fa1a4046ae)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:56:47.349251 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f870abe5-ecce-4dcc-a420-096a87aa6d62 admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:56:47.406631 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 930/1833] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Oct 9 00:56:47 2022] PUT /identity/v3/projects/8e6641689a744f24867cf322fec1af00/users/39c1d689269f443a87d3d7e91d5986e4/roles/afb0a01183d9497795eaa4fa1a4046ae => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 00:56:47.422483 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df5998b-ac72-4210-8e15-ee44d3ec14df None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:47.422860 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df5998b-ac72-4210-8e15-ee44d3ec14df None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:47.423176 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df5998b-ac72-4210-8e15-ee44d3ec14df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:47.531378 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-6df5998b-ac72-4210-8e15-ee44d3ec14df None None] MFA Rules not processed for user `39c1d689269f443a87d3d7e91d5986e4`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:56:47.533370 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-6df5998b-ac72-4210-8e15-ee44d3ec14df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:56:47.584489 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:56:47.705872 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 904/1834] 10.222.0.15 () {58 vars in 958 bytes} [Sun Oct 9 00:56:47 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:56:47.710885 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f870abe5-ecce-4dcc-a420-096a87aa6d62 admin admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:56:47.798215 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f870abe5-ecce-4dcc-a420-096a87aa6d62 admin admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:56:47.803415 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10009126-9c97-4e9d-bcf0-e38d9c7cedcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:56:47.804562 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10009126-9c97-4e9d-bcf0-e38d9c7cedcd admin admin] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:47.804905 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10009126-9c97-4e9d-bcf0-e38d9c7cedcd admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:47.805246 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10009126-9c97-4e9d-bcf0-e38d9c7cedcd admin admin] PATH_INFO: `/v3/projects` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:47.806127 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10009126-9c97-4e9d-bcf0-e38d9c7cedcd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:56:47.808238 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10009126-9c97-4e9d-bcf0-e38d9c7cedcd admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:56:47.846669 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 931/1835] 10.222.0.15 () {60 vars in 1153 bytes} [Sun Oct 9 00:56:47 2022] POST /identity/v3/projects => generated 379 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 09 00:56:47.850334 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df5998b-ac72-4210-8e15-ee44d3ec14df None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:56:47.864698 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df5998b-ac72-4210-8e15-ee44d3ec14df None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:56:47.959993 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11c5182-55f6-4cf0-abee-340937cc7afe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:56:47.961932 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11c5182-55f6-4cf0-abee-340937cc7afe admin admin] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:47.962404 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11c5182-55f6-4cf0-abee-340937cc7afe admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:47.963471 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11c5182-55f6-4cf0-abee-340937cc7afe admin admin] PATH_INFO: `/v3/users` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:47.964593 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11c5182-55f6-4cf0-abee-340937cc7afe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:56:47.967768 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11c5182-55f6-4cf0-abee-340937cc7afe admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:56:48.004408 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 905/1836] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Oct 9 00:56:47 2022] POST /identity/v3/users => generated 290 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 09 00:56:48.005205 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10009126-9c97-4e9d-bcf0-e38d9c7cedcd admin admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:56:48.023361 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10009126-9c97-4e9d-bcf0-e38d9c7cedcd admin admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:56:48.040046 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7cb074-e230-445c-b79b-ef965afca88b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:56:48.040908 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7cb074-e230-445c-b79b-ef965afca88b admin admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:48.041710 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7cb074-e230-445c-b79b-ef965afca88b admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:48.042171 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7cb074-e230-445c-b79b-ef965afca88b admin admin] PATH_INFO: `/v3/roles` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:48.043145 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7cb074-e230-445c-b79b-ef965afca88b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:56:48.046261 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7cb074-e230-445c-b79b-ef965afca88b admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:56:48.061338 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 932/1837] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Oct 9 00:56:48 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 09 00:56:48.065558 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11c5182-55f6-4cf0-abee-340937cc7afe admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:56:48.076058 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11c5182-55f6-4cf0-abee-340937cc7afe admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:56:48.080740 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eda0787-359a-4a31-9a0f-7d6ad27d93e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:56:48.081425 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eda0787-359a-4a31-9a0f-7d6ad27d93e4 admin admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:48.081793 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eda0787-359a-4a31-9a0f-7d6ad27d93e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:48.082131 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eda0787-359a-4a31-9a0f-7d6ad27d93e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:48.082913 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eda0787-359a-4a31-9a0f-7d6ad27d93e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:56:48.084697 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eda0787-359a-4a31-9a0f-7d6ad27d93e4 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:56:48.100553 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 906/1838] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Oct 9 00:56:48 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 09 00:56:48.101870 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7cb074-e230-445c-b79b-ef965afca88b admin admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:56:48.118042 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7cb074-e230-445c-b79b-ef965afca88b admin admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:56:48.138620 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a71e52c-9bd6-4ae3-a1a8-45235349719f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:56:48.139342 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a71e52c-9bd6-4ae3-a1a8-45235349719f admin admin] REQUEST_METHOD: `PUT` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:48.139748 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a71e52c-9bd6-4ae3-a1a8-45235349719f admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:48.140016 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a71e52c-9bd6-4ae3-a1a8-45235349719f admin admin] PATH_INFO: `/v3/projects/0b9948cd3f574222930d462a5449e1b7/users/7ce1cfbc1ec046e3b06020e01e15cc67/roles/afb0a01183d9497795eaa4fa1a4046ae` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:48.157112 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a71e52c-9bd6-4ae3-a1a8-45235349719f admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b9948cd3f574222930d462a5449e1b7, user_id=7ce1cfbc1ec046e3b06020e01e15cc67, role_id=afb0a01183d9497795eaa4fa1a4046ae)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:56:48.160294 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a71e52c-9bd6-4ae3-a1a8-45235349719f admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:56:48.175525 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 933/1839] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Oct 9 00:56:48 2022] PUT /identity/v3/projects/0b9948cd3f574222930d462a5449e1b7/users/7ce1cfbc1ec046e3b06020e01e15cc67/roles/afb0a01183d9497795eaa4fa1a4046ae => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 00:56:48.187539 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2784651-aee9-40b9-b8ae-4945be381a0c None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:48.187962 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2784651-aee9-40b9-b8ae-4945be381a0c None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:48.188238 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2784651-aee9-40b9-b8ae-4945be381a0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:48.218964 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-b2784651-aee9-40b9-b8ae-4945be381a0c None None] MFA Rules not processed for user `7ce1cfbc1ec046e3b06020e01e15cc67`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:56:48.220340 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-b2784651-aee9-40b9-b8ae-4945be381a0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:56:48.287713 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 907/1840] 10.222.0.15 () {58 vars in 958 bytes} [Sun Oct 9 00:56:48 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:56:48.292373 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a71e52c-9bd6-4ae3-a1a8-45235349719f admin admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:56:48.355412 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a71e52c-9bd6-4ae3-a1a8-45235349719f admin admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:56:48.362048 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a5b2b4-6a7a-4494-9b8d-a28600a544f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:56:48.362686 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a5b2b4-6a7a-4494-9b8d-a28600a544f1 admin admin] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:48.362964 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a5b2b4-6a7a-4494-9b8d-a28600a544f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:48.363230 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a5b2b4-6a7a-4494-9b8d-a28600a544f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:48.363954 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a5b2b4-6a7a-4494-9b8d-a28600a544f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:56:48.366049 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a5b2b4-6a7a-4494-9b8d-a28600a544f1 admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:56:48.404080 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 934/1841] 10.222.0.15 () {60 vars in 1153 bytes} [Sun Oct 9 00:56:48 2022] POST /identity/v3/projects => generated 379 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 09 00:56:48.407798 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2784651-aee9-40b9-b8ae-4945be381a0c None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:56:48.419029 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2784651-aee9-40b9-b8ae-4945be381a0c None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:56:48.447684 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:56:48.482272 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf13c7ce-f0c3-40f0-9ae1-ace2c45671d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:56:48.482908 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf13c7ce-f0c3-40f0-9ae1-ace2c45671d1 admin admin] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:48.483182 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf13c7ce-f0c3-40f0-9ae1-ace2c45671d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:48.483502 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf13c7ce-f0c3-40f0-9ae1-ace2c45671d1 admin admin] PATH_INFO: `/v3/users` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:48.484214 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf13c7ce-f0c3-40f0-9ae1-ace2c45671d1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:56:48.486526 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf13c7ce-f0c3-40f0-9ae1-ace2c45671d1 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:56:48.522202 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 908/1842] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Oct 9 00:56:48 2022] POST /identity/v3/users => generated 296 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 09 00:56:48.523525 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a5b2b4-6a7a-4494-9b8d-a28600a544f1 admin admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:56:48.530887 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:56:48.535457 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a5b2b4-6a7a-4494-9b8d-a28600a544f1 admin admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:56:48.543440 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5410c377-dad6-4b0f-ac1e-86779a78b13d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:56:48.544139 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5410c377-dad6-4b0f-ac1e-86779a78b13d admin admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:48.544581 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5410c377-dad6-4b0f-ac1e-86779a78b13d admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:48.544871 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5410c377-dad6-4b0f-ac1e-86779a78b13d admin admin] PATH_INFO: `/v3/roles` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:48.547414 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5410c377-dad6-4b0f-ac1e-86779a78b13d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:56:48.547646 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5410c377-dad6-4b0f-ac1e-86779a78b13d admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:56:48.560173 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 935/1843] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Oct 9 00:56:48 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 09 00:56:48.564530 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf13c7ce-f0c3-40f0-9ae1-ace2c45671d1 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:56:48.575907 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf13c7ce-f0c3-40f0-9ae1-ace2c45671d1 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:56:48.581860 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14adfddc-cc44-42f8-b5fc-8855c6bc42b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:56:48.582544 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14adfddc-cc44-42f8-b5fc-8855c6bc42b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:48.582817 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14adfddc-cc44-42f8-b5fc-8855c6bc42b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:48.583082 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14adfddc-cc44-42f8-b5fc-8855c6bc42b5 admin admin] PATH_INFO: `/v3/projects/fc1a229ff10640c3af56350826a5de8a/users/9bd1c880ca274662b55c85539301ff5e/roles/f69dddf26daf4dd79d4c962beb877af5` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:48.608515 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14adfddc-cc44-42f8-b5fc-8855c6bc42b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc1a229ff10640c3af56350826a5de8a, user_id=9bd1c880ca274662b55c85539301ff5e, role_id=f69dddf26daf4dd79d4c962beb877af5)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:56:48.612955 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14adfddc-cc44-42f8-b5fc-8855c6bc42b5 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:56:48.639350 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 909/1844] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Oct 9 00:56:48 2022] PUT /identity/v3/projects/fc1a229ff10640c3af56350826a5de8a/users/9bd1c880ca274662b55c85539301ff5e/roles/f69dddf26daf4dd79d4c962beb877af5 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 00:56:48.643698 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5410c377-dad6-4b0f-ac1e-86779a78b13d admin admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:56:48.655676 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5410c377-dad6-4b0f-ac1e-86779a78b13d admin admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:56:48.751440 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f0092b-3e8c-430b-be69-4aaf658e582a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:56:48.752200 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f0092b-3e8c-430b-be69-4aaf658e582a admin admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:48.752736 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f0092b-3e8c-430b-be69-4aaf658e582a admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:48.752888 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f0092b-3e8c-430b-be69-4aaf658e582a admin admin] PATH_INFO: `/v3/roles` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:48.753659 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f0092b-3e8c-430b-be69-4aaf658e582a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:56:48.755997 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f0092b-3e8c-430b-be69-4aaf658e582a admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:56:48.769305 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 936/1845] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Oct 9 00:56:48 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 09 00:56:48.772747 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14adfddc-cc44-42f8-b5fc-8855c6bc42b5 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:56:48.785106 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14adfddc-cc44-42f8-b5fc-8855c6bc42b5 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:56:48.790246 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028ef65c-891b-4f63-a839-7ab34fff3326 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:56:48.791226 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028ef65c-891b-4f63-a839-7ab34fff3326 admin admin] REQUEST_METHOD: `PUT` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:48.791549 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028ef65c-891b-4f63-a839-7ab34fff3326 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:48.791828 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028ef65c-891b-4f63-a839-7ab34fff3326 admin admin] PATH_INFO: `/v3/projects/fc1a229ff10640c3af56350826a5de8a/users/9bd1c880ca274662b55c85539301ff5e/roles/f69dddf26daf4dd79d4c962beb877af5` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:48.794749 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028ef65c-891b-4f63-a839-7ab34fff3326 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc1a229ff10640c3af56350826a5de8a, user_id=9bd1c880ca274662b55c85539301ff5e, role_id=f69dddf26daf4dd79d4c962beb877af5)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:56:48.797699 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028ef65c-891b-4f63-a839-7ab34fff3326 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:56:48.813796 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 910/1846] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Oct 9 00:56:48 2022] PUT /identity/v3/projects/fc1a229ff10640c3af56350826a5de8a/users/9bd1c880ca274662b55c85539301ff5e/roles/f69dddf26daf4dd79d4c962beb877af5 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 00:56:48.825358 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fabb3f-52c6-421a-a1b8-3f92cc278774 None None] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:48.825635 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fabb3f-52c6-421a-a1b8-3f92cc278774 None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:48.825938 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fabb3f-52c6-421a-a1b8-3f92cc278774 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:48.863932 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.auth.core [None req-28fabb3f-52c6-421a-a1b8-3f92cc278774 None None] MFA Rules not processed for user `9bd1c880ca274662b55c85539301ff5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:56:48.865370 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-28fabb3f-52c6-421a-a1b8-3f92cc278774 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:56:48.949445 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 937/1847] 10.222.0.15 () {58 vars in 958 bytes} [Sun Oct 9 00:56:48 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:56:48.963916 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028ef65c-891b-4f63-a839-7ab34fff3326 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:56:48.966247 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-028ef65c-891b-4f63-a839-7ab34fff3326 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:56:49.031194 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028ef65c-891b-4f63-a839-7ab34fff3326 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:56:49.034901 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84161048-094e-4d47-a9ff-f4eafb59464c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff7cb78bcd91467abe5c2e2b48aedd1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f148d39ced534860abfbe8fc3f98ace4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:56:49.035492 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84161048-094e-4d47-a9ff-f4eafb59464c service cinder] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:49.035766 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84161048-094e-4d47-a9ff-f4eafb59464c service cinder] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:49.036035 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84161048-094e-4d47-a9ff-f4eafb59464c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:49.045312 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84161048-094e-4d47-a9ff-f4eafb59464c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:56:49.046795 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84161048-094e-4d47-a9ff-f4eafb59464c service cinder] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:56:49.056573 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 911/1848] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Oct 9 00:56:48 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 09 00:56:49.101802 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fabb3f-52c6-421a-a1b8-3f92cc278774 None None] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:56:49.111406 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fabb3f-52c6-421a-a1b8-3f92cc278774 None None] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:56:49.115287 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa6c378-767a-40b6-a7c0-2463c52300ff service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff7cb78bcd91467abe5c2e2b48aedd1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f148d39ced534860abfbe8fc3f98ace4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:56:49.115863 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa6c378-767a-40b6-a7c0-2463c52300ff service cinder] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:49.116169 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa6c378-767a-40b6-a7c0-2463c52300ff service cinder] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:49.116443 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa6c378-767a-40b6-a7c0-2463c52300ff service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:49.182144 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa6c378-767a-40b6-a7c0-2463c52300ff service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:56:49.183644 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa6c378-767a-40b6-a7c0-2463c52300ff service cinder] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:56:49.195405 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 938/1849] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Oct 9 00:56:49 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 09 00:56:51.484395 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84161048-094e-4d47-a9ff-f4eafb59464c service cinder] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:56:51.486113 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-84161048-094e-4d47-a9ff-f4eafb59464c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:56:51.557326 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84161048-094e-4d47-a9ff-f4eafb59464c service cinder] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:56:51.562750 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28274742-63f0-4160-91f1-262f852c9b76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:56:51.563424 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28274742-63f0-4160-91f1-262f852c9b76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:51.563704 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28274742-63f0-4160-91f1-262f852c9b76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:51.563979 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28274742-63f0-4160-91f1-262f852c9b76 admin admin] PATH_INFO: `/v3/users/a8810bd2de5a40bcb10dc51a9a429f12` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:51.565113 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28274742-63f0-4160-91f1-262f852c9b76 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a8810bd2de5a40bcb10dc51a9a429f12)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:56:51.567071 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28274742-63f0-4160-91f1-262f852c9b76 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:56:51.592442 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=91,keystone:INSERT=5,keystone:DELETE=4 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:56:51.624589 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-28274742-63f0-4160-91f1-262f852c9b76 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a8810bd2de5a40bcb10dc51a9a429f12'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:56:51.632279 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-28274742-63f0-4160-91f1-262f852c9b76 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a8810bd2de5a40bcb10dc51a9a429f12'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:56:51.633404 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-28274742-63f0-4160-91f1-262f852c9b76 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a8810bd2de5a40bcb10dc51a9a429f12'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:56:51.633872 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-28274742-63f0-4160-91f1-262f852c9b76 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a8810bd2de5a40bcb10dc51a9a429f12'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:56:51.643428 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-28274742-63f0-4160-91f1-262f852c9b76 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a8810bd2de5a40bcb10dc51a9a429f12'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:56:51.662272 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 912/1850] 10.222.0.15 () {58 vars in 1224 bytes} [Sun Oct 9 00:56:51 2022] DELETE /identity/v3/users/a8810bd2de5a40bcb10dc51a9a429f12 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 00:56:51.667301 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38d2e4d-fb4a-41b0-afcd-268054996a27 None None] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:51.667849 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38d2e4d-fb4a-41b0-afcd-268054996a27 None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:51.667849 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38d2e4d-fb4a-41b0-afcd-268054996a27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:51.692329 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.auth.core [None req-b38d2e4d-fb4a-41b0-afcd-268054996a27 None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:56:51.693651 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-b38d2e4d-fb4a-41b0-afcd-268054996a27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:56:51.702544 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:56:51.759664 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 939/1851] 10.222.0.15 () {58 vars in 958 bytes} [Sun Oct 9 00:56:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 09 00:56:51.768779 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28274742-63f0-4160-91f1-262f852c9b76 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:56:51.774969 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-28274742-63f0-4160-91f1-262f852c9b76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:56:51.843825 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28274742-63f0-4160-91f1-262f852c9b76 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:56:51.847579 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f494265-512d-4c60-b2a2-5683b048ceb8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4ef90d456d2483e8ddafbe2d4d4fb5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f148d39ced534860abfbe8fc3f98ace4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:56:51.848480 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f494265-512d-4c60-b2a2-5683b048ceb8 service neutron] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:51.848706 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f494265-512d-4c60-b2a2-5683b048ceb8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:51.849155 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f494265-512d-4c60-b2a2-5683b048ceb8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:51.863974 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f494265-512d-4c60-b2a2-5683b048ceb8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:56:51.865694 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f494265-512d-4c60-b2a2-5683b048ceb8 service neutron] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:56:51.877256 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 913/1852] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Oct 9 00:56:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 09 00:56:52.178967 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38d2e4d-fb4a-41b0-afcd-268054996a27 None None] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:56:52.181228 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-b38d2e4d-fb4a-41b0-afcd-268054996a27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:56:52.199409 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38d2e4d-fb4a-41b0-afcd-268054996a27 None None] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:56:52.205860 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9af439c-ce47-4a01-b5e2-f6e0c93b91ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:56:52.206821 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9af439c-ce47-4a01-b5e2-f6e0c93b91ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:52.207130 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9af439c-ce47-4a01-b5e2-f6e0c93b91ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:52.207475 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9af439c-ce47-4a01-b5e2-f6e0c93b91ea admin admin] PATH_INFO: `/v3/projects/d9bf67a710d24bed9b5dc4c89bf00a16` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:52.208818 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9af439c-ce47-4a01-b5e2-f6e0c93b91ea admin admin] RBAC: Authorizing `identity:delete_project(project_id=d9bf67a710d24bed9b5dc4c89bf00a16)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:56:52.211166 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9af439c-ce47-4a01-b5e2-f6e0c93b91ea admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:56:52.282857 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-d9af439c-ce47-4a01-b5e2-f6e0c93b91ea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd9bf67a710d24bed9b5dc4c89bf00a16', 'request_id': 'req-d9af439c-ce47-4a01-b5e2-f6e0c93b91ea'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:56:52.296458 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-d9af439c-ce47-4a01-b5e2-f6e0c93b91ea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd9bf67a710d24bed9b5dc4c89bf00a16', 'request_id': 'req-d9af439c-ce47-4a01-b5e2-f6e0c93b91ea'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:56:52.315652 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-d9af439c-ce47-4a01-b5e2-f6e0c93b91ea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd9bf67a710d24bed9b5dc4c89bf00a16', 'request_id': 'req-d9af439c-ce47-4a01-b5e2-f6e0c93b91ea'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:56:52.320666 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-d9af439c-ce47-4a01-b5e2-f6e0c93b91ea admin admin] The token cache is being invalidate because project d9bf67a710d24bed9b5dc4c89bf00a16 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81525) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 09 00:56:52.321172 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-d9af439c-ce47-4a01-b5e2-f6e0c93b91ea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:56:52.321746 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-d9af439c-ce47-4a01-b5e2-f6e0c93b91ea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:56:52.323629 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 940/1853] 10.222.0.15 () {58 vars in 1233 bytes} [Sun Oct 9 00:56:52 2022] DELETE /identity/v3/projects/d9bf67a710d24bed9b5dc4c89bf00a16 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 00:56:52.327527 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f494265-512d-4c60-b2a2-5683b048ceb8 service neutron] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:56:52.338749 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f494265-512d-4c60-b2a2-5683b048ceb8 service neutron] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:56:52.428378 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bace62-52ad-486c-b3f3-b9ad6740c99d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:56:52.429078 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bace62-52ad-486c-b3f3-b9ad6740c99d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:52.429357 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bace62-52ad-486c-b3f3-b9ad6740c99d admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:52.430768 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bace62-52ad-486c-b3f3-b9ad6740c99d admin admin] PATH_INFO: `/v3/users/4b4868af82294b3b97e012aca36acfb1` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:52.434300 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bace62-52ad-486c-b3f3-b9ad6740c99d admin admin] RBAC: Authorizing `identity:delete_user(user_id=4b4868af82294b3b97e012aca36acfb1)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:56:52.439053 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bace62-52ad-486c-b3f3-b9ad6740c99d admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:56:52.464375 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9af439c-ce47-4a01-b5e2-f6e0c93b91ea admin admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:56:52.467875 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-d9af439c-ce47-4a01-b5e2-f6e0c93b91ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:56:52.486620 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9af439c-ce47-4a01-b5e2-f6e0c93b91ea admin admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:56:52.493095 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54210571-d835-4f3f-b783-3de1c69bf71b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:56:52.493816 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54210571-d835-4f3f-b783-3de1c69bf71b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:52.494132 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54210571-d835-4f3f-b783-3de1c69bf71b admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:52.494446 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54210571-d835-4f3f-b783-3de1c69bf71b admin admin] PATH_INFO: `/v3/users/39c1d689269f443a87d3d7e91d5986e4` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:52.495660 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54210571-d835-4f3f-b783-3de1c69bf71b admin admin] RBAC: Authorizing `identity:delete_user(user_id=39c1d689269f443a87d3d7e91d5986e4)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:56:52.497960 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54210571-d835-4f3f-b783-3de1c69bf71b admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:56:52.516351 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:56:52.518629 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-f2bace62-52ad-486c-b3f3-b9ad6740c99d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4b4868af82294b3b97e012aca36acfb1'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:56:52.538503 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-f2bace62-52ad-486c-b3f3-b9ad6740c99d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4b4868af82294b3b97e012aca36acfb1'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:56:52.539349 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-f2bace62-52ad-486c-b3f3-b9ad6740c99d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4b4868af82294b3b97e012aca36acfb1'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:56:52.540129 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-f2bace62-52ad-486c-b3f3-b9ad6740c99d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4b4868af82294b3b97e012aca36acfb1'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:56:52.553129 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-f2bace62-52ad-486c-b3f3-b9ad6740c99d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4b4868af82294b3b97e012aca36acfb1'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:56:52.568264 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-54210571-d835-4f3f-b783-3de1c69bf71b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '39c1d689269f443a87d3d7e91d5986e4'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:56:52.574356 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 914/1854] 10.222.0.15 () {58 vars in 1224 bytes} [Sun Oct 9 00:56:52 2022] DELETE /identity/v3/users/4b4868af82294b3b97e012aca36acfb1 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 09 00:56:52.576854 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-54210571-d835-4f3f-b783-3de1c69bf71b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '39c1d689269f443a87d3d7e91d5986e4'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:56:52.579760 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-54210571-d835-4f3f-b783-3de1c69bf71b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '39c1d689269f443a87d3d7e91d5986e4'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:56:52.580710 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-54210571-d835-4f3f-b783-3de1c69bf71b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '39c1d689269f443a87d3d7e91d5986e4'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:56:52.591672 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-54210571-d835-4f3f-b783-3de1c69bf71b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '39c1d689269f443a87d3d7e91d5986e4'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:56:52.613645 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 941/1855] 10.222.0.15 () {58 vars in 1224 bytes} [Sun Oct 9 00:56:52 2022] DELETE /identity/v3/users/39c1d689269f443a87d3d7e91d5986e4 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 00:56:52.618222 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9abebc-0f4a-4938-96ec-068f46dde63c None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:52.618511 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9abebc-0f4a-4938-96ec-068f46dde63c None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:52.618793 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9abebc-0f4a-4938-96ec-068f46dde63c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:52.644898 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-6d9abebc-0f4a-4938-96ec-068f46dde63c None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:56:52.646543 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-6d9abebc-0f4a-4938-96ec-068f46dde63c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:56:52.712818 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 915/1856] 10.222.0.15 () {58 vars in 958 bytes} [Sun Oct 9 00:56:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:56:52.724759 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54210571-d835-4f3f-b783-3de1c69bf71b admin admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:56:52.726181 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-54210571-d835-4f3f-b783-3de1c69bf71b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:56:52.755967 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:56:52.844395 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54210571-d835-4f3f-b783-3de1c69bf71b admin admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:56:52.847991 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c84a68-a71d-403c-8e2a-ad11bc1a0800 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4ef90d456d2483e8ddafbe2d4d4fb5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f148d39ced534860abfbe8fc3f98ace4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:56:52.848618 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c84a68-a71d-403c-8e2a-ad11bc1a0800 service neutron] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:52.848987 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c84a68-a71d-403c-8e2a-ad11bc1a0800 service neutron] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:52.849166 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c84a68-a71d-403c-8e2a-ad11bc1a0800 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:52.859543 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c84a68-a71d-403c-8e2a-ad11bc1a0800 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:56:52.861377 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c84a68-a71d-403c-8e2a-ad11bc1a0800 service neutron] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:56:52.880541 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 942/1857] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Oct 9 00:56:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 09 00:56:52.970215 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9abebc-0f4a-4938-96ec-068f46dde63c None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:56:52.972046 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-6d9abebc-0f4a-4938-96ec-068f46dde63c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:56:52.987519 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9abebc-0f4a-4938-96ec-068f46dde63c None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:56:52.992889 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0880e3cf-732a-4e49-805e-e3d127f1a1f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:56:52.993646 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0880e3cf-732a-4e49-805e-e3d127f1a1f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:52.993992 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0880e3cf-732a-4e49-805e-e3d127f1a1f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:52.994330 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0880e3cf-732a-4e49-805e-e3d127f1a1f0 admin admin] PATH_INFO: `/v3/projects/f0e58e2eab15408aac55ba589b3b5f3f` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:52.995775 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0880e3cf-732a-4e49-805e-e3d127f1a1f0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f0e58e2eab15408aac55ba589b3b5f3f)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:56:52.998100 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0880e3cf-732a-4e49-805e-e3d127f1a1f0 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:56:53.069313 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-0880e3cf-732a-4e49-805e-e3d127f1a1f0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f0e58e2eab15408aac55ba589b3b5f3f', 'request_id': 'req-0880e3cf-732a-4e49-805e-e3d127f1a1f0'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:56:53.079987 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-0880e3cf-732a-4e49-805e-e3d127f1a1f0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f0e58e2eab15408aac55ba589b3b5f3f', 'request_id': 'req-0880e3cf-732a-4e49-805e-e3d127f1a1f0'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:56:53.096483 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-0880e3cf-732a-4e49-805e-e3d127f1a1f0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f0e58e2eab15408aac55ba589b3b5f3f', 'request_id': 'req-0880e3cf-732a-4e49-805e-e3d127f1a1f0'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:56:53.113778 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-0880e3cf-732a-4e49-805e-e3d127f1a1f0 admin admin] The token cache is being invalidate because project f0e58e2eab15408aac55ba589b3b5f3f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81524) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 09 00:56:53.113976 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-0880e3cf-732a-4e49-805e-e3d127f1a1f0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:56:53.114770 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-0880e3cf-732a-4e49-805e-e3d127f1a1f0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:56:53.116895 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 916/1858] 10.222.0.15 () {58 vars in 1233 bytes} [Sun Oct 9 00:56:52 2022] DELETE /identity/v3/projects/f0e58e2eab15408aac55ba589b3b5f3f => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 00:56:53.121669 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83bb0ee-7b7b-4980-ab64-f93770ecbddf None None] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:53.121952 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83bb0ee-7b7b-4980-ab64-f93770ecbddf None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:53.122572 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83bb0ee-7b7b-4980-ab64-f93770ecbddf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:53.144845 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.auth.core [None req-c83bb0ee-7b7b-4980-ab64-f93770ecbddf None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:56:53.146889 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-c83bb0ee-7b7b-4980-ab64-f93770ecbddf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:56:53.228383 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 943/1859] 10.222.0.15 () {58 vars in 958 bytes} [Sun Oct 9 00:56:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:56:53.236142 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412cec5b-2f91-4147-bed9-d6bf26568fe3 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:53.236445 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412cec5b-2f91-4147-bed9-d6bf26568fe3 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:53.236717 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412cec5b-2f91-4147-bed9-d6bf26568fe3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:53.260187 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-412cec5b-2f91-4147-bed9-d6bf26568fe3 None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:56:53.261842 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-412cec5b-2f91-4147-bed9-d6bf26568fe3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:56:53.271677 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 917/1860] 10.222.0.15 () {58 vars in 958 bytes} [Sun Oct 9 00:56:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:56:53.275843 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83bb0ee-7b7b-4980-ab64-f93770ecbddf None None] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:56:53.301459 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83bb0ee-7b7b-4980-ab64-f93770ecbddf None None] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:56:53.307742 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9765de32-1b49-47c9-aef0-f3f500c0b2eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:56:53.308380 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9765de32-1b49-47c9-aef0-f3f500c0b2eb admin admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:53.308657 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9765de32-1b49-47c9-aef0-f3f500c0b2eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:53.308924 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9765de32-1b49-47c9-aef0-f3f500c0b2eb admin admin] PATH_INFO: `/v3/domains` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:53.309620 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9765de32-1b49-47c9-aef0-f3f500c0b2eb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:56:53.309915 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9765de32-1b49-47c9-aef0-f3f500c0b2eb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:56:53.311582 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9765de32-1b49-47c9-aef0-f3f500c0b2eb admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:56:53.324625 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 944/1861] 10.222.0.15 () {58 vars in 1153 bytes} [Sun Oct 9 00:56:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 09 00:56:53.329109 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412cec5b-2f91-4147-bed9-d6bf26568fe3 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:56:53.339335 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412cec5b-2f91-4147-bed9-d6bf26568fe3 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:56:53.344229 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181ec003-a5fb-4a28-ac82-91e2ee9c5984 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:56:53.344868 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181ec003-a5fb-4a28-ac82-91e2ee9c5984 admin admin] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:53.345130 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181ec003-a5fb-4a28-ac82-91e2ee9c5984 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:53.345403 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181ec003-a5fb-4a28-ac82-91e2ee9c5984 admin admin] PATH_INFO: `/v3/projects` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:53.346207 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181ec003-a5fb-4a28-ac82-91e2ee9c5984 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:56:53.348363 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181ec003-a5fb-4a28-ac82-91e2ee9c5984 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:56:53.376668 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9765de32-1b49-47c9-aef0-f3f500c0b2eb admin admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:56:53.378684 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-9765de32-1b49-47c9-aef0-f3f500c0b2eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:56:53.385290 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 918/1862] 10.222.0.15 () {60 vars in 1153 bytes} [Sun Oct 9 00:56:53 2022] POST /identity/v3/projects => generated 407 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 09 00:56:53.388164 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181ec003-a5fb-4a28-ac82-91e2ee9c5984 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:56:53.395499 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9765de32-1b49-47c9-aef0-f3f500c0b2eb admin admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:56:53.418388 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:56:53.483959 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181ec003-a5fb-4a28-ac82-91e2ee9c5984 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:56:53.490028 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9033b2d9-b3ab-4536-8b75-2bd109961700 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:56:53.490237 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7702b5ad-2518-4ee6-b077-d2994b1e55c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:56:53.490856 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9033b2d9-b3ab-4536-8b75-2bd109961700 admin admin] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:53.491137 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9033b2d9-b3ab-4536-8b75-2bd109961700 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:53.491272 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7702b5ad-2518-4ee6-b077-d2994b1e55c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:53.491443 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9033b2d9-b3ab-4536-8b75-2bd109961700 admin admin] PATH_INFO: `/v3/users` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:53.491714 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7702b5ad-2518-4ee6-b077-d2994b1e55c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:53.491987 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7702b5ad-2518-4ee6-b077-d2994b1e55c9 admin admin] PATH_INFO: `/v3/projects/8e6641689a744f24867cf322fec1af00` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:53.492224 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9033b2d9-b3ab-4536-8b75-2bd109961700 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:56:53.493630 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7702b5ad-2518-4ee6-b077-d2994b1e55c9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e6641689a744f24867cf322fec1af00)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:56:53.494174 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9033b2d9-b3ab-4536-8b75-2bd109961700 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:56:53.495398 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7702b5ad-2518-4ee6-b077-d2994b1e55c9 admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:56:53.523460 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 919/1863] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Oct 9 00:56:53 2022] POST /identity/v3/users => generated 304 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 09 00:56:53.528004 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9033b2d9-b3ab-4536-8b75-2bd109961700 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:56:53.541039 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9033b2d9-b3ab-4536-8b75-2bd109961700 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:56:53.550540 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:56:53.558510 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-7702b5ad-2518-4ee6-b077-d2994b1e55c9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e6641689a744f24867cf322fec1af00', 'request_id': 'req-7702b5ad-2518-4ee6-b077-d2994b1e55c9'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:56:53.573053 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-7702b5ad-2518-4ee6-b077-d2994b1e55c9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e6641689a744f24867cf322fec1af00', 'request_id': 'req-7702b5ad-2518-4ee6-b077-d2994b1e55c9'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:56:53.580159 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-7702b5ad-2518-4ee6-b077-d2994b1e55c9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e6641689a744f24867cf322fec1af00', 'request_id': 'req-7702b5ad-2518-4ee6-b077-d2994b1e55c9'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:56:53.591872 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-7702b5ad-2518-4ee6-b077-d2994b1e55c9 admin admin] The token cache is being invalidate because project 8e6641689a744f24867cf322fec1af00 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81525) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 09 00:56:53.591872 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-7702b5ad-2518-4ee6-b077-d2994b1e55c9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:56:53.592635 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-7702b5ad-2518-4ee6-b077-d2994b1e55c9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:56:53.594157 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 945/1864] 10.222.0.15 () {58 vars in 1233 bytes} [Sun Oct 9 00:56:53 2022] DELETE /identity/v3/projects/8e6641689a744f24867cf322fec1af00 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 00:56:53.598190 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7702b5ad-2518-4ee6-b077-d2994b1e55c9 admin admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:56:53.599753 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-7702b5ad-2518-4ee6-b077-d2994b1e55c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:56:53.621811 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478ccd52-a953-4d2a-bf79-e4e09cec2fc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:56:53.623171 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478ccd52-a953-4d2a-bf79-e4e09cec2fc8 admin admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:53.623478 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478ccd52-a953-4d2a-bf79-e4e09cec2fc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:53.623753 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478ccd52-a953-4d2a-bf79-e4e09cec2fc8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:53.624691 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478ccd52-a953-4d2a-bf79-e4e09cec2fc8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:56:53.626303 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478ccd52-a953-4d2a-bf79-e4e09cec2fc8 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:56:53.637583 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 920/1865] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Oct 9 00:56:53 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 09 00:56:53.641363 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478ccd52-a953-4d2a-bf79-e4e09cec2fc8 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:56:53.643063 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-478ccd52-a953-4d2a-bf79-e4e09cec2fc8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:56:53.655670 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478ccd52-a953-4d2a-bf79-e4e09cec2fc8 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:56:53.662056 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891c5b42-f68c-4e63-b772-28204f0966ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:56:53.662741 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891c5b42-f68c-4e63-b772-28204f0966ff admin admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:53.663102 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891c5b42-f68c-4e63-b772-28204f0966ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:53.663502 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891c5b42-f68c-4e63-b772-28204f0966ff admin admin] PATH_INFO: `/v3/roles` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:53.664263 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891c5b42-f68c-4e63-b772-28204f0966ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:56:53.665960 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891c5b42-f68c-4e63-b772-28204f0966ff admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:56:53.680448 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7702b5ad-2518-4ee6-b077-d2994b1e55c9 admin admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:56:53.686551 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e544db93-9c82-4ed9-a8e7-7ee6868b0767 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:56:53.687430 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 921/1866] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Oct 9 00:56:53 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 09 00:56:53.688301 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e544db93-9c82-4ed9-a8e7-7ee6868b0767 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:53.688301 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e544db93-9c82-4ed9-a8e7-7ee6868b0767 admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:53.688301 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e544db93-9c82-4ed9-a8e7-7ee6868b0767 admin admin] PATH_INFO: `/v3/users/7ce1cfbc1ec046e3b06020e01e15cc67` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:53.688597 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891c5b42-f68c-4e63-b772-28204f0966ff admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:56:53.689932 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e544db93-9c82-4ed9-a8e7-7ee6868b0767 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7ce1cfbc1ec046e3b06020e01e15cc67)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:56:53.692178 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e544db93-9c82-4ed9-a8e7-7ee6868b0767 admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:56:53.700331 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891c5b42-f68c-4e63-b772-28204f0966ff admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:56:53.705724 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf610f04-bdd5-492b-8dd2-8a9457bf6e91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:56:53.706440 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf610f04-bdd5-492b-8dd2-8a9457bf6e91 admin admin] REQUEST_METHOD: `PUT` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:53.706719 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf610f04-bdd5-492b-8dd2-8a9457bf6e91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:53.707242 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf610f04-bdd5-492b-8dd2-8a9457bf6e91 admin admin] PATH_INFO: `/v3/projects/6d75923e5a084708b4b8370cb7e5eea0/users/6be9a10fc19e4852bf329c872b25f2bc/roles/afb0a01183d9497795eaa4fa1a4046ae` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:53.723067 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf610f04-bdd5-492b-8dd2-8a9457bf6e91 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d75923e5a084708b4b8370cb7e5eea0, user_id=6be9a10fc19e4852bf329c872b25f2bc, role_id=afb0a01183d9497795eaa4fa1a4046ae)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:56:53.726211 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf610f04-bdd5-492b-8dd2-8a9457bf6e91 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:56:53.764537 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 922/1867] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Oct 9 00:56:53 2022] PUT /identity/v3/projects/6d75923e5a084708b4b8370cb7e5eea0/users/6be9a10fc19e4852bf329c872b25f2bc/roles/afb0a01183d9497795eaa4fa1a4046ae => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 00:56:53.774410 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-e544db93-9c82-4ed9-a8e7-7ee6868b0767 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7ce1cfbc1ec046e3b06020e01e15cc67'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:56:53.777920 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fe8d53-a68a-4fcc-bbc4-45fbca2b8d18 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:53.778208 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fe8d53-a68a-4fcc-bbc4-45fbca2b8d18 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:53.778474 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fe8d53-a68a-4fcc-bbc4-45fbca2b8d18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:53.782571 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-e544db93-9c82-4ed9-a8e7-7ee6868b0767 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7ce1cfbc1ec046e3b06020e01e15cc67'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:56:53.783404 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-e544db93-9c82-4ed9-a8e7-7ee6868b0767 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7ce1cfbc1ec046e3b06020e01e15cc67'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:56:53.784107 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-e544db93-9c82-4ed9-a8e7-7ee6868b0767 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7ce1cfbc1ec046e3b06020e01e15cc67'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:56:53.793093 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-e544db93-9c82-4ed9-a8e7-7ee6868b0767 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7ce1cfbc1ec046e3b06020e01e15cc67'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:56:53.807077 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-c8fe8d53-a68a-4fcc-bbc4-45fbca2b8d18 None None] MFA Rules not processed for user `6be9a10fc19e4852bf329c872b25f2bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:56:53.808378 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-c8fe8d53-a68a-4fcc-bbc4-45fbca2b8d18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:56:53.810470 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 946/1868] 10.222.0.15 () {58 vars in 1224 bytes} [Sun Oct 9 00:56:53 2022] DELETE /identity/v3/users/7ce1cfbc1ec046e3b06020e01e15cc67 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 00:56:53.875610 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:56:53.883302 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 923/1869] 10.222.0.15 () {58 vars in 958 bytes} [Sun Oct 9 00:56:53 2022] POST /identity/v3/auth/tokens => generated 3284 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 09 00:56:53.887840 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e544db93-9c82-4ed9-a8e7-7ee6868b0767 admin admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:56:53.889295 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-e544db93-9c82-4ed9-a8e7-7ee6868b0767 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:56:53.940683 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:56:53.958463 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e544db93-9c82-4ed9-a8e7-7ee6868b0767 admin admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:56:53.963867 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ca5afd-5bcf-4353-aa17-7ce4a081de00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:56:53.967741 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ca5afd-5bcf-4353-aa17-7ce4a081de00 admin admin] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:53.967741 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ca5afd-5bcf-4353-aa17-7ce4a081de00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:53.967898 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ca5afd-5bcf-4353-aa17-7ce4a081de00 admin admin] PATH_INFO: `/v3/projects` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:53.968598 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ca5afd-5bcf-4353-aa17-7ce4a081de00 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:56:53.970590 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ca5afd-5bcf-4353-aa17-7ce4a081de00 admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:56:54.017631 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 947/1870] 10.222.0.15 () {60 vars in 1153 bytes} [Sun Oct 9 00:56:53 2022] POST /identity/v3/projects => generated 409 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 09 00:56:54.019130 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fe8d53-a68a-4fcc-bbc4-45fbca2b8d18 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:56:54.031621 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fe8d53-a68a-4fcc-bbc4-45fbca2b8d18 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:56:54.126951 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389a3720-0147-4f80-88fa-171a4dfca7bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:56:54.130857 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389a3720-0147-4f80-88fa-171a4dfca7bd admin admin] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:54.131154 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389a3720-0147-4f80-88fa-171a4dfca7bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:54.131487 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389a3720-0147-4f80-88fa-171a4dfca7bd admin admin] PATH_INFO: `/v3/users` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:54.133537 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389a3720-0147-4f80-88fa-171a4dfca7bd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:56:54.143786 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ca5afd-5bcf-4353-aa17-7ce4a081de00 admin admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:56:54.145541 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-f6ca5afd-5bcf-4353-aa17-7ce4a081de00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:56:54.146474 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389a3720-0147-4f80-88fa-171a4dfca7bd admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:56:54.170480 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ca5afd-5bcf-4353-aa17-7ce4a081de00 admin admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:56:54.191244 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 924/1871] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Oct 9 00:56:54 2022] POST /identity/v3/users => generated 311 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 09 00:56:54.191244 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389a3720-0147-4f80-88fa-171a4dfca7bd admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:56:54.192371 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071beec5-801d-417a-96d3-05a3888bc4c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:56:54.193451 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071beec5-801d-417a-96d3-05a3888bc4c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:54.194603 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071beec5-801d-417a-96d3-05a3888bc4c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:54.195070 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071beec5-801d-417a-96d3-05a3888bc4c1 admin admin] PATH_INFO: `/v3/projects/0b9948cd3f574222930d462a5449e1b7` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:54.196769 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071beec5-801d-417a-96d3-05a3888bc4c1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b9948cd3f574222930d462a5449e1b7)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:56:54.199002 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071beec5-801d-417a-96d3-05a3888bc4c1 admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:56:54.213341 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389a3720-0147-4f80-88fa-171a4dfca7bd admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:56:54.220462 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a65f460-8182-4338-99a7-1efc0656ff64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:56:54.221221 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a65f460-8182-4338-99a7-1efc0656ff64 admin admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:54.232306 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a65f460-8182-4338-99a7-1efc0656ff64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:54.232802 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a65f460-8182-4338-99a7-1efc0656ff64 admin admin] PATH_INFO: `/v3/roles` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:54.233680 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a65f460-8182-4338-99a7-1efc0656ff64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:56:54.237177 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a65f460-8182-4338-99a7-1efc0656ff64 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:56:54.254859 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 925/1872] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Oct 9 00:56:54 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 09 00:56:54.256874 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a65f460-8182-4338-99a7-1efc0656ff64 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:56:54.269465 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a65f460-8182-4338-99a7-1efc0656ff64 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:56:54.292224 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-071beec5-801d-417a-96d3-05a3888bc4c1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b9948cd3f574222930d462a5449e1b7', 'request_id': 'req-071beec5-801d-417a-96d3-05a3888bc4c1'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:56:54.310814 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-071beec5-801d-417a-96d3-05a3888bc4c1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b9948cd3f574222930d462a5449e1b7', 'request_id': 'req-071beec5-801d-417a-96d3-05a3888bc4c1'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:56:54.321782 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-071beec5-801d-417a-96d3-05a3888bc4c1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b9948cd3f574222930d462a5449e1b7', 'request_id': 'req-071beec5-801d-417a-96d3-05a3888bc4c1'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:56:54.340918 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-071beec5-801d-417a-96d3-05a3888bc4c1 admin admin] The token cache is being invalidate because project 0b9948cd3f574222930d462a5449e1b7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81525) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 09 00:56:54.341510 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-071beec5-801d-417a-96d3-05a3888bc4c1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:56:54.342849 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-071beec5-801d-417a-96d3-05a3888bc4c1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:56:54.345819 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 948/1873] 10.222.0.15 () {58 vars in 1233 bytes} [Sun Oct 9 00:56:54 2022] DELETE /identity/v3/projects/0b9948cd3f574222930d462a5449e1b7 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 09 00:56:54.351485 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071beec5-801d-417a-96d3-05a3888bc4c1 admin admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:56:54.353186 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-071beec5-801d-417a-96d3-05a3888bc4c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:56:54.382232 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a7eba4-e205-41aa-a4e0-d830dbf9a547 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:56:54.383007 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a7eba4-e205-41aa-a4e0-d830dbf9a547 admin admin] REQUEST_METHOD: `PUT` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:54.383491 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a7eba4-e205-41aa-a4e0-d830dbf9a547 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:54.383768 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a7eba4-e205-41aa-a4e0-d830dbf9a547 admin admin] PATH_INFO: `/v3/projects/918cff8cb5da4478868db2296de2dc32/users/2c2ec36d9bf1405e97d0ff2f800696f4/roles/f69dddf26daf4dd79d4c962beb877af5` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:54.418077 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a7eba4-e205-41aa-a4e0-d830dbf9a547 admin admin] RBAC: Authorizing `identity:create_grant(project_id=918cff8cb5da4478868db2296de2dc32, user_id=2c2ec36d9bf1405e97d0ff2f800696f4, role_id=f69dddf26daf4dd79d4c962beb877af5)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:56:54.424770 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a7eba4-e205-41aa-a4e0-d830dbf9a547 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:56:54.450772 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 926/1874] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Oct 9 00:56:54 2022] PUT /identity/v3/projects/918cff8cb5da4478868db2296de2dc32/users/2c2ec36d9bf1405e97d0ff2f800696f4/roles/f69dddf26daf4dd79d4c962beb877af5 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 00:56:54.455484 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a7eba4-e205-41aa-a4e0-d830dbf9a547 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:56:54.472989 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-f7a7eba4-e205-41aa-a4e0-d830dbf9a547 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:56:54.547774 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071beec5-801d-417a-96d3-05a3888bc4c1 admin admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:56:54.640076 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a7eba4-e205-41aa-a4e0-d830dbf9a547 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:56:54.647301 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe8518a-9be0-4108-adf9-362a1a1ffcb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:56:54.647937 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe8518a-9be0-4108-adf9-362a1a1ffcb2 admin admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:54.648219 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe8518a-9be0-4108-adf9-362a1a1ffcb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:54.648583 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe8518a-9be0-4108-adf9-362a1a1ffcb2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:54.649585 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe8518a-9be0-4108-adf9-362a1a1ffcb2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:56:54.652961 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe8518a-9be0-4108-adf9-362a1a1ffcb2 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:56:54.654728 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:56:54.672910 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 927/1875] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Oct 9 00:56:54 2022] GET /identity/v3/roles => generated 1420 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 09 00:56:54.678279 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe8518a-9be0-4108-adf9-362a1a1ffcb2 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:56:54.679740 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54793759-89f3-47f0-a44f-2e0060fedccc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:56:54.680556 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54793759-89f3-47f0-a44f-2e0060fedccc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:54.680836 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54793759-89f3-47f0-a44f-2e0060fedccc admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:54.681107 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54793759-89f3-47f0-a44f-2e0060fedccc admin admin] PATH_INFO: `/v3/users/9bd1c880ca274662b55c85539301ff5e` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:54.682715 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54793759-89f3-47f0-a44f-2e0060fedccc admin admin] RBAC: Authorizing `identity:delete_user(user_id=9bd1c880ca274662b55c85539301ff5e)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:56:54.686702 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54793759-89f3-47f0-a44f-2e0060fedccc admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:56:54.691861 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe8518a-9be0-4108-adf9-362a1a1ffcb2 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:56:54.697228 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd286ec-cc8f-4516-a22e-a9cbaf8d3c69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:56:54.698281 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd286ec-cc8f-4516-a22e-a9cbaf8d3c69 admin admin] REQUEST_METHOD: `PUT` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:54.698629 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd286ec-cc8f-4516-a22e-a9cbaf8d3c69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:54.699014 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd286ec-cc8f-4516-a22e-a9cbaf8d3c69 admin admin] PATH_INFO: `/v3/projects/918cff8cb5da4478868db2296de2dc32/users/2c2ec36d9bf1405e97d0ff2f800696f4/roles/f69dddf26daf4dd79d4c962beb877af5` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:54.701516 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd286ec-cc8f-4516-a22e-a9cbaf8d3c69 admin admin] RBAC: Authorizing `identity:create_grant(project_id=918cff8cb5da4478868db2296de2dc32, user_id=2c2ec36d9bf1405e97d0ff2f800696f4, role_id=f69dddf26daf4dd79d4c962beb877af5)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:56:54.702269 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:56:54.707846 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd286ec-cc8f-4516-a22e-a9cbaf8d3c69 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:56:54.727388 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 928/1876] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Oct 9 00:56:54 2022] PUT /identity/v3/projects/918cff8cb5da4478868db2296de2dc32/users/2c2ec36d9bf1405e97d0ff2f800696f4/roles/f69dddf26daf4dd79d4c962beb877af5 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 00:56:54.742742 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bb5f61-d61d-440f-92e9-1552e35575bc None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:54.743199 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bb5f61-d61d-440f-92e9-1552e35575bc None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:54.743539 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bb5f61-d61d-440f-92e9-1552e35575bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:54.812095 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-54793759-89f3-47f0-a44f-2e0060fedccc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9bd1c880ca274662b55c85539301ff5e'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:56:54.812670 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-e3bb5f61-d61d-440f-92e9-1552e35575bc None None] MFA Rules not processed for user `2c2ec36d9bf1405e97d0ff2f800696f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:56:54.813398 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-e3bb5f61-d61d-440f-92e9-1552e35575bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:56:54.829078 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-54793759-89f3-47f0-a44f-2e0060fedccc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9bd1c880ca274662b55c85539301ff5e'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:56:54.831444 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-54793759-89f3-47f0-a44f-2e0060fedccc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9bd1c880ca274662b55c85539301ff5e'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:56:54.833363 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-54793759-89f3-47f0-a44f-2e0060fedccc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9bd1c880ca274662b55c85539301ff5e'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:56:54.848129 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-54793759-89f3-47f0-a44f-2e0060fedccc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9bd1c880ca274662b55c85539301ff5e'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:56:54.905045 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 949/1877] 10.222.0.15 () {58 vars in 1224 bytes} [Sun Oct 9 00:56:54 2022] DELETE /identity/v3/users/9bd1c880ca274662b55c85539301ff5e => generated 0 bytes in 555 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 00:56:54.963772 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 929/1878] 10.222.0.15 () {58 vars in 958 bytes} [Sun Oct 9 00:56:54 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:56:54.975194 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54793759-89f3-47f0-a44f-2e0060fedccc admin admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:56:54.977150 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-54793759-89f3-47f0-a44f-2e0060fedccc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:56:55.123787 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54793759-89f3-47f0-a44f-2e0060fedccc admin admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:56:55.127612 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d46a6c9-9545-4956-8bd6-fbc3e51a7b45 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff7cb78bcd91467abe5c2e2b48aedd1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f148d39ced534860abfbe8fc3f98ace4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:56:55.128249 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d46a6c9-9545-4956-8bd6-fbc3e51a7b45 service cinder] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:55.128529 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d46a6c9-9545-4956-8bd6-fbc3e51a7b45 service cinder] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:55.128798 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d46a6c9-9545-4956-8bd6-fbc3e51a7b45 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:55.224453 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d46a6c9-9545-4956-8bd6-fbc3e51a7b45 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:56:55.229742 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d46a6c9-9545-4956-8bd6-fbc3e51a7b45 service cinder] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:56:55.240003 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 950/1879] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Oct 9 00:56:54 2022] GET /identity/v3/auth/tokens => generated 3353 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 09 00:56:55.476533 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bb5f61-d61d-440f-92e9-1552e35575bc None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:56:55.558810 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bb5f61-d61d-440f-92e9-1552e35575bc None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:56:55.563517 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c990b9-191c-4c7c-acfa-09986669682a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff7cb78bcd91467abe5c2e2b48aedd1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f148d39ced534860abfbe8fc3f98ace4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:56:55.564434 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c990b9-191c-4c7c-acfa-09986669682a service cinder] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:55.564717 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c990b9-191c-4c7c-acfa-09986669682a service cinder] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:55.564990 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c990b9-191c-4c7c-acfa-09986669682a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:55.567127 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-42c990b9-191c-4c7c-acfa-09986669682a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:56:55.652588 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c990b9-191c-4c7c-acfa-09986669682a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:56:55.654132 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c990b9-191c-4c7c-acfa-09986669682a service cinder] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:56:55.665748 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 930/1880] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Oct 9 00:56:55 2022] GET /identity/v3/auth/tokens => generated 3284 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 09 00:56:55.995627 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d46a6c9-9545-4956-8bd6-fbc3e51a7b45 service cinder] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:56:55.996084 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-4d46a6c9-9545-4956-8bd6-fbc3e51a7b45 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:56:56.081686 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:56:56.138853 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d46a6c9-9545-4956-8bd6-fbc3e51a7b45 service cinder] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:56:56.146069 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efb2c00-b546-4d31-a70a-5c0c455f940f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:56:56.146468 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efb2c00-b546-4d31-a70a-5c0c455f940f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:56.146647 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efb2c00-b546-4d31-a70a-5c0c455f940f admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:56.146964 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efb2c00-b546-4d31-a70a-5c0c455f940f admin admin] PATH_INFO: `/v3/projects/fc1a229ff10640c3af56350826a5de8a` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:56.148161 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efb2c00-b546-4d31-a70a-5c0c455f940f admin admin] RBAC: Authorizing `identity:delete_project(project_id=fc1a229ff10640c3af56350826a5de8a)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:56:56.150607 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efb2c00-b546-4d31-a70a-5c0c455f940f admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:56:56.223923 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-6efb2c00-b546-4d31-a70a-5c0c455f940f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc1a229ff10640c3af56350826a5de8a', 'request_id': 'req-6efb2c00-b546-4d31-a70a-5c0c455f940f'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:56:56.234416 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-6efb2c00-b546-4d31-a70a-5c0c455f940f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc1a229ff10640c3af56350826a5de8a', 'request_id': 'req-6efb2c00-b546-4d31-a70a-5c0c455f940f'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:56:56.245136 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-6efb2c00-b546-4d31-a70a-5c0c455f940f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc1a229ff10640c3af56350826a5de8a', 'request_id': 'req-6efb2c00-b546-4d31-a70a-5c0c455f940f'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:56:56.270836 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-6efb2c00-b546-4d31-a70a-5c0c455f940f admin admin] The token cache is being invalidate because project fc1a229ff10640c3af56350826a5de8a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81525) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 09 00:56:56.271121 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-6efb2c00-b546-4d31-a70a-5c0c455f940f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:56:56.272133 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-6efb2c00-b546-4d31-a70a-5c0c455f940f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:56:56.280563 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb02f3ea-c505-4554-88f2-215f34792969 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:56.280795 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 951/1881] 10.222.0.15 () {58 vars in 1233 bytes} [Sun Oct 9 00:56:55 2022] DELETE /identity/v3/projects/fc1a229ff10640c3af56350826a5de8a => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 00:56:56.281401 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb02f3ea-c505-4554-88f2-215f34792969 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:56.281685 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb02f3ea-c505-4554-88f2-215f34792969 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:56.305777 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-bb02f3ea-c505-4554-88f2-215f34792969 None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:56:56.307292 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-bb02f3ea-c505-4554-88f2-215f34792969 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:56:56.340472 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:56:56.391060 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 931/1882] 10.222.0.15 () {58 vars in 958 bytes} [Sun Oct 9 00:56:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:56:56.400300 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cee6d01-12cb-4870-a15f-c7e0ad58c83b None None] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:56.400605 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cee6d01-12cb-4870-a15f-c7e0ad58c83b None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:56.400973 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cee6d01-12cb-4870-a15f-c7e0ad58c83b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:56.424653 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.auth.core [None req-7cee6d01-12cb-4870-a15f-c7e0ad58c83b None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:56:56.425875 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-7cee6d01-12cb-4870-a15f-c7e0ad58c83b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:56:56.434664 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 952/1883] 10.222.0.15 () {58 vars in 958 bytes} [Sun Oct 9 00:56:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:56:56.439707 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb02f3ea-c505-4554-88f2-215f34792969 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:56:56.452021 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb02f3ea-c505-4554-88f2-215f34792969 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:56:56.458512 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56e0bbc-7b29-4339-90ff-729ca1575b95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:56:56.459214 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56e0bbc-7b29-4339-90ff-729ca1575b95 admin admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:56.459614 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56e0bbc-7b29-4339-90ff-729ca1575b95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:56.459898 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56e0bbc-7b29-4339-90ff-729ca1575b95 admin admin] PATH_INFO: `/v3/domains` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:56.460596 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56e0bbc-7b29-4339-90ff-729ca1575b95 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:56:56.460908 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56e0bbc-7b29-4339-90ff-729ca1575b95 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:56:56.462683 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56e0bbc-7b29-4339-90ff-729ca1575b95 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:56:56.481335 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 932/1884] 10.222.0.15 () {58 vars in 1153 bytes} [Sun Oct 9 00:56:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:56:56.482658 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cee6d01-12cb-4870-a15f-c7e0ad58c83b None None] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:56:56.492564 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cee6d01-12cb-4870-a15f-c7e0ad58c83b None None] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:56:56.497757 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbf946b-8938-492b-9566-3f7473b96eb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:56:56.498398 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbf946b-8938-492b-9566-3f7473b96eb3 admin admin] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:56.498674 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbf946b-8938-492b-9566-3f7473b96eb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:56.498936 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbf946b-8938-492b-9566-3f7473b96eb3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:56.499568 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbf946b-8938-492b-9566-3f7473b96eb3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:56:56.501506 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbf946b-8938-492b-9566-3f7473b96eb3 admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:56:56.546813 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 953/1885] 10.222.0.15 () {60 vars in 1153 bytes} [Sun Oct 9 00:56:56 2022] POST /identity/v3/projects => generated 381 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 09 00:56:56.548632 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56e0bbc-7b29-4339-90ff-729ca1575b95 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:56:56.559829 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56e0bbc-7b29-4339-90ff-729ca1575b95 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:56:56.657981 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a89d12f-9b95-498a-93dd-e876cd7765f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:56:56.658714 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a89d12f-9b95-498a-93dd-e876cd7765f7 admin admin] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:56.659024 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a89d12f-9b95-498a-93dd-e876cd7765f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:56.659220 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a89d12f-9b95-498a-93dd-e876cd7765f7 admin admin] PATH_INFO: `/v3/users` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:56.660036 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a89d12f-9b95-498a-93dd-e876cd7765f7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:56:56.663100 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a89d12f-9b95-498a-93dd-e876cd7765f7 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:56:56.697091 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 933/1886] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Oct 9 00:56:56 2022] POST /identity/v3/users => generated 291 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 09 00:56:56.701875 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbf946b-8938-492b-9566-3f7473b96eb3 admin admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:56:56.717595 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbf946b-8938-492b-9566-3f7473b96eb3 admin admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:56:56.741487 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf847e6-f63e-433b-b155-30a7667ef4b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:56:56.742201 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf847e6-f63e-433b-b155-30a7667ef4b5 admin admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:56.742535 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf847e6-f63e-433b-b155-30a7667ef4b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:56.742808 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf847e6-f63e-433b-b155-30a7667ef4b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:56.743633 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf847e6-f63e-433b-b155-30a7667ef4b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:56:56.745256 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf847e6-f63e-433b-b155-30a7667ef4b5 admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:56:56.769553 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 954/1887] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Oct 9 00:56:56 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 09 00:56:56.773034 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a89d12f-9b95-498a-93dd-e876cd7765f7 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:56:56.785422 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a89d12f-9b95-498a-93dd-e876cd7765f7 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:56:56.791529 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e5749f-d2f9-4c43-872c-d15fc07a8e50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:56:56.792505 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e5749f-d2f9-4c43-872c-d15fc07a8e50 admin admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:56.793012 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e5749f-d2f9-4c43-872c-d15fc07a8e50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:56.793479 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e5749f-d2f9-4c43-872c-d15fc07a8e50 admin admin] PATH_INFO: `/v3/roles` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:56.794349 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e5749f-d2f9-4c43-872c-d15fc07a8e50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:56:56.798205 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e5749f-d2f9-4c43-872c-d15fc07a8e50 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:56:56.817103 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 934/1888] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Oct 9 00:56:56 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 09 00:56:56.817821 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf847e6-f63e-433b-b155-30a7667ef4b5 admin admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:56:56.837061 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf847e6-f63e-433b-b155-30a7667ef4b5 admin admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:56:56.844395 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d68977-b24b-4c1e-9c61-87228824249e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:56:56.845444 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d68977-b24b-4c1e-9c61-87228824249e admin admin] REQUEST_METHOD: `PUT` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:56.845610 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d68977-b24b-4c1e-9c61-87228824249e admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:56.845850 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d68977-b24b-4c1e-9c61-87228824249e admin admin] PATH_INFO: `/v3/projects/bf680c59b27c480fbfa80a3b5dae900c/users/2ba8bff5fc554b7886ce7c80304ab10f/roles/afb0a01183d9497795eaa4fa1a4046ae` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:56.863145 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d68977-b24b-4c1e-9c61-87228824249e admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf680c59b27c480fbfa80a3b5dae900c, user_id=2ba8bff5fc554b7886ce7c80304ab10f, role_id=afb0a01183d9497795eaa4fa1a4046ae)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:56:56.865994 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d68977-b24b-4c1e-9c61-87228824249e admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:56:56.883304 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 955/1889] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Oct 9 00:56:56 2022] PUT /identity/v3/projects/bf680c59b27c480fbfa80a3b5dae900c/users/2ba8bff5fc554b7886ce7c80304ab10f/roles/afb0a01183d9497795eaa4fa1a4046ae => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 09 00:56:56.896858 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac4e911-d5c4-4da2-9b84-71ece7eef853 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:56.897112 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac4e911-d5c4-4da2-9b84-71ece7eef853 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:56.898027 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac4e911-d5c4-4da2-9b84-71ece7eef853 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:56.935134 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-8ac4e911-d5c4-4da2-9b84-71ece7eef853 None None] MFA Rules not processed for user `2ba8bff5fc554b7886ce7c80304ab10f`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:56:56.936535 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-8ac4e911-d5c4-4da2-9b84-71ece7eef853 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:56:57.034187 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 935/1890] 10.222.0.15 () {58 vars in 958 bytes} [Sun Oct 9 00:56:56 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:56:57.036522 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d68977-b24b-4c1e-9c61-87228824249e admin admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:56:57.181808 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d68977-b24b-4c1e-9c61-87228824249e admin admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:56:57.187661 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d97f804-e088-4396-a901-ff89aa57d2e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:56:57.188284 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d97f804-e088-4396-a901-ff89aa57d2e0 admin admin] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:57.188561 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d97f804-e088-4396-a901-ff89aa57d2e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:57.190506 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d97f804-e088-4396-a901-ff89aa57d2e0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:57.191371 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d97f804-e088-4396-a901-ff89aa57d2e0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:56:57.193877 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d97f804-e088-4396-a901-ff89aa57d2e0 admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:56:57.199896 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:56:57.233103 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 956/1891] 10.222.0.15 () {60 vars in 1153 bytes} [Sun Oct 9 00:56:57 2022] POST /identity/v3/projects => generated 381 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 09 00:56:57.238002 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac4e911-d5c4-4da2-9b84-71ece7eef853 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:56:57.251157 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac4e911-d5c4-4da2-9b84-71ece7eef853 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:56:57.270432 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:56:57.319624 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d0924a-73dc-4bc9-a4f8-269973a31038 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:56:57.320420 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d0924a-73dc-4bc9-a4f8-269973a31038 admin admin] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:57.320686 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d0924a-73dc-4bc9-a4f8-269973a31038 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:57.320955 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d0924a-73dc-4bc9-a4f8-269973a31038 admin admin] PATH_INFO: `/v3/users` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:57.321596 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d0924a-73dc-4bc9-a4f8-269973a31038 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:56:57.323813 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d0924a-73dc-4bc9-a4f8-269973a31038 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:56:57.374183 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 936/1892] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Oct 9 00:56:57 2022] POST /identity/v3/users => generated 297 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 09 00:56:57.378074 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d97f804-e088-4396-a901-ff89aa57d2e0 admin admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:56:57.407747 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d97f804-e088-4396-a901-ff89aa57d2e0 admin admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:56:57.415555 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae21b0b-bb46-4ab8-aa05-d0461879e766 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:56:57.416192 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae21b0b-bb46-4ab8-aa05-d0461879e766 admin admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:57.416470 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae21b0b-bb46-4ab8-aa05-d0461879e766 admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:57.416742 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae21b0b-bb46-4ab8-aa05-d0461879e766 admin admin] PATH_INFO: `/v3/roles` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:57.417401 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae21b0b-bb46-4ab8-aa05-d0461879e766 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:56:57.419043 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae21b0b-bb46-4ab8-aa05-d0461879e766 admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:56:57.430900 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 957/1893] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Oct 9 00:56:57 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 09 00:56:57.435319 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d0924a-73dc-4bc9-a4f8-269973a31038 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:56:57.447112 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d0924a-73dc-4bc9-a4f8-269973a31038 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:56:57.452279 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be956db6-ec23-449c-851c-028902a9d8e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:56:57.453014 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be956db6-ec23-449c-851c-028902a9d8e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:57.453300 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be956db6-ec23-449c-851c-028902a9d8e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:57.453595 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be956db6-ec23-449c-851c-028902a9d8e6 admin admin] PATH_INFO: `/v3/projects/30ae59d452784f44baa80c51054e6e59/users/70a5a0365c224ad7af746b3fd1616e86/roles/f69dddf26daf4dd79d4c962beb877af5` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:57.470646 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be956db6-ec23-449c-851c-028902a9d8e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=30ae59d452784f44baa80c51054e6e59, user_id=70a5a0365c224ad7af746b3fd1616e86, role_id=f69dddf26daf4dd79d4c962beb877af5)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:56:57.473511 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be956db6-ec23-449c-851c-028902a9d8e6 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:56:57.514757 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 937/1894] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Oct 9 00:56:57 2022] PUT /identity/v3/projects/30ae59d452784f44baa80c51054e6e59/users/70a5a0365c224ad7af746b3fd1616e86/roles/f69dddf26daf4dd79d4c962beb877af5 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 00:56:57.515150 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae21b0b-bb46-4ab8-aa05-d0461879e766 admin admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:56:57.528986 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae21b0b-bb46-4ab8-aa05-d0461879e766 admin admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:56:57.612520 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386a5b23-5c28-4b59-a316-9f2a7605f748 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:56:57.613152 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386a5b23-5c28-4b59-a316-9f2a7605f748 admin admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:57.613431 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386a5b23-5c28-4b59-a316-9f2a7605f748 admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:57.613706 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386a5b23-5c28-4b59-a316-9f2a7605f748 admin admin] PATH_INFO: `/v3/roles` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:57.614354 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386a5b23-5c28-4b59-a316-9f2a7605f748 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:56:57.616184 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386a5b23-5c28-4b59-a316-9f2a7605f748 admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:56:57.627250 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 958/1895] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Oct 9 00:56:57 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 09 00:56:57.631493 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be956db6-ec23-449c-851c-028902a9d8e6 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:56:57.643630 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be956db6-ec23-449c-851c-028902a9d8e6 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:56:57.648623 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f5e53b-c92a-4ce0-a8be-9721713ce3b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:56:57.649293 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f5e53b-c92a-4ce0-a8be-9721713ce3b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:57.649575 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f5e53b-c92a-4ce0-a8be-9721713ce3b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:57.649846 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f5e53b-c92a-4ce0-a8be-9721713ce3b1 admin admin] PATH_INFO: `/v3/projects/30ae59d452784f44baa80c51054e6e59/users/70a5a0365c224ad7af746b3fd1616e86/roles/f69dddf26daf4dd79d4c962beb877af5` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:57.651812 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f5e53b-c92a-4ce0-a8be-9721713ce3b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=30ae59d452784f44baa80c51054e6e59, user_id=70a5a0365c224ad7af746b3fd1616e86, role_id=f69dddf26daf4dd79d4c962beb877af5)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:56:57.654444 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f5e53b-c92a-4ce0-a8be-9721713ce3b1 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:56:57.665393 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 938/1896] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Oct 9 00:56:57 2022] PUT /identity/v3/projects/30ae59d452784f44baa80c51054e6e59/users/70a5a0365c224ad7af746b3fd1616e86/roles/f69dddf26daf4dd79d4c962beb877af5 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 00:56:57.675709 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac95de1-6758-4325-8f9d-219696ffc9a4 None None] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:57.675992 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac95de1-6758-4325-8f9d-219696ffc9a4 None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:57.676267 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac95de1-6758-4325-8f9d-219696ffc9a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:57.704966 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.auth.core [None req-0ac95de1-6758-4325-8f9d-219696ffc9a4 None None] MFA Rules not processed for user `70a5a0365c224ad7af746b3fd1616e86`. Rule list: `[]` (Enabled: `True`). {{(pid=81525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:56:57.706193 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-0ac95de1-6758-4325-8f9d-219696ffc9a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:56:57.840215 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 959/1897] 10.222.0.15 () {58 vars in 958 bytes} [Sun Oct 9 00:56:57 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 09 00:56:57.854719 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f5e53b-c92a-4ce0-a8be-9721713ce3b1 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:56:57.856576 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-c0f5e53b-c92a-4ce0-a8be-9721713ce3b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:56:57.961886 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f5e53b-c92a-4ce0-a8be-9721713ce3b1 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:56:57.965703 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82b486c-ecbb-4e8c-9739-fb9f0d810bd2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff7cb78bcd91467abe5c2e2b48aedd1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f148d39ced534860abfbe8fc3f98ace4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:56:57.966227 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82b486c-ecbb-4e8c-9739-fb9f0d810bd2 service cinder] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:57.966503 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82b486c-ecbb-4e8c-9739-fb9f0d810bd2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:57.966772 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82b486c-ecbb-4e8c-9739-fb9f0d810bd2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:57.976489 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82b486c-ecbb-4e8c-9739-fb9f0d810bd2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:56:57.978546 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82b486c-ecbb-4e8c-9739-fb9f0d810bd2 service cinder] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:56:57.988068 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 939/1898] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Oct 9 00:56:57 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 09 00:56:58.464464 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac95de1-6758-4325-8f9d-219696ffc9a4 None None] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:56:58.546151 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:56:58.557470 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac95de1-6758-4325-8f9d-219696ffc9a4 None None] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:56:58.566669 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8add9dd-1894-4922-9d75-607f4605c289 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:56:58.568309 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8add9dd-1894-4922-9d75-607f4605c289 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:58.568930 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8add9dd-1894-4922-9d75-607f4605c289 admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:58.569650 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8add9dd-1894-4922-9d75-607f4605c289 admin admin] PATH_INFO: `/v3/users/2ba8bff5fc554b7886ce7c80304ab10f` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:58.571736 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8add9dd-1894-4922-9d75-607f4605c289 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2ba8bff5fc554b7886ce7c80304ab10f)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:56:58.576931 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8add9dd-1894-4922-9d75-607f4605c289 admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:56:58.720340 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-c8add9dd-1894-4922-9d75-607f4605c289 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ba8bff5fc554b7886ce7c80304ab10f'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:56:58.766813 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-c8add9dd-1894-4922-9d75-607f4605c289 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ba8bff5fc554b7886ce7c80304ab10f'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:56:58.769684 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-c8add9dd-1894-4922-9d75-607f4605c289 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ba8bff5fc554b7886ce7c80304ab10f'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:56:58.774841 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-c8add9dd-1894-4922-9d75-607f4605c289 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ba8bff5fc554b7886ce7c80304ab10f'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:56:58.807497 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-c8add9dd-1894-4922-9d75-607f4605c289 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ba8bff5fc554b7886ce7c80304ab10f'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:56:58.851294 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 960/1899] 10.222.0.15 () {58 vars in 1224 bytes} [Sun Oct 9 00:56:58 2022] DELETE /identity/v3/users/2ba8bff5fc554b7886ce7c80304ab10f => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 00:56:58.856187 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a875f5-ddae-405c-bd99-c36fda1f9b1a None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:58.856749 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a875f5-ddae-405c-bd99-c36fda1f9b1a None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:58.856749 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a875f5-ddae-405c-bd99-c36fda1f9b1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:58.884171 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-00a875f5-ddae-405c-bd99-c36fda1f9b1a None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:56:58.898741 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-00a875f5-ddae-405c-bd99-c36fda1f9b1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:56:58.974449 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 940/1900] 10.222.0.15 () {58 vars in 958 bytes} [Sun Oct 9 00:56:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 09 00:56:58.986373 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8add9dd-1894-4922-9d75-607f4605c289 admin admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:56:58.988089 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-c8add9dd-1894-4922-9d75-607f4605c289 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:56:59.054659 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8add9dd-1894-4922-9d75-607f4605c289 admin admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:56:59.058379 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cf341d-7324-42b7-945f-3cd8ffd4428c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4ef90d456d2483e8ddafbe2d4d4fb5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f148d39ced534860abfbe8fc3f98ace4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:56:59.059013 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cf341d-7324-42b7-945f-3cd8ffd4428c service neutron] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:59.059420 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cf341d-7324-42b7-945f-3cd8ffd4428c service neutron] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:59.059696 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cf341d-7324-42b7-945f-3cd8ffd4428c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:59.070422 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cf341d-7324-42b7-945f-3cd8ffd4428c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:56:59.071984 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cf341d-7324-42b7-945f-3cd8ffd4428c service neutron] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:56:59.083445 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 961/1901] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Oct 9 00:56:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 09 00:56:59.468577 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a875f5-ddae-405c-bd99-c36fda1f9b1a None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:56:59.469954 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-00a875f5-ddae-405c-bd99-c36fda1f9b1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:56:59.491649 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a875f5-ddae-405c-bd99-c36fda1f9b1a None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:56:59.508662 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb36ec3-01e9-40e5-9eeb-85b31dba6e61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:56:59.509362 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb36ec3-01e9-40e5-9eeb-85b31dba6e61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:59.509604 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb36ec3-01e9-40e5-9eeb-85b31dba6e61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:59.509877 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb36ec3-01e9-40e5-9eeb-85b31dba6e61 admin admin] PATH_INFO: `/v3/projects/bf680c59b27c480fbfa80a3b5dae900c` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:59.511065 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb36ec3-01e9-40e5-9eeb-85b31dba6e61 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bf680c59b27c480fbfa80a3b5dae900c)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:56:59.514417 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb36ec3-01e9-40e5-9eeb-85b31dba6e61 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:56:59.538971 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:56:59.613792 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-fdb36ec3-01e9-40e5-9eeb-85b31dba6e61 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf680c59b27c480fbfa80a3b5dae900c', 'request_id': 'req-fdb36ec3-01e9-40e5-9eeb-85b31dba6e61'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:56:59.626760 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-fdb36ec3-01e9-40e5-9eeb-85b31dba6e61 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf680c59b27c480fbfa80a3b5dae900c', 'request_id': 'req-fdb36ec3-01e9-40e5-9eeb-85b31dba6e61'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:56:59.637663 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-fdb36ec3-01e9-40e5-9eeb-85b31dba6e61 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf680c59b27c480fbfa80a3b5dae900c', 'request_id': 'req-fdb36ec3-01e9-40e5-9eeb-85b31dba6e61'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:56:59.650561 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-fdb36ec3-01e9-40e5-9eeb-85b31dba6e61 admin admin] The token cache is being invalidate because project bf680c59b27c480fbfa80a3b5dae900c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81524) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 09 00:56:59.651077 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-fdb36ec3-01e9-40e5-9eeb-85b31dba6e61 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:56:59.652000 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-fdb36ec3-01e9-40e5-9eeb-85b31dba6e61 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:56:59.659543 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 941/1902] 10.222.0.15 () {58 vars in 1233 bytes} [Sun Oct 9 00:56:59 2022] DELETE /identity/v3/projects/bf680c59b27c480fbfa80a3b5dae900c => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 00:56:59.660680 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cf341d-7324-42b7-945f-3cd8ffd4428c service neutron] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:56:59.677610 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cf341d-7324-42b7-945f-3cd8ffd4428c service neutron] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:56:59.798968 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb205b2-ee5f-4b63-97fb-a810bbbf2fdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:56:59.799667 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb205b2-ee5f-4b63-97fb-a810bbbf2fdf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:56:59.799942 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb205b2-ee5f-4b63-97fb-a810bbbf2fdf admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:56:59.800213 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb205b2-ee5f-4b63-97fb-a810bbbf2fdf admin admin] PATH_INFO: `/v3/users/70a5a0365c224ad7af746b3fd1616e86` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:56:59.801350 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb205b2-ee5f-4b63-97fb-a810bbbf2fdf admin admin] RBAC: Authorizing `identity:delete_user(user_id=70a5a0365c224ad7af746b3fd1616e86)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:56:59.803414 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb205b2-ee5f-4b63-97fb-a810bbbf2fdf admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:56:59.832132 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:56:59.860315 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-ceb205b2-ee5f-4b63-97fb-a810bbbf2fdf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '70a5a0365c224ad7af746b3fd1616e86'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:56:59.867859 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-ceb205b2-ee5f-4b63-97fb-a810bbbf2fdf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '70a5a0365c224ad7af746b3fd1616e86'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:56:59.868642 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-ceb205b2-ee5f-4b63-97fb-a810bbbf2fdf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '70a5a0365c224ad7af746b3fd1616e86'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:56:59.869256 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-ceb205b2-ee5f-4b63-97fb-a810bbbf2fdf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '70a5a0365c224ad7af746b3fd1616e86'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:56:59.879955 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-ceb205b2-ee5f-4b63-97fb-a810bbbf2fdf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '70a5a0365c224ad7af746b3fd1616e86'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:56:59.901637 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 962/1903] 10.222.0.15 () {58 vars in 1224 bytes} [Sun Oct 9 00:56:59 2022] DELETE /identity/v3/users/70a5a0365c224ad7af746b3fd1616e86 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 00:57:00.230455 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb36ec3-01e9-40e5-9eeb-85b31dba6e61 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:57:00.232033 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-fdb36ec3-01e9-40e5-9eeb-85b31dba6e61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:57:00.257950 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb36ec3-01e9-40e5-9eeb-85b31dba6e61 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:57:00.339739 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b581512-b54d-40cb-a68b-0258b099f7ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:57:00.340378 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b581512-b54d-40cb-a68b-0258b099f7ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:57:00.340766 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b581512-b54d-40cb-a68b-0258b099f7ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:57:00.341018 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b581512-b54d-40cb-a68b-0258b099f7ec admin admin] PATH_INFO: `/v3/projects/30ae59d452784f44baa80c51054e6e59` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:57:00.342676 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b581512-b54d-40cb-a68b-0258b099f7ec admin admin] RBAC: Authorizing `identity:delete_project(project_id=30ae59d452784f44baa80c51054e6e59)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:57:00.344630 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b581512-b54d-40cb-a68b-0258b099f7ec admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:57:00.409267 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-5b581512-b54d-40cb-a68b-0258b099f7ec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '30ae59d452784f44baa80c51054e6e59', 'request_id': 'req-5b581512-b54d-40cb-a68b-0258b099f7ec'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:57:00.419762 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-5b581512-b54d-40cb-a68b-0258b099f7ec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '30ae59d452784f44baa80c51054e6e59', 'request_id': 'req-5b581512-b54d-40cb-a68b-0258b099f7ec'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:57:00.428730 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-5b581512-b54d-40cb-a68b-0258b099f7ec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '30ae59d452784f44baa80c51054e6e59', 'request_id': 'req-5b581512-b54d-40cb-a68b-0258b099f7ec'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:57:00.439420 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-5b581512-b54d-40cb-a68b-0258b099f7ec admin admin] The token cache is being invalidate because project 30ae59d452784f44baa80c51054e6e59 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81524) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 09 00:57:00.439702 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-5b581512-b54d-40cb-a68b-0258b099f7ec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:57:00.440352 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-5b581512-b54d-40cb-a68b-0258b099f7ec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:57:00.441865 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 942/1904] 10.222.0.15 () {58 vars in 1233 bytes} [Sun Oct 9 00:57:00 2022] DELETE /identity/v3/projects/30ae59d452784f44baa80c51054e6e59 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 00:57:00.448909 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8e3acf-5444-4e9b-a11c-3be9e38e6d09 None None] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:57:00.449183 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8e3acf-5444-4e9b-a11c-3be9e38e6d09 None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:57:00.449455 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8e3acf-5444-4e9b-a11c-3be9e38e6d09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:57:00.470507 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.auth.core [None req-da8e3acf-5444-4e9b-a11c-3be9e38e6d09 None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:57:00.471785 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-da8e3acf-5444-4e9b-a11c-3be9e38e6d09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:57:00.542090 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 963/1905] 10.222.0.15 () {58 vars in 958 bytes} [Sun Oct 9 00:57:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:57:00.550136 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ca0960-61bb-4492-9706-d9a8b1360e2e None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:57:00.550632 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ca0960-61bb-4492-9706-d9a8b1360e2e None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:57:00.550961 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ca0960-61bb-4492-9706-d9a8b1360e2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:57:00.572937 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-93ca0960-61bb-4492-9706-d9a8b1360e2e None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:57:00.574135 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-93ca0960-61bb-4492-9706-d9a8b1360e2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:57:00.587030 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 943/1906] 10.222.0.15 () {58 vars in 958 bytes} [Sun Oct 9 00:57:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:57:00.588417 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8e3acf-5444-4e9b-a11c-3be9e38e6d09 None None] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:57:00.599842 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8e3acf-5444-4e9b-a11c-3be9e38e6d09 None None] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:57:00.605406 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee395ac6-85aa-483e-adac-5138e0d81b68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:57:00.606147 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee395ac6-85aa-483e-adac-5138e0d81b68 admin admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:57:00.606423 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee395ac6-85aa-483e-adac-5138e0d81b68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:57:00.606715 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee395ac6-85aa-483e-adac-5138e0d81b68 admin admin] PATH_INFO: `/v3/domains` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:57:00.607438 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee395ac6-85aa-483e-adac-5138e0d81b68 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:57:00.607752 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee395ac6-85aa-483e-adac-5138e0d81b68 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:57:00.609362 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee395ac6-85aa-483e-adac-5138e0d81b68 admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:57:00.622837 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 964/1907] 10.222.0.15 () {58 vars in 1153 bytes} [Sun Oct 9 00:57:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:57:00.628468 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ca0960-61bb-4492-9706-d9a8b1360e2e None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:57:00.638192 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ca0960-61bb-4492-9706-d9a8b1360e2e None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:57:00.643165 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1121155-1001-41cc-ab06-303a486e96c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:57:00.643799 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1121155-1001-41cc-ab06-303a486e96c8 admin admin] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:57:00.644073 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1121155-1001-41cc-ab06-303a486e96c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:57:00.644342 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1121155-1001-41cc-ab06-303a486e96c8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:57:00.645055 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1121155-1001-41cc-ab06-303a486e96c8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:57:00.647193 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1121155-1001-41cc-ab06-303a486e96c8 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:57:00.671011 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:57:00.681482 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 944/1908] 10.222.0.15 () {60 vars in 1153 bytes} [Sun Oct 9 00:57:00 2022] POST /identity/v3/projects => generated 377 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 09 00:57:00.686510 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee395ac6-85aa-483e-adac-5138e0d81b68 admin admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:57:00.699807 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee395ac6-85aa-483e-adac-5138e0d81b68 admin admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:57:00.775575 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b808691-c5a0-4946-805d-33e05cbaa47d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:57:00.776718 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b808691-c5a0-4946-805d-33e05cbaa47d admin admin] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:57:00.777170 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b808691-c5a0-4946-805d-33e05cbaa47d admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:57:00.777678 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b808691-c5a0-4946-805d-33e05cbaa47d admin admin] PATH_INFO: `/v3/users` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:57:00.778705 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b808691-c5a0-4946-805d-33e05cbaa47d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:57:00.782259 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b808691-c5a0-4946-805d-33e05cbaa47d admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:57:00.819320 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 965/1909] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Oct 9 00:57:00 2022] POST /identity/v3/users => generated 289 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 09 00:57:00.822058 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1121155-1001-41cc-ab06-303a486e96c8 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:57:00.839572 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1121155-1001-41cc-ab06-303a486e96c8 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:57:00.847163 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc71b29-f9df-4682-84b7-73aacc29ca63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:57:00.847957 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc71b29-f9df-4682-84b7-73aacc29ca63 admin admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:57:00.848290 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc71b29-f9df-4682-84b7-73aacc29ca63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:57:00.848610 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc71b29-f9df-4682-84b7-73aacc29ca63 admin admin] PATH_INFO: `/v3/roles` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:57:00.849180 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc71b29-f9df-4682-84b7-73aacc29ca63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:57:00.851098 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc71b29-f9df-4682-84b7-73aacc29ca63 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:57:00.866206 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 945/1910] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Oct 9 00:57:00 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 09 00:57:00.871548 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b808691-c5a0-4946-805d-33e05cbaa47d admin admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:57:00.883841 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b808691-c5a0-4946-805d-33e05cbaa47d admin admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:57:00.889894 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a7b3aa-74ae-49a5-9aca-4fe60ee6ead4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:57:00.891832 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a7b3aa-74ae-49a5-9aca-4fe60ee6ead4 admin admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:57:00.892189 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a7b3aa-74ae-49a5-9aca-4fe60ee6ead4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:57:00.892571 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a7b3aa-74ae-49a5-9aca-4fe60ee6ead4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:57:00.894003 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a7b3aa-74ae-49a5-9aca-4fe60ee6ead4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:57:00.894971 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a7b3aa-74ae-49a5-9aca-4fe60ee6ead4 admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:57:00.912017 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 966/1911] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Oct 9 00:57:00 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 09 00:57:00.913123 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc71b29-f9df-4682-84b7-73aacc29ca63 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:57:00.924105 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc71b29-f9df-4682-84b7-73aacc29ca63 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:57:00.928768 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86a6a91-f40e-47c2-a53b-dcfd8b4f5da9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:57:00.929441 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86a6a91-f40e-47c2-a53b-dcfd8b4f5da9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:57:00.929721 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86a6a91-f40e-47c2-a53b-dcfd8b4f5da9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:57:00.929991 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86a6a91-f40e-47c2-a53b-dcfd8b4f5da9 admin admin] PATH_INFO: `/v3/projects/5ded855df9a6470ba68d00680adf088f/users/8b2109071d6d412ea9ff3f8e4289634f/roles/afb0a01183d9497795eaa4fa1a4046ae` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:57:00.945893 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86a6a91-f40e-47c2-a53b-dcfd8b4f5da9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ded855df9a6470ba68d00680adf088f, user_id=8b2109071d6d412ea9ff3f8e4289634f, role_id=afb0a01183d9497795eaa4fa1a4046ae)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:57:00.949230 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86a6a91-f40e-47c2-a53b-dcfd8b4f5da9 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:57:00.963588 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 946/1912] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Oct 9 00:57:00 2022] PUT /identity/v3/projects/5ded855df9a6470ba68d00680adf088f/users/8b2109071d6d412ea9ff3f8e4289634f/roles/afb0a01183d9497795eaa4fa1a4046ae => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 00:57:00.974365 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09384674-97d3-413d-b41d-4408a6a98804 None None] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:57:00.974899 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09384674-97d3-413d-b41d-4408a6a98804 None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:57:00.975293 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09384674-97d3-413d-b41d-4408a6a98804 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:57:00.985821 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:DELETE=8,keystone:SELECT=88,keystone:INSERT=4 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:57:01.017251 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.auth.core [None req-09384674-97d3-413d-b41d-4408a6a98804 None None] MFA Rules not processed for user `8b2109071d6d412ea9ff3f8e4289634f`. Rule list: `[]` (Enabled: `True`). {{(pid=81525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:57:01.018490 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-09384674-97d3-413d-b41d-4408a6a98804 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:57:01.095947 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 967/1913] 10.222.0.15 () {58 vars in 958 bytes} [Sun Oct 9 00:57:00 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:57:01.101055 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86a6a91-f40e-47c2-a53b-dcfd8b4f5da9 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:57:01.174177 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86a6a91-f40e-47c2-a53b-dcfd8b4f5da9 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:57:01.179598 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88364ac7-973b-409b-8654-10b343c9ea63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:57:01.180198 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88364ac7-973b-409b-8654-10b343c9ea63 admin admin] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:57:01.180471 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88364ac7-973b-409b-8654-10b343c9ea63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:57:01.180738 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88364ac7-973b-409b-8654-10b343c9ea63 admin admin] PATH_INFO: `/v3/projects` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:57:01.181368 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88364ac7-973b-409b-8654-10b343c9ea63 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:57:01.183981 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88364ac7-973b-409b-8654-10b343c9ea63 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:57:01.220593 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 947/1914] 10.222.0.15 () {60 vars in 1153 bytes} [Sun Oct 9 00:57:01 2022] POST /identity/v3/projects => generated 375 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 09 00:57:01.225291 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09384674-97d3-413d-b41d-4408a6a98804 None None] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:57:01.237104 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09384674-97d3-413d-b41d-4408a6a98804 None None] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:57:01.309121 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5581ca84-fc6f-433d-9beb-8b1ec3713d64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:57:01.309872 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5581ca84-fc6f-433d-9beb-8b1ec3713d64 admin admin] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:57:01.310221 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5581ca84-fc6f-433d-9beb-8b1ec3713d64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:57:01.310559 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5581ca84-fc6f-433d-9beb-8b1ec3713d64 admin admin] PATH_INFO: `/v3/users` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:57:01.311281 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5581ca84-fc6f-433d-9beb-8b1ec3713d64 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:57:01.313278 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5581ca84-fc6f-433d-9beb-8b1ec3713d64 admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:57:01.338909 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 968/1915] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Oct 9 00:57:01 2022] POST /identity/v3/users => generated 288 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 09 00:57:01.342728 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88364ac7-973b-409b-8654-10b343c9ea63 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:57:01.354073 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88364ac7-973b-409b-8654-10b343c9ea63 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:57:01.359582 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb82981-670a-4960-a5a1-991578e254cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:57:01.360282 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb82981-670a-4960-a5a1-991578e254cf admin admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:57:01.360606 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb82981-670a-4960-a5a1-991578e254cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:57:01.360879 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb82981-670a-4960-a5a1-991578e254cf admin admin] PATH_INFO: `/v3/roles` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:57:01.361534 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb82981-670a-4960-a5a1-991578e254cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:57:01.363138 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb82981-670a-4960-a5a1-991578e254cf admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:57:01.378152 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 948/1916] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Oct 9 00:57:01 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 09 00:57:01.380030 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5581ca84-fc6f-433d-9beb-8b1ec3713d64 admin admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:57:01.390646 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5581ca84-fc6f-433d-9beb-8b1ec3713d64 admin admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:57:01.396885 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374038a5-1387-4623-b7f9-6fc11cf71742 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:57:01.398315 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374038a5-1387-4623-b7f9-6fc11cf71742 admin admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:57:01.398315 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374038a5-1387-4623-b7f9-6fc11cf71742 admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:57:01.402886 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374038a5-1387-4623-b7f9-6fc11cf71742 admin admin] PATH_INFO: `/v3/roles` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:57:01.403670 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374038a5-1387-4623-b7f9-6fc11cf71742 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:57:01.405310 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374038a5-1387-4623-b7f9-6fc11cf71742 admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:57:01.433070 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 969/1917] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Oct 9 00:57:01 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 09 00:57:01.449103 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb82981-670a-4960-a5a1-991578e254cf admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:57:01.461013 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb82981-670a-4960-a5a1-991578e254cf admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:57:01.467387 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d20753d-b536-4a56-b1a9-9740c98de2de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:57:01.468082 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d20753d-b536-4a56-b1a9-9740c98de2de admin admin] REQUEST_METHOD: `PUT` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:57:01.468735 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d20753d-b536-4a56-b1a9-9740c98de2de admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:57:01.468735 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d20753d-b536-4a56-b1a9-9740c98de2de admin admin] PATH_INFO: `/v3/projects/51c10334a89f4f3fb754cc89ecc9af25/users/40cfec8f068e43b0b1dd625b844689c5/roles/afb0a01183d9497795eaa4fa1a4046ae` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:57:01.487736 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d20753d-b536-4a56-b1a9-9740c98de2de admin admin] RBAC: Authorizing `identity:create_grant(project_id=51c10334a89f4f3fb754cc89ecc9af25, user_id=40cfec8f068e43b0b1dd625b844689c5, role_id=afb0a01183d9497795eaa4fa1a4046ae)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:57:01.490619 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d20753d-b536-4a56-b1a9-9740c98de2de admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:57:01.507295 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 949/1918] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Oct 9 00:57:01 2022] PUT /identity/v3/projects/51c10334a89f4f3fb754cc89ecc9af25/users/40cfec8f068e43b0b1dd625b844689c5/roles/afb0a01183d9497795eaa4fa1a4046ae => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 09 00:57:01.519064 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b85f89-ff02-4a63-90f3-a185b03be6c8 None None] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:57:01.519548 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b85f89-ff02-4a63-90f3-a185b03be6c8 None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:57:01.519801 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b85f89-ff02-4a63-90f3-a185b03be6c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:57:01.553306 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.auth.core [None req-65b85f89-ff02-4a63-90f3-a185b03be6c8 None None] MFA Rules not processed for user `40cfec8f068e43b0b1dd625b844689c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:57:01.554620 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-65b85f89-ff02-4a63-90f3-a185b03be6c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:57:01.608065 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d20753d-b536-4a56-b1a9-9740c98de2de admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:57:01.609857 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-8d20753d-b536-4a56-b1a9-9740c98de2de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:57:01.649519 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:57:01.655229 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 970/1919] 10.222.0.15 () {58 vars in 958 bytes} [Sun Oct 9 00:57:01 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:57:01.660736 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b85f89-ff02-4a63-90f3-a185b03be6c8 None None] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:57:01.700736 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d20753d-b536-4a56-b1a9-9740c98de2de admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:57:01.706534 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3a54fe-3700-4bd8-9f8e-ac4608e992d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:57:01.707680 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3a54fe-3700-4bd8-9f8e-ac4608e992d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:57:01.707948 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3a54fe-3700-4bd8-9f8e-ac4608e992d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:57:01.708223 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3a54fe-3700-4bd8-9f8e-ac4608e992d3 admin admin] PATH_INFO: `/v3/users/6be9a10fc19e4852bf329c872b25f2bc` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:57:01.709481 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3a54fe-3700-4bd8-9f8e-ac4608e992d3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6be9a10fc19e4852bf329c872b25f2bc)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:57:01.711453 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3a54fe-3700-4bd8-9f8e-ac4608e992d3 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:57:01.727708 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:57:01.738273 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b85f89-ff02-4a63-90f3-a185b03be6c8 None None] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:57:01.744130 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9053dbd8-2b56-4070-b25c-6737989f89df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:57:01.744779 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9053dbd8-2b56-4070-b25c-6737989f89df admin admin] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:57:01.745091 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9053dbd8-2b56-4070-b25c-6737989f89df admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:57:01.745403 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9053dbd8-2b56-4070-b25c-6737989f89df admin admin] PATH_INFO: `/v3/projects` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:57:01.746204 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9053dbd8-2b56-4070-b25c-6737989f89df admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:57:01.748880 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9053dbd8-2b56-4070-b25c-6737989f89df admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:57:01.768925 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-6a3a54fe-3700-4bd8-9f8e-ac4608e992d3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6be9a10fc19e4852bf329c872b25f2bc'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:57:01.783936 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-6a3a54fe-3700-4bd8-9f8e-ac4608e992d3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6be9a10fc19e4852bf329c872b25f2bc'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:57:01.784850 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-6a3a54fe-3700-4bd8-9f8e-ac4608e992d3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6be9a10fc19e4852bf329c872b25f2bc'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:57:01.787868 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-6a3a54fe-3700-4bd8-9f8e-ac4608e992d3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6be9a10fc19e4852bf329c872b25f2bc'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:57:01.796187 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 971/1920] 10.222.0.15 () {60 vars in 1153 bytes} [Sun Oct 9 00:57:01 2022] POST /identity/v3/projects => generated 377 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 09 00:57:01.800616 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9053dbd8-2b56-4070-b25c-6737989f89df admin admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:57:01.801705 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-6a3a54fe-3700-4bd8-9f8e-ac4608e992d3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6be9a10fc19e4852bf329c872b25f2bc'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:57:01.803252 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-9053dbd8-2b56-4070-b25c-6737989f89df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:57:01.845174 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 950/1921] 10.222.0.15 () {58 vars in 1224 bytes} [Sun Oct 9 00:57:01 2022] DELETE /identity/v3/users/6be9a10fc19e4852bf329c872b25f2bc => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 09 00:57:01.850163 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e36669e-a7d5-429e-bdb6-8bc9ecf7f55a None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:57:01.850587 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e36669e-a7d5-429e-bdb6-8bc9ecf7f55a None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:57:01.850987 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e36669e-a7d5-429e-bdb6-8bc9ecf7f55a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:57:01.875776 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-7e36669e-a7d5-429e-bdb6-8bc9ecf7f55a None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:57:01.877196 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-7e36669e-a7d5-429e-bdb6-8bc9ecf7f55a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:57:01.934096 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9053dbd8-2b56-4070-b25c-6737989f89df admin admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:57:01.955568 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 951/1922] 10.222.0.15 () {58 vars in 958 bytes} [Sun Oct 9 00:57:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:57:01.968303 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e36669e-a7d5-429e-bdb6-8bc9ecf7f55a None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:57:01.969770 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-7e36669e-a7d5-429e-bdb6-8bc9ecf7f55a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:57:02.007751 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5761edd-2fa3-4bd0-876d-f594ef1ad25a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:57:02.008785 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5761edd-2fa3-4bd0-876d-f594ef1ad25a admin admin] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:57:02.009066 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5761edd-2fa3-4bd0-876d-f594ef1ad25a admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:57:02.009337 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5761edd-2fa3-4bd0-876d-f594ef1ad25a admin admin] PATH_INFO: `/v3/users` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:57:02.010553 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5761edd-2fa3-4bd0-876d-f594ef1ad25a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:57:02.013278 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5761edd-2fa3-4bd0-876d-f594ef1ad25a admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:57:02.038708 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 972/1923] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Oct 9 00:57:01 2022] POST /identity/v3/users => generated 295 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 09 00:57:02.040423 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e36669e-a7d5-429e-bdb6-8bc9ecf7f55a None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:57:02.042716 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5761edd-2fa3-4bd0-876d-f594ef1ad25a admin admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:57:02.045711 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dda480c-2630-43e5-8883-c2926686f4d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4ef90d456d2483e8ddafbe2d4d4fb5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f148d39ced534860abfbe8fc3f98ace4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:57:02.046337 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dda480c-2630-43e5-8883-c2926686f4d2 service neutron] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:57:02.046612 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dda480c-2630-43e5-8883-c2926686f4d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:57:02.046883 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dda480c-2630-43e5-8883-c2926686f4d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:57:02.062759 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dda480c-2630-43e5-8883-c2926686f4d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:57:02.065125 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dda480c-2630-43e5-8883-c2926686f4d2 service neutron] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:57:02.067930 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5761edd-2fa3-4bd0-876d-f594ef1ad25a admin admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:57:02.075447 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582ab929-fa22-4d68-afc2-74fd257c9820 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:57:02.076636 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582ab929-fa22-4d68-afc2-74fd257c9820 admin admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:57:02.077188 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582ab929-fa22-4d68-afc2-74fd257c9820 admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:57:02.077745 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 952/1924] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Oct 9 00:57:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 09 00:57:02.083661 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582ab929-fa22-4d68-afc2-74fd257c9820 admin admin] PATH_INFO: `/v3/roles` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:57:02.084511 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582ab929-fa22-4d68-afc2-74fd257c9820 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:57:02.086190 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582ab929-fa22-4d68-afc2-74fd257c9820 admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:57:02.113515 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 973/1925] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Oct 9 00:57:02 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 09 00:57:02.118127 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dda480c-2630-43e5-8883-c2926686f4d2 service neutron] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:57:02.129323 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dda480c-2630-43e5-8883-c2926686f4d2 service neutron] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:57:02.137241 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d849bc4c-24ef-4eed-b969-3fe8127bd7ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:57:02.138009 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d849bc4c-24ef-4eed-b969-3fe8127bd7ac admin admin] REQUEST_METHOD: `PUT` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:57:02.138356 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d849bc4c-24ef-4eed-b969-3fe8127bd7ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:57:02.138803 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d849bc4c-24ef-4eed-b969-3fe8127bd7ac admin admin] PATH_INFO: `/v3/projects/35200ad5507d48999bb11aafaa5bfcef/users/ecca31cf77d7485ba734e58f15fbd292/roles/f69dddf26daf4dd79d4c962beb877af5` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:57:02.160632 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d849bc4c-24ef-4eed-b969-3fe8127bd7ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=35200ad5507d48999bb11aafaa5bfcef, user_id=ecca31cf77d7485ba734e58f15fbd292, role_id=f69dddf26daf4dd79d4c962beb877af5)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:57:02.163819 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d849bc4c-24ef-4eed-b969-3fe8127bd7ac admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:57:02.187473 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 953/1926] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Oct 9 00:57:02 2022] PUT /identity/v3/projects/35200ad5507d48999bb11aafaa5bfcef/users/ecca31cf77d7485ba734e58f15fbd292/roles/f69dddf26daf4dd79d4c962beb877af5 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 00:57:02.189798 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582ab929-fa22-4d68-afc2-74fd257c9820 admin admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:57:02.204243 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582ab929-fa22-4d68-afc2-74fd257c9820 admin admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:57:02.214186 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:57:02.280439 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccc1fbc-06d6-42c0-9b1e-11bdd289b503 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:57:02.280628 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccc1fbc-06d6-42c0-9b1e-11bdd289b503 admin admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:57:02.280987 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccc1fbc-06d6-42c0-9b1e-11bdd289b503 admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:57:02.281323 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccc1fbc-06d6-42c0-9b1e-11bdd289b503 admin admin] PATH_INFO: `/v3/roles` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:57:02.282703 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccc1fbc-06d6-42c0-9b1e-11bdd289b503 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:57:02.285078 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccc1fbc-06d6-42c0-9b1e-11bdd289b503 admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:57:02.300487 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 974/1927] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Oct 9 00:57:02 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 09 00:57:02.306061 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d849bc4c-24ef-4eed-b969-3fe8127bd7ac admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:57:02.317256 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d849bc4c-24ef-4eed-b969-3fe8127bd7ac admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:57:02.322530 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43b7290-a844-451d-a122-67a4c3e058c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:57:02.323216 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43b7290-a844-451d-a122-67a4c3e058c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:57:02.323533 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43b7290-a844-451d-a122-67a4c3e058c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:57:02.323840 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43b7290-a844-451d-a122-67a4c3e058c8 admin admin] PATH_INFO: `/v3/projects/35200ad5507d48999bb11aafaa5bfcef/users/ecca31cf77d7485ba734e58f15fbd292/roles/f69dddf26daf4dd79d4c962beb877af5` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:57:02.326256 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43b7290-a844-451d-a122-67a4c3e058c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=35200ad5507d48999bb11aafaa5bfcef, user_id=ecca31cf77d7485ba734e58f15fbd292, role_id=f69dddf26daf4dd79d4c962beb877af5)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:57:02.328712 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43b7290-a844-451d-a122-67a4c3e058c8 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:57:02.335425 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=88,keystone:DELETE=9,keystone:INSERT=3 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:57:02.342509 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 954/1928] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Oct 9 00:57:02 2022] PUT /identity/v3/projects/35200ad5507d48999bb11aafaa5bfcef/users/ecca31cf77d7485ba734e58f15fbd292/roles/f69dddf26daf4dd79d4c962beb877af5 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 00:57:02.353087 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b967f942-731e-48de-9a0e-f0618c7f00d4 None None] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:57:02.353448 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b967f942-731e-48de-9a0e-f0618c7f00d4 None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:57:02.353823 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b967f942-731e-48de-9a0e-f0618c7f00d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:57:02.449260 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.auth.core [None req-b967f942-731e-48de-9a0e-f0618c7f00d4 None None] MFA Rules not processed for user `ecca31cf77d7485ba734e58f15fbd292`. Rule list: `[]` (Enabled: `True`). {{(pid=81525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:57:02.451379 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-b967f942-731e-48de-9a0e-f0618c7f00d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:57:02.559619 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 975/1929] 10.222.0.15 () {58 vars in 958 bytes} [Sun Oct 9 00:57:02 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:57:02.572004 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43b7290-a844-451d-a122-67a4c3e058c8 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:57:02.574371 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-f43b7290-a844-451d-a122-67a4c3e058c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:57:02.656740 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43b7290-a844-451d-a122-67a4c3e058c8 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:57:02.662615 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30899124-6925-48be-bea4-21ce26f96099 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff7cb78bcd91467abe5c2e2b48aedd1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f148d39ced534860abfbe8fc3f98ace4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:57:02.663390 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30899124-6925-48be-bea4-21ce26f96099 service cinder] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:57:02.665775 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30899124-6925-48be-bea4-21ce26f96099 service cinder] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:57:02.665775 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30899124-6925-48be-bea4-21ce26f96099 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:57:02.668382 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-30899124-6925-48be-bea4-21ce26f96099 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:57:02.768852 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30899124-6925-48be-bea4-21ce26f96099 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:57:02.770913 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30899124-6925-48be-bea4-21ce26f96099 service cinder] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:57:02.791488 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 955/1930] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Oct 9 00:57:02 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 09 00:57:03.008460 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b967f942-731e-48de-9a0e-f0618c7f00d4 None None] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:57:03.012477 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-b967f942-731e-48de-9a0e-f0618c7f00d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:57:03.186046 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30899124-6925-48be-bea4-21ce26f96099 service cinder] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:57:03.187468 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b967f942-731e-48de-9a0e-f0618c7f00d4 None None] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:57:03.187695 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-30899124-6925-48be-bea4-21ce26f96099 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:57:03.197245 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f83277-a736-424d-bb2c-e6164359cdba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:57:03.197986 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f83277-a736-424d-bb2c-e6164359cdba admin admin] REQUEST_METHOD: `DELETE` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:57:03.198328 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f83277-a736-424d-bb2c-e6164359cdba admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:57:03.198682 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f83277-a736-424d-bb2c-e6164359cdba admin admin] PATH_INFO: `/v3/projects/6d75923e5a084708b4b8370cb7e5eea0` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:57:03.200480 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f83277-a736-424d-bb2c-e6164359cdba admin admin] RBAC: Authorizing `identity:delete_project(project_id=6d75923e5a084708b4b8370cb7e5eea0)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:57:03.202801 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f83277-a736-424d-bb2c-e6164359cdba admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:57:03.210941 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30899124-6925-48be-bea4-21ce26f96099 service cinder] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:57:03.244191 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886e470d-8041-48a6-b2fb-f64b72034ee6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:57:03.244964 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886e470d-8041-48a6-b2fb-f64b72034ee6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:57:03.245313 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886e470d-8041-48a6-b2fb-f64b72034ee6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:57:03.245661 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886e470d-8041-48a6-b2fb-f64b72034ee6 admin admin] PATH_INFO: `/v3/users/4954df36b4a7436e8c19418af919d21d` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:57:03.248051 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886e470d-8041-48a6-b2fb-f64b72034ee6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4954df36b4a7436e8c19418af919d21d)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:57:03.252128 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886e470d-8041-48a6-b2fb-f64b72034ee6 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:57:03.292377 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:57:03.330718 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-85f83277-a736-424d-bb2c-e6164359cdba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6d75923e5a084708b4b8370cb7e5eea0', 'request_id': 'req-85f83277-a736-424d-bb2c-e6164359cdba'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:57:03.351054 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-85f83277-a736-424d-bb2c-e6164359cdba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6d75923e5a084708b4b8370cb7e5eea0', 'request_id': 'req-85f83277-a736-424d-bb2c-e6164359cdba'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:57:03.360343 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-85f83277-a736-424d-bb2c-e6164359cdba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6d75923e5a084708b4b8370cb7e5eea0', 'request_id': 'req-85f83277-a736-424d-bb2c-e6164359cdba'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:57:03.368689 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-886e470d-8041-48a6-b2fb-f64b72034ee6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4954df36b4a7436e8c19418af919d21d'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:57:03.381487 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-85f83277-a736-424d-bb2c-e6164359cdba admin admin] The token cache is being invalidate because project 6d75923e5a084708b4b8370cb7e5eea0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81525) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 09 00:57:03.381831 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-85f83277-a736-424d-bb2c-e6164359cdba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:57:03.381927 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-886e470d-8041-48a6-b2fb-f64b72034ee6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4954df36b4a7436e8c19418af919d21d'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:57:03.382469 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-85f83277-a736-424d-bb2c-e6164359cdba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:57:03.383064 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-886e470d-8041-48a6-b2fb-f64b72034ee6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4954df36b4a7436e8c19418af919d21d'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:57:03.384361 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-886e470d-8041-48a6-b2fb-f64b72034ee6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4954df36b4a7436e8c19418af919d21d'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:57:03.384802 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 976/1931] 10.222.0.15 () {58 vars in 1233 bytes} [Sun Oct 9 00:57:03 2022] DELETE /identity/v3/projects/6d75923e5a084708b4b8370cb7e5eea0 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 00:57:03.388611 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f83277-a736-424d-bb2c-e6164359cdba admin admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:57:03.391230 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-85f83277-a736-424d-bb2c-e6164359cdba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:57:03.397049 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-886e470d-8041-48a6-b2fb-f64b72034ee6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4954df36b4a7436e8c19418af919d21d'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:57:03.424476 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 956/1932] 10.222.0.15 () {58 vars in 1224 bytes} [Sun Oct 9 00:57:03 2022] DELETE /identity/v3/users/4954df36b4a7436e8c19418af919d21d => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 09 00:57:03.429101 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e774889-e43b-4328-8e70-d1c919c61a01 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:57:03.429577 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e774889-e43b-4328-8e70-d1c919c61a01 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:57:03.429975 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e774889-e43b-4328-8e70-d1c919c61a01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:57:03.454538 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-1e774889-e43b-4328-8e70-d1c919c61a01 None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:57:03.456448 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-1e774889-e43b-4328-8e70-d1c919c61a01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:57:03.477806 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:57:03.524117 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f83277-a736-424d-bb2c-e6164359cdba admin admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:57:03.554757 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 957/1933] 10.222.0.15 () {58 vars in 958 bytes} [Sun Oct 9 00:57:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:57:03.569136 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e774889-e43b-4328-8e70-d1c919c61a01 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:57:03.571618 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-1e774889-e43b-4328-8e70-d1c919c61a01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:57:03.607876 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b18b7a9-bb4f-476a-b1de-0fd0e8c975b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:57:03.608861 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b18b7a9-bb4f-476a-b1de-0fd0e8c975b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:57:03.609214 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b18b7a9-bb4f-476a-b1de-0fd0e8c975b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:57:03.609560 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b18b7a9-bb4f-476a-b1de-0fd0e8c975b6 admin admin] PATH_INFO: `/v3/users/2c2ec36d9bf1405e97d0ff2f800696f4` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:57:03.611660 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b18b7a9-bb4f-476a-b1de-0fd0e8c975b6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2c2ec36d9bf1405e97d0ff2f800696f4)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:57:03.613882 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b18b7a9-bb4f-476a-b1de-0fd0e8c975b6 admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:57:03.639322 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e774889-e43b-4328-8e70-d1c919c61a01 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:57:03.644657 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2075bdb0-2fc8-4447-8bc2-eb5eba17bdde service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4ef90d456d2483e8ddafbe2d4d4fb5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f148d39ced534860abfbe8fc3f98ace4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:57:03.645885 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2075bdb0-2fc8-4447-8bc2-eb5eba17bdde service neutron] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:57:03.646376 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2075bdb0-2fc8-4447-8bc2-eb5eba17bdde service neutron] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:57:03.646768 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2075bdb0-2fc8-4447-8bc2-eb5eba17bdde service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:57:03.658659 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2075bdb0-2fc8-4447-8bc2-eb5eba17bdde service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:57:03.660279 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2075bdb0-2fc8-4447-8bc2-eb5eba17bdde service neutron] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:57:03.672494 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 958/1934] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Oct 9 00:57:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 09 00:57:03.691485 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-9b18b7a9-bb4f-476a-b1de-0fd0e8c975b6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2c2ec36d9bf1405e97d0ff2f800696f4'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:57:03.717138 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-9b18b7a9-bb4f-476a-b1de-0fd0e8c975b6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2c2ec36d9bf1405e97d0ff2f800696f4'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:57:03.719326 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-9b18b7a9-bb4f-476a-b1de-0fd0e8c975b6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2c2ec36d9bf1405e97d0ff2f800696f4'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:57:03.720524 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-9b18b7a9-bb4f-476a-b1de-0fd0e8c975b6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2c2ec36d9bf1405e97d0ff2f800696f4'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:57:03.734338 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-9b18b7a9-bb4f-476a-b1de-0fd0e8c975b6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2c2ec36d9bf1405e97d0ff2f800696f4'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:57:03.757852 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:57:03.778856 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 977/1935] 10.222.0.15 () {58 vars in 1224 bytes} [Sun Oct 9 00:57:03 2022] DELETE /identity/v3/users/2c2ec36d9bf1405e97d0ff2f800696f4 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 09 00:57:04.327714 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2075bdb0-2fc8-4447-8bc2-eb5eba17bdde service neutron] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:57:04.329196 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-2075bdb0-2fc8-4447-8bc2-eb5eba17bdde service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:57:04.346190 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2075bdb0-2fc8-4447-8bc2-eb5eba17bdde service neutron] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:57:04.449512 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c49bd3-87c2-4cf5-96bf-ef22c0377f06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:57:04.450306 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c49bd3-87c2-4cf5-96bf-ef22c0377f06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:57:04.450653 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c49bd3-87c2-4cf5-96bf-ef22c0377f06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:57:04.451291 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c49bd3-87c2-4cf5-96bf-ef22c0377f06 admin admin] PATH_INFO: `/v3/projects/58cbd21b11d546c8901c53c2ab5862fc` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:57:04.452731 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c49bd3-87c2-4cf5-96bf-ef22c0377f06 admin admin] RBAC: Authorizing `identity:delete_project(project_id=58cbd21b11d546c8901c53c2ab5862fc)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:57:04.455492 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c49bd3-87c2-4cf5-96bf-ef22c0377f06 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:57:04.526569 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-82c49bd3-87c2-4cf5-96bf-ef22c0377f06 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '58cbd21b11d546c8901c53c2ab5862fc', 'request_id': 'req-82c49bd3-87c2-4cf5-96bf-ef22c0377f06'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:57:04.541782 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-82c49bd3-87c2-4cf5-96bf-ef22c0377f06 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '58cbd21b11d546c8901c53c2ab5862fc', 'request_id': 'req-82c49bd3-87c2-4cf5-96bf-ef22c0377f06'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:57:04.552899 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-82c49bd3-87c2-4cf5-96bf-ef22c0377f06 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '58cbd21b11d546c8901c53c2ab5862fc', 'request_id': 'req-82c49bd3-87c2-4cf5-96bf-ef22c0377f06'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:57:04.563081 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:57:04.571661 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-82c49bd3-87c2-4cf5-96bf-ef22c0377f06 admin admin] The token cache is being invalidate because project 58cbd21b11d546c8901c53c2ab5862fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81524) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 09 00:57:04.572251 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-82c49bd3-87c2-4cf5-96bf-ef22c0377f06 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:57:04.574895 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-82c49bd3-87c2-4cf5-96bf-ef22c0377f06 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:57:04.577133 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 959/1936] 10.222.0.15 () {58 vars in 1233 bytes} [Sun Oct 9 00:57:04 2022] DELETE /identity/v3/projects/58cbd21b11d546c8901c53c2ab5862fc => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 00:57:04.591765 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692eaa18-c3f1-47c2-a0e4-6190592d4498 None None] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:57:04.591765 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692eaa18-c3f1-47c2-a0e4-6190592d4498 None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:57:04.591765 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692eaa18-c3f1-47c2-a0e4-6190592d4498 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:57:04.608540 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.auth.core [None req-692eaa18-c3f1-47c2-a0e4-6190592d4498 None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:57:04.609886 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-692eaa18-c3f1-47c2-a0e4-6190592d4498 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:57:04.644637 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c49bd3-87c2-4cf5-96bf-ef22c0377f06 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:57:04.645465 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-82c49bd3-87c2-4cf5-96bf-ef22c0377f06 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:57:04.771894 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 978/1937] 10.222.0.15 () {58 vars in 958 bytes} [Sun Oct 9 00:57:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:57:04.773161 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692eaa18-c3f1-47c2-a0e4-6190592d4498 None None] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:57:04.775454 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-692eaa18-c3f1-47c2-a0e4-6190592d4498 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:57:04.786274 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c49bd3-87c2-4cf5-96bf-ef22c0377f06 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:57:04.790389 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692eaa18-c3f1-47c2-a0e4-6190592d4498 None None] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:57:04.790684 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40211c34-30c0-47aa-8621-82df4bac6954 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff7cb78bcd91467abe5c2e2b48aedd1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f148d39ced534860abfbe8fc3f98ace4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:57:04.791654 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40211c34-30c0-47aa-8621-82df4bac6954 service cinder] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:57:04.791944 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40211c34-30c0-47aa-8621-82df4bac6954 service cinder] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:57:04.792213 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40211c34-30c0-47aa-8621-82df4bac6954 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:57:04.793972 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-40211c34-30c0-47aa-8621-82df4bac6954 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:57:04.796474 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903fd461-6f32-48d1-ba31-21d20a9e5629 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:57:04.797339 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903fd461-6f32-48d1-ba31-21d20a9e5629 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:57:04.797685 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903fd461-6f32-48d1-ba31-21d20a9e5629 admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:57:04.798253 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903fd461-6f32-48d1-ba31-21d20a9e5629 admin admin] PATH_INFO: `/v3/projects/918cff8cb5da4478868db2296de2dc32` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:57:04.799594 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903fd461-6f32-48d1-ba31-21d20a9e5629 admin admin] RBAC: Authorizing `identity:delete_project(project_id=918cff8cb5da4478868db2296de2dc32)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:57:04.802104 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903fd461-6f32-48d1-ba31-21d20a9e5629 admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:57:04.875505 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-903fd461-6f32-48d1-ba31-21d20a9e5629 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '918cff8cb5da4478868db2296de2dc32', 'request_id': 'req-903fd461-6f32-48d1-ba31-21d20a9e5629'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:57:04.881805 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40211c34-30c0-47aa-8621-82df4bac6954 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:57:04.883499 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40211c34-30c0-47aa-8621-82df4bac6954 service cinder] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:57:04.886935 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-903fd461-6f32-48d1-ba31-21d20a9e5629 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '918cff8cb5da4478868db2296de2dc32', 'request_id': 'req-903fd461-6f32-48d1-ba31-21d20a9e5629'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:57:04.894413 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-903fd461-6f32-48d1-ba31-21d20a9e5629 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '918cff8cb5da4478868db2296de2dc32', 'request_id': 'req-903fd461-6f32-48d1-ba31-21d20a9e5629'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:57:04.894998 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 960/1938] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Oct 9 00:57:04 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 09 00:57:04.896303 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48088c2d-7417-45f0-9b3c-e8820501d2ac None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:57:04.896719 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48088c2d-7417-45f0-9b3c-e8820501d2ac None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:57:04.897055 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48088c2d-7417-45f0-9b3c-e8820501d2ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:57:04.908587 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-903fd461-6f32-48d1-ba31-21d20a9e5629 admin admin] The token cache is being invalidate because project 918cff8cb5da4478868db2296de2dc32 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81525) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 09 00:57:04.909060 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-903fd461-6f32-48d1-ba31-21d20a9e5629 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:57:04.909804 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-903fd461-6f32-48d1-ba31-21d20a9e5629 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:57:04.911552 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 979/1939] 10.222.0.15 () {58 vars in 1233 bytes} [Sun Oct 9 00:57:04 2022] DELETE /identity/v3/projects/918cff8cb5da4478868db2296de2dc32 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 00:57:04.916682 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea41c9ed-cb31-48e2-bc49-14c3eb2504b5 None None] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:57:04.917220 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea41c9ed-cb31-48e2-bc49-14c3eb2504b5 None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:57:04.918843 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea41c9ed-cb31-48e2-bc49-14c3eb2504b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:57:04.925662 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-48088c2d-7417-45f0-9b3c-e8820501d2ac None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:57:04.926993 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-48088c2d-7417-45f0-9b3c-e8820501d2ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:57:04.943234 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.auth.core [None req-ea41c9ed-cb31-48e2-bc49-14c3eb2504b5 None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:57:04.945879 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-ea41c9ed-cb31-48e2-bc49-14c3eb2504b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:57:05.008914 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 961/1940] 10.222.0.15 () {58 vars in 958 bytes} [Sun Oct 9 00:57:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:57:05.009710 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48088c2d-7417-45f0-9b3c-e8820501d2ac None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:57:05.026744 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48088c2d-7417-45f0-9b3c-e8820501d2ac None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:57:05.048686 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33eb484-bb4a-439f-b30a-15118342fbe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:57:05.049362 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33eb484-bb4a-439f-b30a-15118342fbe3 admin admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:57:05.056429 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33eb484-bb4a-439f-b30a-15118342fbe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:57:05.056860 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33eb484-bb4a-439f-b30a-15118342fbe3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:57:05.057663 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33eb484-bb4a-439f-b30a-15118342fbe3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:57:05.061331 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33eb484-bb4a-439f-b30a-15118342fbe3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:57:05.065265 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33eb484-bb4a-439f-b30a-15118342fbe3 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:57:05.073810 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 980/1941] 10.222.0.15 () {58 vars in 958 bytes} [Sun Oct 9 00:57:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 09 00:57:05.091370 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2e5a89-f5c0-4224-be8c-91c06e83d024 None None] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:57:05.091370 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2e5a89-f5c0-4224-be8c-91c06e83d024 None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:57:05.091370 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2e5a89-f5c0-4224-be8c-91c06e83d024 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:57:05.097577 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 962/1942] 10.222.0.15 () {58 vars in 1153 bytes} [Sun Oct 9 00:57:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:57:05.098930 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33eb484-bb4a-439f-b30a-15118342fbe3 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:57:05.105267 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.auth.core [None req-4e2e5a89-f5c0-4224-be8c-91c06e83d024 None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:57:05.106590 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-4e2e5a89-f5c0-4224-be8c-91c06e83d024 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:57:05.128340 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33eb484-bb4a-439f-b30a-15118342fbe3 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:57:05.128563 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 981/1943] 10.222.0.15 () {58 vars in 958 bytes} [Sun Oct 9 00:57:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:57:05.129611 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2e5a89-f5c0-4224-be8c-91c06e83d024 None None] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:57:05.151968 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42d0d7a-3663-4e62-8cfa-9a60bb59cda8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:57:05.152835 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42d0d7a-3663-4e62-8cfa-9a60bb59cda8 admin admin] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:57:05.153217 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42d0d7a-3663-4e62-8cfa-9a60bb59cda8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:57:05.153581 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42d0d7a-3663-4e62-8cfa-9a60bb59cda8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:57:05.154329 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42d0d7a-3663-4e62-8cfa-9a60bb59cda8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:57:05.156741 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42d0d7a-3663-4e62-8cfa-9a60bb59cda8 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:57:05.168779 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2e5a89-f5c0-4224-be8c-91c06e83d024 None None] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:57:05.180524 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c85f50-691f-4a64-aba6-fec9adaad96f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:57:05.181657 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c85f50-691f-4a64-aba6-fec9adaad96f admin admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:57:05.182418 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c85f50-691f-4a64-aba6-fec9adaad96f admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:57:05.183312 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c85f50-691f-4a64-aba6-fec9adaad96f admin admin] PATH_INFO: `/v3/domains` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:57:05.185020 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c85f50-691f-4a64-aba6-fec9adaad96f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:57:05.186207 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c85f50-691f-4a64-aba6-fec9adaad96f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:57:05.189311 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c85f50-691f-4a64-aba6-fec9adaad96f admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:57:05.192261 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:57:05.199829 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 963/1944] 10.222.0.15 () {60 vars in 1153 bytes} [Sun Oct 9 00:57:05 2022] POST /identity/v3/projects => generated 383 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 09 00:57:05.204427 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42d0d7a-3663-4e62-8cfa-9a60bb59cda8 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:57:05.222557 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 982/1945] 10.222.0.15 () {58 vars in 1153 bytes} [Sun Oct 9 00:57:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:57:05.230722 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c85f50-691f-4a64-aba6-fec9adaad96f admin admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:57:05.233634 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:57:05.255253 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c85f50-691f-4a64-aba6-fec9adaad96f admin admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:57:05.341468 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42d0d7a-3663-4e62-8cfa-9a60bb59cda8 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:57:05.349794 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d965b928-4d77-4099-ad25-bd455d3e1b98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:57:05.351602 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d965b928-4d77-4099-ad25-bd455d3e1b98 admin admin] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:57:05.352279 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d965b928-4d77-4099-ad25-bd455d3e1b98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:57:05.352279 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d965b928-4d77-4099-ad25-bd455d3e1b98 admin admin] PATH_INFO: `/v3/users` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:57:05.355327 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d965b928-4d77-4099-ad25-bd455d3e1b98 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:57:05.357518 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d965b928-4d77-4099-ad25-bd455d3e1b98 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:57:05.384383 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b37f74e-c303-4a14-a01f-377a6dea3c68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:57:05.385250 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b37f74e-c303-4a14-a01f-377a6dea3c68 admin admin] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:57:05.385672 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b37f74e-c303-4a14-a01f-377a6dea3c68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:57:05.386103 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b37f74e-c303-4a14-a01f-377a6dea3c68 admin admin] PATH_INFO: `/v3/projects` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:57:05.386897 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b37f74e-c303-4a14-a01f-377a6dea3c68 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:57:05.389059 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b37f74e-c303-4a14-a01f-377a6dea3c68 admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:57:05.390373 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 964/1946] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Oct 9 00:57:05 2022] POST /identity/v3/users => generated 292 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 09 00:57:05.395354 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d965b928-4d77-4099-ad25-bd455d3e1b98 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:57:05.411624 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d965b928-4d77-4099-ad25-bd455d3e1b98 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:57:05.419542 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeadabb5-1cd2-44a1-b547-78a40c57f973 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:57:05.421368 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeadabb5-1cd2-44a1-b547-78a40c57f973 admin admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:57:05.421671 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeadabb5-1cd2-44a1-b547-78a40c57f973 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:57:05.422001 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeadabb5-1cd2-44a1-b547-78a40c57f973 admin admin] PATH_INFO: `/v3/roles` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:57:05.422776 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeadabb5-1cd2-44a1-b547-78a40c57f973 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:57:05.425673 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeadabb5-1cd2-44a1-b547-78a40c57f973 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:57:05.441516 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 983/1947] 10.222.0.15 () {60 vars in 1153 bytes} [Sun Oct 9 00:57:05 2022] POST /identity/v3/projects => generated 371 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 09 00:57:05.442480 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b37f74e-c303-4a14-a01f-377a6dea3c68 admin admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:57:05.449080 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 965/1948] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Oct 9 00:57:05 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 09 00:57:05.454181 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeadabb5-1cd2-44a1-b547-78a40c57f973 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:57:05.478867 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeadabb5-1cd2-44a1-b547-78a40c57f973 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:57:05.535109 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b37f74e-c303-4a14-a01f-377a6dea3c68 admin admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:57:05.545299 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa348b7c-24fc-44bb-aa44-be79a07c6ebd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:57:05.545936 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa348b7c-24fc-44bb-aa44-be79a07c6ebd admin admin] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:57:05.546213 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa348b7c-24fc-44bb-aa44-be79a07c6ebd admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:57:05.546527 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa348b7c-24fc-44bb-aa44-be79a07c6ebd admin admin] PATH_INFO: `/v3/users` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:57:05.547382 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa348b7c-24fc-44bb-aa44-be79a07c6ebd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:57:05.549403 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa348b7c-24fc-44bb-aa44-be79a07c6ebd admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:57:05.578893 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a5e8b4-ac89-4d40-80c8-70672227db5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:57:05.579800 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a5e8b4-ac89-4d40-80c8-70672227db5e admin admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:57:05.580013 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a5e8b4-ac89-4d40-80c8-70672227db5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:57:05.580903 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a5e8b4-ac89-4d40-80c8-70672227db5e admin admin] PATH_INFO: `/v3/roles` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:57:05.581046 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a5e8b4-ac89-4d40-80c8-70672227db5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:57:05.583819 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a5e8b4-ac89-4d40-80c8-70672227db5e admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:57:05.597258 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 966/1949] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Oct 9 00:57:05 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 09 00:57:05.605702 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 984/1950] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Oct 9 00:57:05 2022] POST /identity/v3/users => generated 286 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 09 00:57:05.606253 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a5e8b4-ac89-4d40-80c8-70672227db5e admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:57:05.609753 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa348b7c-24fc-44bb-aa44-be79a07c6ebd admin admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:57:05.629782 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa348b7c-24fc-44bb-aa44-be79a07c6ebd admin admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:57:05.630445 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a5e8b4-ac89-4d40-80c8-70672227db5e admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:57:05.638873 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d401bb-0944-4a65-9f0d-18e32631594c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:57:05.639581 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d401bb-0944-4a65-9f0d-18e32631594c admin admin] REQUEST_METHOD: `PUT` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:57:05.639860 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d401bb-0944-4a65-9f0d-18e32631594c admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:57:05.640126 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d401bb-0944-4a65-9f0d-18e32631594c admin admin] PATH_INFO: `/v3/projects/6e2becab454c4065b275611633476be9/users/236673cdba0f4288a58a015e985bab3d/roles/afb0a01183d9497795eaa4fa1a4046ae` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:57:05.641502 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5d974d-aa8d-437f-a0e4-7199bb55b75c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:57:05.642124 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5d974d-aa8d-437f-a0e4-7199bb55b75c admin admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:57:05.642392 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5d974d-aa8d-437f-a0e4-7199bb55b75c admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:57:05.642652 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5d974d-aa8d-437f-a0e4-7199bb55b75c admin admin] PATH_INFO: `/v3/roles` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:57:05.643331 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5d974d-aa8d-437f-a0e4-7199bb55b75c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:57:05.645216 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5d974d-aa8d-437f-a0e4-7199bb55b75c admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:57:05.672723 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 985/1951] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Oct 9 00:57:05 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 09 00:57:05.678842 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5d974d-aa8d-437f-a0e4-7199bb55b75c admin admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:57:05.685244 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d401bb-0944-4a65-9f0d-18e32631594c admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e2becab454c4065b275611633476be9, user_id=236673cdba0f4288a58a015e985bab3d, role_id=afb0a01183d9497795eaa4fa1a4046ae)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:57:05.688219 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d401bb-0944-4a65-9f0d-18e32631594c admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:57:05.707790 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5d974d-aa8d-437f-a0e4-7199bb55b75c admin admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:57:05.747437 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5648a958-a73d-42e2-8543-1b98f37634c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:57:05.748931 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 967/1952] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Oct 9 00:57:05 2022] PUT /identity/v3/projects/6e2becab454c4065b275611633476be9/users/236673cdba0f4288a58a015e985bab3d/roles/afb0a01183d9497795eaa4fa1a4046ae => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 00:57:05.749300 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5648a958-a73d-42e2-8543-1b98f37634c6 admin admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:57:05.749713 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5648a958-a73d-42e2-8543-1b98f37634c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:57:05.750050 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5648a958-a73d-42e2-8543-1b98f37634c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:57:05.751285 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5648a958-a73d-42e2-8543-1b98f37634c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:57:05.754234 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5648a958-a73d-42e2-8543-1b98f37634c6 admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:57:05.767215 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec50d25-6f69-4c5a-a824-f620342d636c None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:57:05.767535 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec50d25-6f69-4c5a-a824-f620342d636c None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:57:05.770063 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec50d25-6f69-4c5a-a824-f620342d636c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:57:05.822432 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 986/1953] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Oct 9 00:57:05 2022] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 09 00:57:05.825922 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5648a958-a73d-42e2-8543-1b98f37634c6 admin admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:57:05.838891 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5648a958-a73d-42e2-8543-1b98f37634c6 admin admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:57:05.871760 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-3ec50d25-6f69-4c5a-a824-f620342d636c None None] MFA Rules not processed for user `236673cdba0f4288a58a015e985bab3d`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:57:05.876529 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-3ec50d25-6f69-4c5a-a824-f620342d636c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:57:05.938350 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:57:05.970331 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89296a81-6049-47c0-9df7-ed2edbb213fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:57:05.971181 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89296a81-6049-47c0-9df7-ed2edbb213fe admin admin] REQUEST_METHOD: `PUT` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:57:05.971504 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89296a81-6049-47c0-9df7-ed2edbb213fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:57:05.971776 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89296a81-6049-47c0-9df7-ed2edbb213fe admin admin] PATH_INFO: `/v3/projects/5712fa49fdea4feebe08bda4eb6fbc3a/users/9f76bffc4c1741d7bc2209e245af3093/roles/afb0a01183d9497795eaa4fa1a4046ae` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:57:05.985189 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:57:05.995580 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89296a81-6049-47c0-9df7-ed2edbb213fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=5712fa49fdea4feebe08bda4eb6fbc3a, user_id=9f76bffc4c1741d7bc2209e245af3093, role_id=afb0a01183d9497795eaa4fa1a4046ae)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:57:06.000877 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89296a81-6049-47c0-9df7-ed2edbb213fe admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:57:06.005674 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 968/1954] 10.222.0.15 () {58 vars in 958 bytes} [Sun Oct 9 00:57:05 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 09 00:57:06.007150 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec50d25-6f69-4c5a-a824-f620342d636c None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:57:06.013407 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-3ec50d25-6f69-4c5a-a824-f620342d636c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:57:06.026660 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 987/1955] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Oct 9 00:57:05 2022] PUT /identity/v3/projects/5712fa49fdea4feebe08bda4eb6fbc3a/users/9f76bffc4c1741d7bc2209e245af3093/roles/afb0a01183d9497795eaa4fa1a4046ae => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 09 00:57:06.031479 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89296a81-6049-47c0-9df7-ed2edbb213fe admin admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:57:06.033375 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-89296a81-6049-47c0-9df7-ed2edbb213fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:57:06.110670 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89296a81-6049-47c0-9df7-ed2edbb213fe admin admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:57:06.119890 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75d4a1e-e298-472d-b66b-1f3bf2319a14 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff7cb78bcd91467abe5c2e2b48aedd1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f148d39ced534860abfbe8fc3f98ace4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:57:06.120567 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75d4a1e-e298-472d-b66b-1f3bf2319a14 service cinder] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:57:06.120906 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75d4a1e-e298-472d-b66b-1f3bf2319a14 service cinder] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:57:06.121282 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75d4a1e-e298-472d-b66b-1f3bf2319a14 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:57:06.128216 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec50d25-6f69-4c5a-a824-f620342d636c None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:57:06.146223 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd7cdeb-d93a-4ebe-a8f7-5995e89c8ec2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff7cb78bcd91467abe5c2e2b48aedd1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f148d39ced534860abfbe8fc3f98ace4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:57:06.147453 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd7cdeb-d93a-4ebe-a8f7-5995e89c8ec2 service cinder] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:57:06.147735 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd7cdeb-d93a-4ebe-a8f7-5995e89c8ec2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:57:06.149866 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd7cdeb-d93a-4ebe-a8f7-5995e89c8ec2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:57:06.153101 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-ecd7cdeb-d93a-4ebe-a8f7-5995e89c8ec2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:57:06.210802 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75d4a1e-e298-472d-b66b-1f3bf2319a14 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:57:06.212429 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75d4a1e-e298-472d-b66b-1f3bf2319a14 service cinder] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:57:06.224544 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 988/1956] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Oct 9 00:57:06 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 09 00:57:06.225801 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60afe1ca-f64e-4aa0-864f-a35ea364c4aa None None] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:57:06.226275 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60afe1ca-f64e-4aa0-864f-a35ea364c4aa None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:57:06.226618 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60afe1ca-f64e-4aa0-864f-a35ea364c4aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:57:06.240608 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd7cdeb-d93a-4ebe-a8f7-5995e89c8ec2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:57:06.243128 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd7cdeb-d93a-4ebe-a8f7-5995e89c8ec2 service cinder] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:57:06.256764 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 969/1957] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Oct 9 00:57:06 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 09 00:57:06.280330 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.auth.core [None req-60afe1ca-f64e-4aa0-864f-a35ea364c4aa None None] MFA Rules not processed for user `9f76bffc4c1741d7bc2209e245af3093`. Rule list: `[]` (Enabled: `True`). {{(pid=81525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:57:06.283525 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-60afe1ca-f64e-4aa0-864f-a35ea364c4aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:57:06.480835 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 989/1958] 10.222.0.15 () {58 vars in 958 bytes} [Sun Oct 9 00:57:06 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:57:06.497771 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd7cdeb-d93a-4ebe-a8f7-5995e89c8ec2 service cinder] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:57:06.520491 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd7cdeb-d93a-4ebe-a8f7-5995e89c8ec2 service cinder] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:57:06.552174 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7025b1-e79b-4919-a0b2-e772a90069fe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff7cb78bcd91467abe5c2e2b48aedd1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f148d39ced534860abfbe8fc3f98ace4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:57:06.552964 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7025b1-e79b-4919-a0b2-e772a90069fe service cinder] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:57:06.553307 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7025b1-e79b-4919-a0b2-e772a90069fe service cinder] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:57:06.555102 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7025b1-e79b-4919-a0b2-e772a90069fe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:57:06.579982 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7025b1-e79b-4919-a0b2-e772a90069fe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:57:06.585992 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7025b1-e79b-4919-a0b2-e772a90069fe service cinder] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:57:06.610130 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 970/1959] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Oct 9 00:57:06 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 09 00:57:06.642373 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60afe1ca-f64e-4aa0-864f-a35ea364c4aa None None] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:57:06.673396 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:57:06.836217 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60afe1ca-f64e-4aa0-864f-a35ea364c4aa None None] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:57:06.851455 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420a3655-47e9-43a3-bcc9-14b60fd37675 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:57:06.856687 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420a3655-47e9-43a3-bcc9-14b60fd37675 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:57:06.856983 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420a3655-47e9-43a3-bcc9-14b60fd37675 admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:57:06.857874 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420a3655-47e9-43a3-bcc9-14b60fd37675 admin admin] PATH_INFO: `/v3/users/9f76bffc4c1741d7bc2209e245af3093` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:57:06.860363 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420a3655-47e9-43a3-bcc9-14b60fd37675 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f76bffc4c1741d7bc2209e245af3093)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:57:06.862810 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420a3655-47e9-43a3-bcc9-14b60fd37675 admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:57:06.934595 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-420a3655-47e9-43a3-bcc9-14b60fd37675 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f76bffc4c1741d7bc2209e245af3093'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:57:06.944414 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-420a3655-47e9-43a3-bcc9-14b60fd37675 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f76bffc4c1741d7bc2209e245af3093'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:57:06.945265 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-420a3655-47e9-43a3-bcc9-14b60fd37675 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f76bffc4c1741d7bc2209e245af3093'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:57:06.945936 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-420a3655-47e9-43a3-bcc9-14b60fd37675 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f76bffc4c1741d7bc2209e245af3093'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:57:06.959898 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-420a3655-47e9-43a3-bcc9-14b60fd37675 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f76bffc4c1741d7bc2209e245af3093'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:57:06.990037 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 990/1960] 10.222.0.15 () {58 vars in 1224 bytes} [Sun Oct 9 00:57:06 2022] DELETE /identity/v3/users/9f76bffc4c1741d7bc2209e245af3093 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 00:57:06.994614 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c87aa2b-01f2-4e71-a3bf-6c40c834b067 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:57:06.995145 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c87aa2b-01f2-4e71-a3bf-6c40c834b067 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:57:06.995145 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c87aa2b-01f2-4e71-a3bf-6c40c834b067 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:57:07.025969 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-5c87aa2b-01f2-4e71-a3bf-6c40c834b067 None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:57:07.027205 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-5c87aa2b-01f2-4e71-a3bf-6c40c834b067 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:57:07.115873 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 971/1961] 10.222.0.15 () {58 vars in 958 bytes} [Sun Oct 9 00:57:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:57:07.125615 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420a3655-47e9-43a3-bcc9-14b60fd37675 admin admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:57:07.127142 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-420a3655-47e9-43a3-bcc9-14b60fd37675 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:57:07.246400 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420a3655-47e9-43a3-bcc9-14b60fd37675 admin admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:57:07.250537 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45b6f7e-a7a8-43f5-a9c8-2a0f043220dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4ef90d456d2483e8ddafbe2d4d4fb5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f148d39ced534860abfbe8fc3f98ace4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:57:07.251184 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45b6f7e-a7a8-43f5-a9c8-2a0f043220dc service neutron] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:57:07.251478 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45b6f7e-a7a8-43f5-a9c8-2a0f043220dc service neutron] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:57:07.251754 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45b6f7e-a7a8-43f5-a9c8-2a0f043220dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:57:07.263085 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45b6f7e-a7a8-43f5-a9c8-2a0f043220dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:57:07.264620 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45b6f7e-a7a8-43f5-a9c8-2a0f043220dc service neutron] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:57:07.277582 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 991/1962] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Oct 9 00:57:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 09 00:57:07.944850 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c87aa2b-01f2-4e71-a3bf-6c40c834b067 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:57:07.948676 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-5c87aa2b-01f2-4e71-a3bf-6c40c834b067 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:57:07.995495 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c87aa2b-01f2-4e71-a3bf-6c40c834b067 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:57:08.002947 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b75ce8-a0b6-4107-8316-d94d80de4468 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:57:08.004054 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b75ce8-a0b6-4107-8316-d94d80de4468 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:57:08.004488 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b75ce8-a0b6-4107-8316-d94d80de4468 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:57:08.004917 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b75ce8-a0b6-4107-8316-d94d80de4468 admin admin] PATH_INFO: `/v3/projects/5712fa49fdea4feebe08bda4eb6fbc3a` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:57:08.006754 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b75ce8-a0b6-4107-8316-d94d80de4468 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5712fa49fdea4feebe08bda4eb6fbc3a)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:57:08.009163 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b75ce8-a0b6-4107-8316-d94d80de4468 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:57:08.124189 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:57:08.148382 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-45b75ce8-a0b6-4107-8316-d94d80de4468 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5712fa49fdea4feebe08bda4eb6fbc3a', 'request_id': 'req-45b75ce8-a0b6-4107-8316-d94d80de4468'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:57:08.167059 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-45b75ce8-a0b6-4107-8316-d94d80de4468 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5712fa49fdea4feebe08bda4eb6fbc3a', 'request_id': 'req-45b75ce8-a0b6-4107-8316-d94d80de4468'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:57:08.179992 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-45b75ce8-a0b6-4107-8316-d94d80de4468 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5712fa49fdea4feebe08bda4eb6fbc3a', 'request_id': 'req-45b75ce8-a0b6-4107-8316-d94d80de4468'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:57:08.221076 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-45b75ce8-a0b6-4107-8316-d94d80de4468 admin admin] The token cache is being invalidate because project 5712fa49fdea4feebe08bda4eb6fbc3a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81524) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 09 00:57:08.225120 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-45b75ce8-a0b6-4107-8316-d94d80de4468 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:57:08.226757 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-45b75ce8-a0b6-4107-8316-d94d80de4468 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:57:08.235871 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 972/1963] 10.222.0.15 () {58 vars in 1233 bytes} [Sun Oct 9 00:57:07 2022] DELETE /identity/v3/projects/5712fa49fdea4feebe08bda4eb6fbc3a => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 00:57:08.236181 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1ca213-4817-458e-a0d8-237fada7da33 None None] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:57:08.236181 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1ca213-4817-458e-a0d8-237fada7da33 None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:57:08.236181 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1ca213-4817-458e-a0d8-237fada7da33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:57:08.265535 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.auth.core [None req-8b1ca213-4817-458e-a0d8-237fada7da33 None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:57:08.266989 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-8b1ca213-4817-458e-a0d8-237fada7da33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:57:08.328397 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:57:08.377165 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 992/1964] 10.222.0.15 () {58 vars in 958 bytes} [Sun Oct 9 00:57:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 09 00:57:08.385089 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75efcc19-0b1b-4607-a0ab-b20b6bdbc2fc None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:57:08.385379 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75efcc19-0b1b-4607-a0ab-b20b6bdbc2fc None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:57:08.385687 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75efcc19-0b1b-4607-a0ab-b20b6bdbc2fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:57:08.413169 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-75efcc19-0b1b-4607-a0ab-b20b6bdbc2fc None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:57:08.414525 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-75efcc19-0b1b-4607-a0ab-b20b6bdbc2fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:57:08.424261 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 973/1965] 10.222.0.15 () {58 vars in 958 bytes} [Sun Oct 9 00:57:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 09 00:57:08.428313 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1ca213-4817-458e-a0d8-237fada7da33 None None] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:57:08.458690 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1ca213-4817-458e-a0d8-237fada7da33 None None] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:57:08.465601 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63883a50-3b09-4429-8279-8e552c27d0e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:57:08.466334 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63883a50-3b09-4429-8279-8e552c27d0e5 admin admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:57:08.467282 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63883a50-3b09-4429-8279-8e552c27d0e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:57:08.468276 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63883a50-3b09-4429-8279-8e552c27d0e5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:57:08.468646 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63883a50-3b09-4429-8279-8e552c27d0e5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:57:08.469371 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63883a50-3b09-4429-8279-8e552c27d0e5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:57:08.471198 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63883a50-3b09-4429-8279-8e552c27d0e5 admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:57:08.486710 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 993/1966] 10.222.0.15 () {58 vars in 1153 bytes} [Sun Oct 9 00:57:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:57:08.491397 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75efcc19-0b1b-4607-a0ab-b20b6bdbc2fc None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:57:08.508641 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75efcc19-0b1b-4607-a0ab-b20b6bdbc2fc None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:57:08.515495 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd83296-346a-42a3-99f5-e46abe28ce28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:57:08.516301 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd83296-346a-42a3-99f5-e46abe28ce28 admin admin] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:57:08.516648 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd83296-346a-42a3-99f5-e46abe28ce28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:57:08.516983 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd83296-346a-42a3-99f5-e46abe28ce28 admin admin] PATH_INFO: `/v3/projects` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:57:08.517715 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd83296-346a-42a3-99f5-e46abe28ce28 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:57:08.519762 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd83296-346a-42a3-99f5-e46abe28ce28 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:57:08.568249 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 974/1967] 10.222.0.15 () {60 vars in 1153 bytes} [Sun Oct 9 00:57:08 2022] POST /identity/v3/projects => generated 373 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 09 00:57:08.572699 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63883a50-3b09-4429-8279-8e552c27d0e5 admin admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:57:08.585529 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63883a50-3b09-4429-8279-8e552c27d0e5 admin admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:57:08.663121 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb892cb-61e7-404f-9b68-75cbd9dcb46e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:57:08.663861 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb892cb-61e7-404f-9b68-75cbd9dcb46e admin admin] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:57:08.664135 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb892cb-61e7-404f-9b68-75cbd9dcb46e admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:57:08.664576 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb892cb-61e7-404f-9b68-75cbd9dcb46e admin admin] PATH_INFO: `/v3/users` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:57:08.665526 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb892cb-61e7-404f-9b68-75cbd9dcb46e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:57:08.667662 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb892cb-61e7-404f-9b68-75cbd9dcb46e admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:57:08.698696 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd83296-346a-42a3-99f5-e46abe28ce28 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:57:08.699165 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 994/1968] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Oct 9 00:57:08 2022] POST /identity/v3/users => generated 287 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 09 00:57:08.710023 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd83296-346a-42a3-99f5-e46abe28ce28 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:57:08.714740 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de51042-3d98-4bd4-8c45-f51b2cc34863 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:57:08.715403 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de51042-3d98-4bd4-8c45-f51b2cc34863 admin admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:57:08.715678 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de51042-3d98-4bd4-8c45-f51b2cc34863 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:57:08.715944 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de51042-3d98-4bd4-8c45-f51b2cc34863 admin admin] PATH_INFO: `/v3/roles` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:57:08.716598 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de51042-3d98-4bd4-8c45-f51b2cc34863 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:57:08.718215 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de51042-3d98-4bd4-8c45-f51b2cc34863 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:57:08.729310 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 975/1969] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Oct 9 00:57:08 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 09 00:57:08.733348 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb892cb-61e7-404f-9b68-75cbd9dcb46e admin admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:57:08.744100 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb892cb-61e7-404f-9b68-75cbd9dcb46e admin admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:57:08.750465 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a2eabd-fcb9-4462-9be3-04844a052052 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:57:08.750989 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a2eabd-fcb9-4462-9be3-04844a052052 admin admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:57:08.751253 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a2eabd-fcb9-4462-9be3-04844a052052 admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:57:08.751583 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a2eabd-fcb9-4462-9be3-04844a052052 admin admin] PATH_INFO: `/v3/roles` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:57:08.752269 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a2eabd-fcb9-4462-9be3-04844a052052 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:57:08.754190 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a2eabd-fcb9-4462-9be3-04844a052052 admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:57:08.767360 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 995/1970] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Oct 9 00:57:08 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 09 00:57:08.771918 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de51042-3d98-4bd4-8c45-f51b2cc34863 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:57:08.785929 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de51042-3d98-4bd4-8c45-f51b2cc34863 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:57:08.791935 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0efbf32-0279-485b-82bb-90d06da55b27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:57:08.792684 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0efbf32-0279-485b-82bb-90d06da55b27 admin admin] REQUEST_METHOD: `PUT` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:57:08.793204 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0efbf32-0279-485b-82bb-90d06da55b27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:57:08.793549 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0efbf32-0279-485b-82bb-90d06da55b27 admin admin] PATH_INFO: `/v3/projects/afe5c7a337fc49e295c10dd0b4f6602f/users/6522c005f09c40179b643c2666e2eab4/roles/afb0a01183d9497795eaa4fa1a4046ae` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:57:08.811329 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0efbf32-0279-485b-82bb-90d06da55b27 admin admin] RBAC: Authorizing `identity:create_grant(project_id=afe5c7a337fc49e295c10dd0b4f6602f, user_id=6522c005f09c40179b643c2666e2eab4, role_id=afb0a01183d9497795eaa4fa1a4046ae)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:57:08.814172 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0efbf32-0279-485b-82bb-90d06da55b27 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:57:08.833323 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 976/1971] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Oct 9 00:57:08 2022] PUT /identity/v3/projects/afe5c7a337fc49e295c10dd0b4f6602f/users/6522c005f09c40179b643c2666e2eab4/roles/afb0a01183d9497795eaa4fa1a4046ae => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 09 00:57:08.846131 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a2936c-02b2-4a00-b932-c8564446ee5e None None] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:57:08.846430 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a2936c-02b2-4a00-b932-c8564446ee5e None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:57:08.847071 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a2936c-02b2-4a00-b932-c8564446ee5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:57:08.890010 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.auth.core [None req-90a2936c-02b2-4a00-b932-c8564446ee5e None None] MFA Rules not processed for user `6522c005f09c40179b643c2666e2eab4`. Rule list: `[]` (Enabled: `True`). {{(pid=81525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:57:08.892322 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-90a2936c-02b2-4a00-b932-c8564446ee5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:57:09.045327 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 996/1972] 10.222.0.15 () {58 vars in 958 bytes} [Sun Oct 9 00:57:08 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:57:09.057774 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0efbf32-0279-485b-82bb-90d06da55b27 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:57:09.060903 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-c0efbf32-0279-485b-82bb-90d06da55b27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:57:09.125956 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0efbf32-0279-485b-82bb-90d06da55b27 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:57:09.131589 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4665f484-aa10-4a83-b805-2d0e670436ae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff7cb78bcd91467abe5c2e2b48aedd1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f148d39ced534860abfbe8fc3f98ace4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:57:09.133918 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4665f484-aa10-4a83-b805-2d0e670436ae service cinder] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:57:09.134417 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4665f484-aa10-4a83-b805-2d0e670436ae service cinder] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:57:09.134931 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4665f484-aa10-4a83-b805-2d0e670436ae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:57:09.148448 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4665f484-aa10-4a83-b805-2d0e670436ae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:57:09.151151 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4665f484-aa10-4a83-b805-2d0e670436ae service cinder] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:57:09.169781 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 977/1973] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Oct 9 00:57:09 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 09 00:57:09.213352 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a2936c-02b2-4a00-b932-c8564446ee5e None None] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:57:09.303489 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:57:09.411177 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a2936c-02b2-4a00-b932-c8564446ee5e None None] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:57:09.433128 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668d81c2-2b64-44eb-978c-14ecf5f6ce97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:57:09.434177 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668d81c2-2b64-44eb-978c-14ecf5f6ce97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:57:09.434640 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668d81c2-2b64-44eb-978c-14ecf5f6ce97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:57:09.436130 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668d81c2-2b64-44eb-978c-14ecf5f6ce97 admin admin] PATH_INFO: `/v3/users/6522c005f09c40179b643c2666e2eab4` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:57:09.441645 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668d81c2-2b64-44eb-978c-14ecf5f6ce97 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6522c005f09c40179b643c2666e2eab4)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:57:09.443953 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668d81c2-2b64-44eb-978c-14ecf5f6ce97 admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:57:09.545305 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-668d81c2-2b64-44eb-978c-14ecf5f6ce97 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6522c005f09c40179b643c2666e2eab4'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:57:09.599843 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-668d81c2-2b64-44eb-978c-14ecf5f6ce97 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6522c005f09c40179b643c2666e2eab4'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:57:09.602799 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-668d81c2-2b64-44eb-978c-14ecf5f6ce97 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6522c005f09c40179b643c2666e2eab4'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:57:09.606646 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-668d81c2-2b64-44eb-978c-14ecf5f6ce97 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6522c005f09c40179b643c2666e2eab4'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:57:09.626262 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-668d81c2-2b64-44eb-978c-14ecf5f6ce97 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6522c005f09c40179b643c2666e2eab4'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:57:09.685620 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 997/1974] 10.222.0.15 () {58 vars in 1224 bytes} [Sun Oct 9 00:57:09 2022] DELETE /identity/v3/users/6522c005f09c40179b643c2666e2eab4 => generated 0 bytes in 471 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 00:57:09.690505 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905032e7-cfef-4d2d-94e3-932dce280e26 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:57:09.690846 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905032e7-cfef-4d2d-94e3-932dce280e26 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:57:09.691298 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905032e7-cfef-4d2d-94e3-932dce280e26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:57:09.737879 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-905032e7-cfef-4d2d-94e3-932dce280e26 None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:57:09.739391 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-905032e7-cfef-4d2d-94e3-932dce280e26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:57:09.849414 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:57:09.881926 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 978/1975] 10.222.0.15 () {58 vars in 958 bytes} [Sun Oct 9 00:57:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:57:09.908744 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668d81c2-2b64-44eb-978c-14ecf5f6ce97 admin admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:57:09.910533 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-668d81c2-2b64-44eb-978c-14ecf5f6ce97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:57:10.008061 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668d81c2-2b64-44eb-978c-14ecf5f6ce97 admin admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:57:10.012258 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad7963a-95b6-4c9a-9ea6-2facbd297e32 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4ef90d456d2483e8ddafbe2d4d4fb5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f148d39ced534860abfbe8fc3f98ace4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:57:10.013138 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad7963a-95b6-4c9a-9ea6-2facbd297e32 service neutron] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:57:10.013641 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad7963a-95b6-4c9a-9ea6-2facbd297e32 service neutron] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:57:10.014220 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad7963a-95b6-4c9a-9ea6-2facbd297e32 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:57:10.026945 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad7963a-95b6-4c9a-9ea6-2facbd297e32 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:57:10.029706 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad7963a-95b6-4c9a-9ea6-2facbd297e32 service neutron] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:57:10.045616 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 998/1976] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Oct 9 00:57:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 09 00:57:10.420011 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905032e7-cfef-4d2d-94e3-932dce280e26 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:57:10.421781 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-905032e7-cfef-4d2d-94e3-932dce280e26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:57:10.435787 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905032e7-cfef-4d2d-94e3-932dce280e26 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:57:10.447237 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a6fc05-6581-4d16-a27c-1f15f80343c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:57:10.448142 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a6fc05-6581-4d16-a27c-1f15f80343c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:57:10.448515 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a6fc05-6581-4d16-a27c-1f15f80343c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:57:10.448944 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a6fc05-6581-4d16-a27c-1f15f80343c0 admin admin] PATH_INFO: `/v3/projects/afe5c7a337fc49e295c10dd0b4f6602f` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:57:10.450825 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a6fc05-6581-4d16-a27c-1f15f80343c0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=afe5c7a337fc49e295c10dd0b4f6602f)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:57:10.455286 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a6fc05-6581-4d16-a27c-1f15f80343c0 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:57:10.515523 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-c2a6fc05-6581-4d16-a27c-1f15f80343c0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'afe5c7a337fc49e295c10dd0b4f6602f', 'request_id': 'req-c2a6fc05-6581-4d16-a27c-1f15f80343c0'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:57:10.527483 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-c2a6fc05-6581-4d16-a27c-1f15f80343c0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'afe5c7a337fc49e295c10dd0b4f6602f', 'request_id': 'req-c2a6fc05-6581-4d16-a27c-1f15f80343c0'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:57:10.535019 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-c2a6fc05-6581-4d16-a27c-1f15f80343c0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'afe5c7a337fc49e295c10dd0b4f6602f', 'request_id': 'req-c2a6fc05-6581-4d16-a27c-1f15f80343c0'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:57:10.546890 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-c2a6fc05-6581-4d16-a27c-1f15f80343c0 admin admin] The token cache is being invalidate because project afe5c7a337fc49e295c10dd0b4f6602f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81524) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 09 00:57:10.547842 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-c2a6fc05-6581-4d16-a27c-1f15f80343c0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:57:10.548591 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-c2a6fc05-6581-4d16-a27c-1f15f80343c0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:57:10.550476 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 979/1977] 10.222.0.15 () {58 vars in 1233 bytes} [Sun Oct 9 00:57:10 2022] DELETE /identity/v3/projects/afe5c7a337fc49e295c10dd0b4f6602f => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 00:57:10.555826 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0aaca9b-b0f3-4a8a-a02d-a495b1fa0f8c None None] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:57:10.556346 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0aaca9b-b0f3-4a8a-a02d-a495b1fa0f8c None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:57:10.556346 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0aaca9b-b0f3-4a8a-a02d-a495b1fa0f8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:57:10.577004 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.auth.core [None req-d0aaca9b-b0f3-4a8a-a02d-a495b1fa0f8c None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:57:10.578190 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-d0aaca9b-b0f3-4a8a-a02d-a495b1fa0f8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:57:10.652828 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:57:10.681327 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 999/1978] 10.222.0.15 () {58 vars in 958 bytes} [Sun Oct 9 00:57:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:57:10.684715 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db0a1ba-d9d0-425d-b6f7-b75c88d621e5 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:57:10.684715 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db0a1ba-d9d0-425d-b6f7-b75c88d621e5 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:57:10.684715 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db0a1ba-d9d0-425d-b6f7-b75c88d621e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:57:10.720945 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-3db0a1ba-d9d0-425d-b6f7-b75c88d621e5 None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:57:10.720945 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-3db0a1ba-d9d0-425d-b6f7-b75c88d621e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:57:10.733719 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 980/1979] 10.222.0.15 () {58 vars in 958 bytes} [Sun Oct 9 00:57:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:57:10.737859 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0aaca9b-b0f3-4a8a-a02d-a495b1fa0f8c None None] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:57:10.748970 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0aaca9b-b0f3-4a8a-a02d-a495b1fa0f8c None None] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:57:10.758107 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb13f3f-039a-4e7c-9914-b869f8c43f59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:57:10.759108 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb13f3f-039a-4e7c-9914-b869f8c43f59 admin admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:57:10.759615 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb13f3f-039a-4e7c-9914-b869f8c43f59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:57:10.760300 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb13f3f-039a-4e7c-9914-b869f8c43f59 admin admin] PATH_INFO: `/v3/domains` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:57:10.762153 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb13f3f-039a-4e7c-9914-b869f8c43f59 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:57:10.762644 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb13f3f-039a-4e7c-9914-b869f8c43f59 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:57:10.769023 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb13f3f-039a-4e7c-9914-b869f8c43f59 admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:57:10.783555 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1000/1980] 10.222.0.15 () {58 vars in 1153 bytes} [Sun Oct 9 00:57:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 09 00:57:10.788602 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db0a1ba-d9d0-425d-b6f7-b75c88d621e5 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:57:10.799390 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db0a1ba-d9d0-425d-b6f7-b75c88d621e5 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:57:10.804990 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188fffb9-122b-4b14-ac29-903db3bde76c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:57:10.805884 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188fffb9-122b-4b14-ac29-903db3bde76c admin admin] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:57:10.806426 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188fffb9-122b-4b14-ac29-903db3bde76c admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:57:10.806841 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188fffb9-122b-4b14-ac29-903db3bde76c admin admin] PATH_INFO: `/v3/projects` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:57:10.807674 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188fffb9-122b-4b14-ac29-903db3bde76c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:57:10.809783 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188fffb9-122b-4b14-ac29-903db3bde76c admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:57:10.844208 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 981/1981] 10.222.0.15 () {60 vars in 1153 bytes} [Sun Oct 9 00:57:10 2022] POST /identity/v3/projects => generated 387 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 09 00:57:10.848270 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb13f3f-039a-4e7c-9914-b869f8c43f59 admin admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:57:10.858988 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb13f3f-039a-4e7c-9914-b869f8c43f59 admin admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:57:10.958991 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95337378-930a-49b2-84b1-b3173e73faff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:57:10.959648 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95337378-930a-49b2-84b1-b3173e73faff admin admin] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:57:10.959924 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95337378-930a-49b2-84b1-b3173e73faff admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:57:10.960186 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95337378-930a-49b2-84b1-b3173e73faff admin admin] PATH_INFO: `/v3/users` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:57:10.960878 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95337378-930a-49b2-84b1-b3173e73faff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:57:10.962814 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95337378-930a-49b2-84b1-b3173e73faff admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:57:11.013691 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188fffb9-122b-4b14-ac29-903db3bde76c admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:57:11.016573 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-188fffb9-122b-4b14-ac29-903db3bde76c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:57:11.031671 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1001/1982] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Oct 9 00:57:10 2022] POST /identity/v3/users => generated 294 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 09 00:57:11.032896 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95337378-930a-49b2-84b1-b3173e73faff admin admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:57:11.041509 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188fffb9-122b-4b14-ac29-903db3bde76c admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:57:11.053744 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95337378-930a-49b2-84b1-b3173e73faff admin admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:57:11.054693 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a295c642-5941-40bb-88b3-04e4d236de1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:57:11.055576 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a295c642-5941-40bb-88b3-04e4d236de1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:57:11.055945 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a295c642-5941-40bb-88b3-04e4d236de1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:57:11.057347 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a295c642-5941-40bb-88b3-04e4d236de1a admin admin] PATH_INFO: `/v3/users/8b2109071d6d412ea9ff3f8e4289634f` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:57:11.059529 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a295c642-5941-40bb-88b3-04e4d236de1a admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b2109071d6d412ea9ff3f8e4289634f)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:57:11.061795 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a295c642-5941-40bb-88b3-04e4d236de1a admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:57:11.073539 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b6a84d-e619-49e7-9c94-2b14036b0fa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:57:11.074187 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b6a84d-e619-49e7-9c94-2b14036b0fa5 admin admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:57:11.074463 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b6a84d-e619-49e7-9c94-2b14036b0fa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:57:11.074735 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b6a84d-e619-49e7-9c94-2b14036b0fa5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:57:11.075422 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b6a84d-e619-49e7-9c94-2b14036b0fa5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:57:11.084577 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b6a84d-e619-49e7-9c94-2b14036b0fa5 admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:57:11.102315 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1002/1983] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Oct 9 00:57:11 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 09 00:57:11.105483 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b6a84d-e619-49e7-9c94-2b14036b0fa5 admin admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:57:11.131721 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b6a84d-e619-49e7-9c94-2b14036b0fa5 admin admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:57:11.135395 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-a295c642-5941-40bb-88b3-04e4d236de1a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b2109071d6d412ea9ff3f8e4289634f'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:57:11.144952 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e87d45-4a7b-40f6-b33a-181b0bf75b8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:57:11.145928 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e87d45-4a7b-40f6-b33a-181b0bf75b8e admin admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:57:11.146357 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e87d45-4a7b-40f6-b33a-181b0bf75b8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:57:11.146848 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e87d45-4a7b-40f6-b33a-181b0bf75b8e admin admin] PATH_INFO: `/v3/roles` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:57:11.148030 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e87d45-4a7b-40f6-b33a-181b0bf75b8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:57:11.148528 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-a295c642-5941-40bb-88b3-04e4d236de1a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b2109071d6d412ea9ff3f8e4289634f'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:57:11.150074 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-a295c642-5941-40bb-88b3-04e4d236de1a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b2109071d6d412ea9ff3f8e4289634f'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:57:11.150655 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e87d45-4a7b-40f6-b33a-181b0bf75b8e admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:57:11.151138 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-a295c642-5941-40bb-88b3-04e4d236de1a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b2109071d6d412ea9ff3f8e4289634f'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:57:11.168455 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1003/1984] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Oct 9 00:57:11 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 09 00:57:11.170860 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e87d45-4a7b-40f6-b33a-181b0bf75b8e admin admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:57:11.172228 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-a295c642-5941-40bb-88b3-04e4d236de1a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b2109071d6d412ea9ff3f8e4289634f'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:57:11.176801 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-e5e87d45-4a7b-40f6-b33a-181b0bf75b8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:57:11.205399 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e87d45-4a7b-40f6-b33a-181b0bf75b8e admin admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:57:11.207154 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 982/1985] 10.222.0.15 () {58 vars in 1224 bytes} [Sun Oct 9 00:57:11 2022] DELETE /identity/v3/users/8b2109071d6d412ea9ff3f8e4289634f => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 09 00:57:11.212084 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac4d91c-2dff-4d74-b253-023f27e662d0 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:57:11.213201 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac4d91c-2dff-4d74-b253-023f27e662d0 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:57:11.213477 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac4d91c-2dff-4d74-b253-023f27e662d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:57:11.255835 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-aac4d91c-2dff-4d74-b253-023f27e662d0 None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:57:11.257088 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-aac4d91c-2dff-4d74-b253-023f27e662d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:57:11.282018 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98376246-4ff8-4fc3-9b51-538c3ec94e41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:57:11.282806 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98376246-4ff8-4fc3-9b51-538c3ec94e41 admin admin] REQUEST_METHOD: `PUT` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:57:11.283612 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98376246-4ff8-4fc3-9b51-538c3ec94e41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:57:11.284054 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98376246-4ff8-4fc3-9b51-538c3ec94e41 admin admin] PATH_INFO: `/v3/projects/288269e173ae4155b5640873b0d56ec7/users/a07b5b68f1eb4ecc915bdb473989262b/roles/afb0a01183d9497795eaa4fa1a4046ae` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:57:11.298963 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=80,keystone:DELETE=17,keystone:INSERT=3 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:57:11.316418 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98376246-4ff8-4fc3-9b51-538c3ec94e41 admin admin] RBAC: Authorizing `identity:create_grant(project_id=288269e173ae4155b5640873b0d56ec7, user_id=a07b5b68f1eb4ecc915bdb473989262b, role_id=afb0a01183d9497795eaa4fa1a4046ae)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:57:11.321636 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98376246-4ff8-4fc3-9b51-538c3ec94e41 admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:57:11.346488 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1004/1986] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Oct 9 00:57:11 2022] PUT /identity/v3/projects/288269e173ae4155b5640873b0d56ec7/users/a07b5b68f1eb4ecc915bdb473989262b/roles/afb0a01183d9497795eaa4fa1a4046ae => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 00:57:11.358332 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cb4b8d-85e8-4668-bd19-1583a6e62c57 None None] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:57:11.359237 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cb4b8d-85e8-4668-bd19-1583a6e62c57 None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:57:11.360263 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cb4b8d-85e8-4668-bd19-1583a6e62c57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:57:11.370077 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 983/1987] 10.222.0.15 () {58 vars in 958 bytes} [Sun Oct 9 00:57:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 09 00:57:11.371207 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac4d91c-2dff-4d74-b253-023f27e662d0 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:57:11.373243 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-aac4d91c-2dff-4d74-b253-023f27e662d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:57:11.401540 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.auth.core [None req-09cb4b8d-85e8-4668-bd19-1583a6e62c57 None None] MFA Rules not processed for user `a07b5b68f1eb4ecc915bdb473989262b`. Rule list: `[]` (Enabled: `True`). {{(pid=81525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:57:11.402782 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-09cb4b8d-85e8-4668-bd19-1583a6e62c57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:57:11.441503 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:57:11.464525 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac4d91c-2dff-4d74-b253-023f27e662d0 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:57:11.537751 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1005/1988] 10.222.0.15 () {58 vars in 958 bytes} [Sun Oct 9 00:57:11 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 09 00:57:11.550091 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cb4b8d-85e8-4668-bd19-1583a6e62c57 None None] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:57:11.552912 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44123b67-931a-4952-8fea-78e0bd402e1f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4ef90d456d2483e8ddafbe2d4d4fb5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f148d39ced534860abfbe8fc3f98ace4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:57:11.553075 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-09cb4b8d-85e8-4668-bd19-1583a6e62c57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:57:11.553734 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44123b67-931a-4952-8fea-78e0bd402e1f service neutron] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:57:11.554146 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44123b67-931a-4952-8fea-78e0bd402e1f service neutron] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:57:11.554617 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44123b67-931a-4952-8fea-78e0bd402e1f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:57:11.640640 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cb4b8d-85e8-4668-bd19-1583a6e62c57 None None] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:57:11.645647 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb75aeb1-ba07-48b9-9b9b-0a851e3b7105 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff7cb78bcd91467abe5c2e2b48aedd1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f148d39ced534860abfbe8fc3f98ace4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:57:11.645647 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb75aeb1-ba07-48b9-9b9b-0a851e3b7105 service cinder] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:57:11.645647 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb75aeb1-ba07-48b9-9b9b-0a851e3b7105 service cinder] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:57:11.645995 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb75aeb1-ba07-48b9-9b9b-0a851e3b7105 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:57:11.655913 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb75aeb1-ba07-48b9-9b9b-0a851e3b7105 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:57:11.658574 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb75aeb1-ba07-48b9-9b9b-0a851e3b7105 service cinder] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:57:11.669480 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1006/1989] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Oct 9 00:57:11 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 09 00:57:11.675720 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44123b67-931a-4952-8fea-78e0bd402e1f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:57:11.677524 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44123b67-931a-4952-8fea-78e0bd402e1f service neutron] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:57:11.689542 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 984/1990] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Oct 9 00:57:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 09 00:57:12.080259 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb75aeb1-ba07-48b9-9b9b-0a851e3b7105 service cinder] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:57:12.081892 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-fb75aeb1-ba07-48b9-9b9b-0a851e3b7105 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:57:12.108691 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb75aeb1-ba07-48b9-9b9b-0a851e3b7105 service cinder] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:57:12.124771 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87143c7-d4ae-49d4-8d96-f3a3c74da1b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:57:12.125437 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87143c7-d4ae-49d4-8d96-f3a3c74da1b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:57:12.125876 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87143c7-d4ae-49d4-8d96-f3a3c74da1b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:57:12.126149 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87143c7-d4ae-49d4-8d96-f3a3c74da1b5 admin admin] PATH_INFO: `/v3/projects/5ded855df9a6470ba68d00680adf088f` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:57:12.127817 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87143c7-d4ae-49d4-8d96-f3a3c74da1b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5ded855df9a6470ba68d00680adf088f)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:57:12.129780 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87143c7-d4ae-49d4-8d96-f3a3c74da1b5 admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:57:12.187101 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-c87143c7-d4ae-49d4-8d96-f3a3c74da1b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ded855df9a6470ba68d00680adf088f', 'request_id': 'req-c87143c7-d4ae-49d4-8d96-f3a3c74da1b5'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:57:12.196932 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-c87143c7-d4ae-49d4-8d96-f3a3c74da1b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ded855df9a6470ba68d00680adf088f', 'request_id': 'req-c87143c7-d4ae-49d4-8d96-f3a3c74da1b5'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:57:12.204723 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-c87143c7-d4ae-49d4-8d96-f3a3c74da1b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ded855df9a6470ba68d00680adf088f', 'request_id': 'req-c87143c7-d4ae-49d4-8d96-f3a3c74da1b5'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:57:12.216036 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-c87143c7-d4ae-49d4-8d96-f3a3c74da1b5 admin admin] The token cache is being invalidate because project 5ded855df9a6470ba68d00680adf088f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81525) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 09 00:57:12.216218 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-c87143c7-d4ae-49d4-8d96-f3a3c74da1b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:57:12.216916 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-c87143c7-d4ae-49d4-8d96-f3a3c74da1b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:57:12.218528 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1007/1991] 10.222.0.15 () {58 vars in 1233 bytes} [Sun Oct 9 00:57:12 2022] DELETE /identity/v3/projects/5ded855df9a6470ba68d00680adf088f => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 09 00:57:12.222505 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44123b67-931a-4952-8fea-78e0bd402e1f service neutron] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:57:12.232464 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44123b67-931a-4952-8fea-78e0bd402e1f service neutron] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:57:12.262753 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:57:12.292585 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0b7b77-9735-44a7-9572-53c7b3f45dd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:57:12.293273 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0b7b77-9735-44a7-9572-53c7b3f45dd1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:57:12.293521 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0b7b77-9735-44a7-9572-53c7b3f45dd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:57:12.293872 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0b7b77-9735-44a7-9572-53c7b3f45dd1 admin admin] PATH_INFO: `/v3/users/40cfec8f068e43b0b1dd625b844689c5` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:57:12.295225 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0b7b77-9735-44a7-9572-53c7b3f45dd1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=40cfec8f068e43b0b1dd625b844689c5)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:57:12.297452 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0b7b77-9735-44a7-9572-53c7b3f45dd1 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:57:12.350472 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-ed0b7b77-9735-44a7-9572-53c7b3f45dd1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '40cfec8f068e43b0b1dd625b844689c5'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:57:12.357833 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-ed0b7b77-9735-44a7-9572-53c7b3f45dd1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '40cfec8f068e43b0b1dd625b844689c5'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:57:12.358573 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-ed0b7b77-9735-44a7-9572-53c7b3f45dd1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '40cfec8f068e43b0b1dd625b844689c5'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:57:12.359162 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-ed0b7b77-9735-44a7-9572-53c7b3f45dd1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '40cfec8f068e43b0b1dd625b844689c5'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:57:12.369880 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-ed0b7b77-9735-44a7-9572-53c7b3f45dd1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '40cfec8f068e43b0b1dd625b844689c5'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:57:12.390727 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 985/1992] 10.222.0.15 () {58 vars in 1224 bytes} [Sun Oct 9 00:57:12 2022] DELETE /identity/v3/users/40cfec8f068e43b0b1dd625b844689c5 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 09 00:57:12.647002 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87143c7-d4ae-49d4-8d96-f3a3c74da1b5 admin admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:57:12.648524 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-c87143c7-d4ae-49d4-8d96-f3a3c74da1b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:57:12.662742 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87143c7-d4ae-49d4-8d96-f3a3c74da1b5 admin admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:57:12.719985 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:57:12.739244 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e762a396-b422-4a23-8ffb-c67d79e5f204 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:57:12.740124 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e762a396-b422-4a23-8ffb-c67d79e5f204 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:57:12.740407 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e762a396-b422-4a23-8ffb-c67d79e5f204 admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:57:12.740780 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e762a396-b422-4a23-8ffb-c67d79e5f204 admin admin] PATH_INFO: `/v3/users/236673cdba0f4288a58a015e985bab3d` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:57:12.745039 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e762a396-b422-4a23-8ffb-c67d79e5f204 admin admin] RBAC: Authorizing `identity:delete_user(user_id=236673cdba0f4288a58a015e985bab3d)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:57:12.745039 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e762a396-b422-4a23-8ffb-c67d79e5f204 admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:57:12.746282 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0b7b77-9735-44a7-9572-53c7b3f45dd1 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:57:12.748091 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-ed0b7b77-9735-44a7-9572-53c7b3f45dd1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:57:12.776293 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0b7b77-9735-44a7-9572-53c7b3f45dd1 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:57:12.784636 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5415c0e0-09e5-421e-92b0-e1c786ef7ab1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:57:12.785518 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5415c0e0-09e5-421e-92b0-e1c786ef7ab1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:57:12.786242 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5415c0e0-09e5-421e-92b0-e1c786ef7ab1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:57:12.786676 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5415c0e0-09e5-421e-92b0-e1c786ef7ab1 admin admin] PATH_INFO: `/v3/projects/51c10334a89f4f3fb754cc89ecc9af25` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:57:12.788612 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5415c0e0-09e5-421e-92b0-e1c786ef7ab1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=51c10334a89f4f3fb754cc89ecc9af25)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:57:12.791237 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5415c0e0-09e5-421e-92b0-e1c786ef7ab1 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:57:12.813038 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-e762a396-b422-4a23-8ffb-c67d79e5f204 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '236673cdba0f4288a58a015e985bab3d'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:57:12.821623 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-e762a396-b422-4a23-8ffb-c67d79e5f204 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '236673cdba0f4288a58a015e985bab3d'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:57:12.823005 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-e762a396-b422-4a23-8ffb-c67d79e5f204 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '236673cdba0f4288a58a015e985bab3d'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:57:12.823842 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-e762a396-b422-4a23-8ffb-c67d79e5f204 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '236673cdba0f4288a58a015e985bab3d'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:57:12.837006 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-e762a396-b422-4a23-8ffb-c67d79e5f204 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '236673cdba0f4288a58a015e985bab3d'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:57:12.863776 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-5415c0e0-09e5-421e-92b0-e1c786ef7ab1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '51c10334a89f4f3fb754cc89ecc9af25', 'request_id': 'req-5415c0e0-09e5-421e-92b0-e1c786ef7ab1'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:57:12.871295 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1008/1993] 10.222.0.15 () {58 vars in 1224 bytes} [Sun Oct 9 00:57:12 2022] DELETE /identity/v3/users/236673cdba0f4288a58a015e985bab3d => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 00:57:12.876463 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4471d15f-4f1a-4af6-84af-3ff00bd31216 None None] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:57:12.877598 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-5415c0e0-09e5-421e-92b0-e1c786ef7ab1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '51c10334a89f4f3fb754cc89ecc9af25', 'request_id': 'req-5415c0e0-09e5-421e-92b0-e1c786ef7ab1'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:57:12.879084 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4471d15f-4f1a-4af6-84af-3ff00bd31216 None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:57:12.879502 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4471d15f-4f1a-4af6-84af-3ff00bd31216 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:57:12.888335 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-5415c0e0-09e5-421e-92b0-e1c786ef7ab1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '51c10334a89f4f3fb754cc89ecc9af25', 'request_id': 'req-5415c0e0-09e5-421e-92b0-e1c786ef7ab1'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:57:12.900326 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-5415c0e0-09e5-421e-92b0-e1c786ef7ab1 admin admin] The token cache is being invalidate because project 51c10334a89f4f3fb754cc89ecc9af25 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81524) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 09 00:57:12.900617 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-5415c0e0-09e5-421e-92b0-e1c786ef7ab1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:57:12.901233 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.auth.core [None req-4471d15f-4f1a-4af6-84af-3ff00bd31216 None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:57:12.901670 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-5415c0e0-09e5-421e-92b0-e1c786ef7ab1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:57:12.902448 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-4471d15f-4f1a-4af6-84af-3ff00bd31216 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:57:12.903860 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 986/1994] 10.222.0.15 () {58 vars in 1233 bytes} [Sun Oct 9 00:57:12 2022] DELETE /identity/v3/projects/51c10334a89f4f3fb754cc89ecc9af25 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 00:57:12.908128 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5415c0e0-09e5-421e-92b0-e1c786ef7ab1 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:57:12.909791 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-5415c0e0-09e5-421e-92b0-e1c786ef7ab1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:57:12.951378 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:57:12.975477 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1009/1995] 10.222.0.15 () {58 vars in 958 bytes} [Sun Oct 9 00:57:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:57:12.985080 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4471d15f-4f1a-4af6-84af-3ff00bd31216 None None] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:57:12.986726 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-4471d15f-4f1a-4af6-84af-3ff00bd31216 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:57:12.988020 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5415c0e0-09e5-421e-92b0-e1c786ef7ab1 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:57:12.993152 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf56619-3dec-44ff-a5d4-899429c0b902 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:57:12.993800 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf56619-3dec-44ff-a5d4-899429c0b902 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:57:12.994076 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf56619-3dec-44ff-a5d4-899429c0b902 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:57:12.994340 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf56619-3dec-44ff-a5d4-899429c0b902 admin admin] PATH_INFO: `/v3/users/ecca31cf77d7485ba734e58f15fbd292` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:57:12.995519 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf56619-3dec-44ff-a5d4-899429c0b902 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ecca31cf77d7485ba734e58f15fbd292)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:57:12.997824 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf56619-3dec-44ff-a5d4-899429c0b902 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:57:13.066562 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-4bf56619-3dec-44ff-a5d4-899429c0b902 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ecca31cf77d7485ba734e58f15fbd292'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:57:13.075149 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-4bf56619-3dec-44ff-a5d4-899429c0b902 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ecca31cf77d7485ba734e58f15fbd292'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:57:13.075758 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4471d15f-4f1a-4af6-84af-3ff00bd31216 None None] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:57:13.076071 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-4bf56619-3dec-44ff-a5d4-899429c0b902 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ecca31cf77d7485ba734e58f15fbd292'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:57:13.076795 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-4bf56619-3dec-44ff-a5d4-899429c0b902 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ecca31cf77d7485ba734e58f15fbd292'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:57:13.079684 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dca05b-e10e-4639-b910-0edba0fd8b54 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4ef90d456d2483e8ddafbe2d4d4fb5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f148d39ced534860abfbe8fc3f98ace4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:57:13.080777 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dca05b-e10e-4639-b910-0edba0fd8b54 service neutron] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:57:13.081501 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dca05b-e10e-4639-b910-0edba0fd8b54 service neutron] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:57:13.082688 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dca05b-e10e-4639-b910-0edba0fd8b54 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:57:13.085491 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-59dca05b-e10e-4639-b910-0edba0fd8b54 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:57:13.088147 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-4bf56619-3dec-44ff-a5d4-899429c0b902 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ecca31cf77d7485ba734e58f15fbd292'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:57:13.108061 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59dca05b-e10e-4639-b910-0edba0fd8b54 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:57:13.110025 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59dca05b-e10e-4639-b910-0edba0fd8b54 service neutron] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:57:13.111581 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 987/1996] 10.222.0.15 () {58 vars in 1224 bytes} [Sun Oct 9 00:57:12 2022] DELETE /identity/v3/users/ecca31cf77d7485ba734e58f15fbd292 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 00:57:13.122647 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1010/1997] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Oct 9 00:57:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 09 00:57:13.528110 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf56619-3dec-44ff-a5d4-899429c0b902 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:57:13.531520 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-4bf56619-3dec-44ff-a5d4-899429c0b902 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:57:13.652156 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf56619-3dec-44ff-a5d4-899429c0b902 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:57:13.657595 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc81fee-c63f-4aa6-9f89-cdd48c214302 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:57:13.658548 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc81fee-c63f-4aa6-9f89-cdd48c214302 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:57:13.658970 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc81fee-c63f-4aa6-9f89-cdd48c214302 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:57:13.659414 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc81fee-c63f-4aa6-9f89-cdd48c214302 admin admin] PATH_INFO: `/v3/projects/35200ad5507d48999bb11aafaa5bfcef` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:57:13.660797 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc81fee-c63f-4aa6-9f89-cdd48c214302 admin admin] RBAC: Authorizing `identity:delete_project(project_id=35200ad5507d48999bb11aafaa5bfcef)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:57:13.662971 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc81fee-c63f-4aa6-9f89-cdd48c214302 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:57:13.726961 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-bcc81fee-c63f-4aa6-9f89-cdd48c214302 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '35200ad5507d48999bb11aafaa5bfcef', 'request_id': 'req-bcc81fee-c63f-4aa6-9f89-cdd48c214302'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:57:13.731650 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:57:13.755166 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-bcc81fee-c63f-4aa6-9f89-cdd48c214302 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '35200ad5507d48999bb11aafaa5bfcef', 'request_id': 'req-bcc81fee-c63f-4aa6-9f89-cdd48c214302'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:57:13.778081 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-bcc81fee-c63f-4aa6-9f89-cdd48c214302 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '35200ad5507d48999bb11aafaa5bfcef', 'request_id': 'req-bcc81fee-c63f-4aa6-9f89-cdd48c214302'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:57:13.792476 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-bcc81fee-c63f-4aa6-9f89-cdd48c214302 admin admin] The token cache is being invalidate because project 35200ad5507d48999bb11aafaa5bfcef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81524) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 09 00:57:13.792766 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-bcc81fee-c63f-4aa6-9f89-cdd48c214302 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:57:13.793515 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-bcc81fee-c63f-4aa6-9f89-cdd48c214302 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:57:13.799832 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 988/1998] 10.222.0.15 () {58 vars in 1233 bytes} [Sun Oct 9 00:57:13 2022] DELETE /identity/v3/projects/35200ad5507d48999bb11aafaa5bfcef => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 00:57:13.800901 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d670ea3e-497a-422d-b64e-78aff05e6f22 None None] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:57:13.801367 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d670ea3e-497a-422d-b64e-78aff05e6f22 None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:57:13.801443 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d670ea3e-497a-422d-b64e-78aff05e6f22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:57:13.842019 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.auth.core [None req-d670ea3e-497a-422d-b64e-78aff05e6f22 None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:57:13.844537 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-d670ea3e-497a-422d-b64e-78aff05e6f22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:57:13.851583 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:57:13.935092 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc81fee-c63f-4aa6-9f89-cdd48c214302 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:57:13.936652 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-bcc81fee-c63f-4aa6-9f89-cdd48c214302 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:57:13.946424 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1011/1999] 10.222.0.15 () {58 vars in 958 bytes} [Sun Oct 9 00:57:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 09 00:57:13.948489 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381efa57-3e46-4917-8df2-258b28364c1b None None] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:57:13.948775 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381efa57-3e46-4917-8df2-258b28364c1b None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:57:13.949048 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381efa57-3e46-4917-8df2-258b28364c1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:57:13.955158 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc81fee-c63f-4aa6-9f89-cdd48c214302 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:57:13.961563 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e1de25-b809-49a4-b0da-8cf49fa53a62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:57:13.962286 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e1de25-b809-49a4-b0da-8cf49fa53a62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:57:13.962688 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e1de25-b809-49a4-b0da-8cf49fa53a62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:57:13.962947 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e1de25-b809-49a4-b0da-8cf49fa53a62 admin admin] PATH_INFO: `/v3/projects/6e2becab454c4065b275611633476be9` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:57:13.964197 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e1de25-b809-49a4-b0da-8cf49fa53a62 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6e2becab454c4065b275611633476be9)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:57:13.966978 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e1de25-b809-49a4-b0da-8cf49fa53a62 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:57:13.979071 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.auth.core [None req-381efa57-3e46-4917-8df2-258b28364c1b None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:57:13.980779 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-381efa57-3e46-4917-8df2-258b28364c1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:57:13.990811 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1012/2000] 10.222.0.15 () {58 vars in 958 bytes} [Sun Oct 9 00:57:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:57:13.995239 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381efa57-3e46-4917-8df2-258b28364c1b None None] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:57:14.005784 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381efa57-3e46-4917-8df2-258b28364c1b None None] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:57:14.010782 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471cc20e-4e86-473e-948d-f3132e95e90c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:57:14.011582 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471cc20e-4e86-473e-948d-f3132e95e90c admin admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:57:14.011922 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471cc20e-4e86-473e-948d-f3132e95e90c admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:57:14.012256 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471cc20e-4e86-473e-948d-f3132e95e90c admin admin] PATH_INFO: `/v3/domains` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:57:14.012978 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471cc20e-4e86-473e-948d-f3132e95e90c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:57:14.013338 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471cc20e-4e86-473e-948d-f3132e95e90c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:57:14.015028 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471cc20e-4e86-473e-948d-f3132e95e90c admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:57:14.023503 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-c8e1de25-b809-49a4-b0da-8cf49fa53a62 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e2becab454c4065b275611633476be9', 'request_id': 'req-c8e1de25-b809-49a4-b0da-8cf49fa53a62'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:57:14.029667 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1013/2001] 10.222.0.15 () {58 vars in 1153 bytes} [Sun Oct 9 00:57:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 09 00:57:14.033087 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471cc20e-4e86-473e-948d-f3132e95e90c admin admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:57:14.035310 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-c8e1de25-b809-49a4-b0da-8cf49fa53a62 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e2becab454c4065b275611633476be9', 'request_id': 'req-c8e1de25-b809-49a4-b0da-8cf49fa53a62'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:57:14.046924 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471cc20e-4e86-473e-948d-f3132e95e90c admin admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:57:14.050338 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-c8e1de25-b809-49a4-b0da-8cf49fa53a62 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e2becab454c4065b275611633476be9', 'request_id': 'req-c8e1de25-b809-49a4-b0da-8cf49fa53a62'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:57:14.066567 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-c8e1de25-b809-49a4-b0da-8cf49fa53a62 admin admin] The token cache is being invalidate because project 6e2becab454c4065b275611633476be9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81524) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 09 00:57:14.066956 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-c8e1de25-b809-49a4-b0da-8cf49fa53a62 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:57:14.068468 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-c8e1de25-b809-49a4-b0da-8cf49fa53a62 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:57:14.070271 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 989/2002] 10.222.0.15 () {58 vars in 1233 bytes} [Sun Oct 9 00:57:13 2022] DELETE /identity/v3/projects/6e2becab454c4065b275611633476be9 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 00:57:14.075706 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07506c55-26d2-4997-ac45-e0d9271c462b None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:57:14.076089 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07506c55-26d2-4997-ac45-e0d9271c462b None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:57:14.076431 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07506c55-26d2-4997-ac45-e0d9271c462b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:57:14.103626 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-07506c55-26d2-4997-ac45-e0d9271c462b None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:57:14.105769 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-07506c55-26d2-4997-ac45-e0d9271c462b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:57:14.125799 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15926406-f61d-4c7c-92b5-99ca8334e19a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:57:14.127729 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15926406-f61d-4c7c-92b5-99ca8334e19a admin admin] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:57:14.128208 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15926406-f61d-4c7c-92b5-99ca8334e19a admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:57:14.128751 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15926406-f61d-4c7c-92b5-99ca8334e19a admin admin] PATH_INFO: `/v3/projects` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:57:14.130545 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15926406-f61d-4c7c-92b5-99ca8334e19a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:57:14.134214 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15926406-f61d-4c7c-92b5-99ca8334e19a admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:57:14.183434 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1014/2003] 10.222.0.15 () {60 vars in 1153 bytes} [Sun Oct 9 00:57:14 2022] POST /identity/v3/projects => generated 383 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 09 00:57:14.186213 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 990/2004] 10.222.0.15 () {58 vars in 958 bytes} [Sun Oct 9 00:57:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:57:14.186359 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15926406-f61d-4c7c-92b5-99ca8334e19a admin admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:57:14.187975 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-15926406-f61d-4c7c-92b5-99ca8334e19a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:57:14.195321 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dc742e-d8fe-45dc-8f1d-1da7f0c95d7c None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:57:14.196827 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dc742e-d8fe-45dc-8f1d-1da7f0c95d7c None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:57:14.197285 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dc742e-d8fe-45dc-8f1d-1da7f0c95d7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:57:14.221616 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-86dc742e-d8fe-45dc-8f1d-1da7f0c95d7c None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:57:14.223584 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-86dc742e-d8fe-45dc-8f1d-1da7f0c95d7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:57:14.279776 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15926406-f61d-4c7c-92b5-99ca8334e19a admin admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:57:14.284969 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7978f575-0b9f-4e6b-93fb-9dcbbf4621f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:57:14.285731 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7978f575-0b9f-4e6b-93fb-9dcbbf4621f5 admin admin] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:57:14.286032 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7978f575-0b9f-4e6b-93fb-9dcbbf4621f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:57:14.286315 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7978f575-0b9f-4e6b-93fb-9dcbbf4621f5 admin admin] PATH_INFO: `/v3/users` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:57:14.286981 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7978f575-0b9f-4e6b-93fb-9dcbbf4621f5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:57:14.289239 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7978f575-0b9f-4e6b-93fb-9dcbbf4621f5 admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:57:14.319131 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 991/2005] 10.222.0.15 () {58 vars in 958 bytes} [Sun Oct 9 00:57:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 09 00:57:14.322412 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1015/2006] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Oct 9 00:57:14 2022] POST /identity/v3/users => generated 292 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 09 00:57:14.322919 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dc742e-d8fe-45dc-8f1d-1da7f0c95d7c None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:57:14.326562 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7978f575-0b9f-4e6b-93fb-9dcbbf4621f5 admin admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:57:14.333918 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:57:14.334805 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dc742e-d8fe-45dc-8f1d-1da7f0c95d7c None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:57:14.340577 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7978f575-0b9f-4e6b-93fb-9dcbbf4621f5 admin admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:57:14.341978 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85aae63-9519-43c7-b6f7-58afe053a859 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:57:14.342816 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85aae63-9519-43c7-b6f7-58afe053a859 admin admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:57:14.343131 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85aae63-9519-43c7-b6f7-58afe053a859 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:57:14.343450 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85aae63-9519-43c7-b6f7-58afe053a859 admin admin] PATH_INFO: `/v3/domains` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:57:14.344441 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85aae63-9519-43c7-b6f7-58afe053a859 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:57:14.344918 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85aae63-9519-43c7-b6f7-58afe053a859 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:57:14.346552 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85aae63-9519-43c7-b6f7-58afe053a859 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:57:14.348339 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:57:14.348570 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25501b8f-6f2f-431d-95e7-9a31d15604f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:57:14.350325 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25501b8f-6f2f-431d-95e7-9a31d15604f4 admin admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:57:14.350847 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25501b8f-6f2f-431d-95e7-9a31d15604f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:57:14.351372 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25501b8f-6f2f-431d-95e7-9a31d15604f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:57:14.352255 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25501b8f-6f2f-431d-95e7-9a31d15604f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:57:14.354229 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25501b8f-6f2f-431d-95e7-9a31d15604f4 admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:57:14.367462 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 992/2007] 10.222.0.15 () {58 vars in 1153 bytes} [Sun Oct 9 00:57:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:57:14.371590 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85aae63-9519-43c7-b6f7-58afe053a859 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:57:14.381382 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1016/2008] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Oct 9 00:57:14 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 09 00:57:14.385833 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25501b8f-6f2f-431d-95e7-9a31d15604f4 admin admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:57:14.387110 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85aae63-9519-43c7-b6f7-58afe053a859 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:57:14.392223 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ead3d3-f477-439d-9afa-b58f2ae14aed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:57:14.392849 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ead3d3-f477-439d-9afa-b58f2ae14aed admin admin] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:57:14.393155 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ead3d3-f477-439d-9afa-b58f2ae14aed admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:57:14.393384 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ead3d3-f477-439d-9afa-b58f2ae14aed admin admin] PATH_INFO: `/v3/projects` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:57:14.394503 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ead3d3-f477-439d-9afa-b58f2ae14aed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:57:14.398861 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25501b8f-6f2f-431d-95e7-9a31d15604f4 admin admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:57:14.398972 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ead3d3-f477-439d-9afa-b58f2ae14aed admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:57:14.403801 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ead9bf6-296e-49e2-b1a1-3b6313bc62e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:57:14.404438 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ead9bf6-296e-49e2-b1a1-3b6313bc62e0 admin admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:57:14.404702 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ead9bf6-296e-49e2-b1a1-3b6313bc62e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:57:14.404966 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ead9bf6-296e-49e2-b1a1-3b6313bc62e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:57:14.405621 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ead9bf6-296e-49e2-b1a1-3b6313bc62e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:57:14.407505 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ead9bf6-296e-49e2-b1a1-3b6313bc62e0 admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:57:14.419835 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1017/2009] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Oct 9 00:57:14 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 09 00:57:14.424337 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ead9bf6-296e-49e2-b1a1-3b6313bc62e0 admin admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:57:14.435849 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 993/2010] 10.222.0.15 () {60 vars in 1153 bytes} [Sun Oct 9 00:57:14 2022] POST /identity/v3/projects => generated 359 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 09 00:57:14.439964 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ead3d3-f477-439d-9afa-b58f2ae14aed admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:57:14.448755 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ead9bf6-296e-49e2-b1a1-3b6313bc62e0 admin admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:57:14.560023 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701f9cc3-2169-44b0-8e9f-aab50fba59c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:57:14.560707 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701f9cc3-2169-44b0-8e9f-aab50fba59c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:57:14.560995 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701f9cc3-2169-44b0-8e9f-aab50fba59c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:57:14.561255 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701f9cc3-2169-44b0-8e9f-aab50fba59c3 admin admin] PATH_INFO: `/v3/projects/e0ba27e2890246dabe6086698d4787ef/users/db1857277e4f48a598b69b8ea4c15ac3/roles/afb0a01183d9497795eaa4fa1a4046ae` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:57:14.577986 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ead3d3-f477-439d-9afa-b58f2ae14aed admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:57:14.588997 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd997f6-5420-4f20-b07a-37ea0080e79d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:57:14.590391 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd997f6-5420-4f20-b07a-37ea0080e79d admin admin] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:57:14.590655 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701f9cc3-2169-44b0-8e9f-aab50fba59c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e0ba27e2890246dabe6086698d4787ef, user_id=db1857277e4f48a598b69b8ea4c15ac3, role_id=afb0a01183d9497795eaa4fa1a4046ae)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:57:14.590955 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd997f6-5420-4f20-b07a-37ea0080e79d admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:57:14.591235 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd997f6-5420-4f20-b07a-37ea0080e79d admin admin] PATH_INFO: `/v3/users` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:57:14.592261 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd997f6-5420-4f20-b07a-37ea0080e79d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:57:14.593553 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701f9cc3-2169-44b0-8e9f-aab50fba59c3 admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:57:14.595028 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd997f6-5420-4f20-b07a-37ea0080e79d admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:57:14.622539 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1018/2011] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Oct 9 00:57:14 2022] PUT /identity/v3/projects/e0ba27e2890246dabe6086698d4787ef/users/db1857277e4f48a598b69b8ea4c15ac3/roles/afb0a01183d9497795eaa4fa1a4046ae => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 09 00:57:14.627443 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8aefbb-9c09-4fe2-82c9-b700e3a9cf1b None None] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:57:14.627843 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8aefbb-9c09-4fe2-82c9-b700e3a9cf1b None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:57:14.628208 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8aefbb-9c09-4fe2-82c9-b700e3a9cf1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:57:14.640253 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 994/2012] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Oct 9 00:57:14 2022] POST /identity/v3/users => generated 280 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 09 00:57:14.644238 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd997f6-5420-4f20-b07a-37ea0080e79d admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:57:14.659758 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.auth.core [None req-8e8aefbb-9c09-4fe2-82c9-b700e3a9cf1b None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:57:14.661585 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-8e8aefbb-9c09-4fe2-82c9-b700e3a9cf1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:57:14.663139 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd997f6-5420-4f20-b07a-37ea0080e79d admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:57:14.781843 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4513b0-61b8-4f6f-84e4-d75bdb06084d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:57:14.782631 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4513b0-61b8-4f6f-84e4-d75bdb06084d admin admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:57:14.782913 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4513b0-61b8-4f6f-84e4-d75bdb06084d admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:57:14.783185 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4513b0-61b8-4f6f-84e4-d75bdb06084d admin admin] PATH_INFO: `/v3/roles` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:57:14.784619 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4513b0-61b8-4f6f-84e4-d75bdb06084d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:57:14.786976 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4513b0-61b8-4f6f-84e4-d75bdb06084d admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:57:14.796738 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1019/2013] 10.222.0.15 () {58 vars in 958 bytes} [Sun Oct 9 00:57:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 09 00:57:14.817290 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8aefbb-9c09-4fe2-82c9-b700e3a9cf1b None None] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:57:14.821440 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-8e8aefbb-9c09-4fe2-82c9-b700e3a9cf1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:57:14.833354 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 995/2014] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Oct 9 00:57:14 2022] GET /identity/v3/roles => generated 1420 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 09 00:57:14.834582 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4513b0-61b8-4f6f-84e4-d75bdb06084d admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:57:14.849773 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4513b0-61b8-4f6f-84e4-d75bdb06084d admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:57:14.856889 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40c3314-ba00-400c-abcf-5077584e3d71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:57:14.857603 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40c3314-ba00-400c-abcf-5077584e3d71 admin admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:57:14.857878 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40c3314-ba00-400c-abcf-5077584e3d71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:57:14.858149 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40c3314-ba00-400c-abcf-5077584e3d71 admin admin] PATH_INFO: `/v3/roles` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:57:14.858899 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40c3314-ba00-400c-abcf-5077584e3d71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:57:14.865313 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40c3314-ba00-400c-abcf-5077584e3d71 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:57:14.894459 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 996/2015] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Oct 9 00:57:14 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 09 00:57:14.899473 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40c3314-ba00-400c-abcf-5077584e3d71 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:57:14.923899 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40c3314-ba00-400c-abcf-5077584e3d71 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:57:14.936135 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b677e2a2-667b-48ba-96b0-93c039574780 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:57:14.936815 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b677e2a2-667b-48ba-96b0-93c039574780 admin admin] REQUEST_METHOD: `PUT` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:57:14.937470 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b677e2a2-667b-48ba-96b0-93c039574780 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:57:14.937470 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b677e2a2-667b-48ba-96b0-93c039574780 admin admin] PATH_INFO: `/v3/projects/c86058caac0745d4b438fb867c124263/users/bbb524afeac44dfabd87649ad48ba53b/roles/afb0a01183d9497795eaa4fa1a4046ae` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:57:14.945489 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8aefbb-9c09-4fe2-82c9-b700e3a9cf1b None None] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:57:14.950418 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b1a370-07f2-4e34-9f02-05e1b8d5d983 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4ef90d456d2483e8ddafbe2d4d4fb5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f148d39ced534860abfbe8fc3f98ace4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:57:14.951053 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b1a370-07f2-4e34-9f02-05e1b8d5d983 service neutron] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:57:14.951371 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b1a370-07f2-4e34-9f02-05e1b8d5d983 service neutron] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:57:14.951641 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b1a370-07f2-4e34-9f02-05e1b8d5d983 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:57:14.961867 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b1a370-07f2-4e34-9f02-05e1b8d5d983 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:57:14.963733 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b1a370-07f2-4e34-9f02-05e1b8d5d983 service neutron] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:57:14.966889 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b677e2a2-667b-48ba-96b0-93c039574780 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c86058caac0745d4b438fb867c124263, user_id=bbb524afeac44dfabd87649ad48ba53b, role_id=afb0a01183d9497795eaa4fa1a4046ae)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:57:14.970106 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b677e2a2-667b-48ba-96b0-93c039574780 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:57:14.976775 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1020/2016] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Oct 9 00:57:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 09 00:57:15.005573 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 997/2017] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Oct 9 00:57:14 2022] PUT /identity/v3/projects/c86058caac0745d4b438fb867c124263/users/bbb524afeac44dfabd87649ad48ba53b/roles/afb0a01183d9497795eaa4fa1a4046ae => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 00:57:15.016810 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255339ed-283f-4800-b842-189c3b9cf9d6 None None] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:57:15.017296 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255339ed-283f-4800-b842-189c3b9cf9d6 None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:57:15.017578 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255339ed-283f-4800-b842-189c3b9cf9d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:57:15.057404 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:57:15.097383 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.auth.core [None req-255339ed-283f-4800-b842-189c3b9cf9d6 None None] MFA Rules not processed for user `bbb524afeac44dfabd87649ad48ba53b`. Rule list: `[]` (Enabled: `True`). {{(pid=81525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:57:15.098951 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-255339ed-283f-4800-b842-189c3b9cf9d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:57:15.221445 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1021/2018] 10.222.0.15 () {58 vars in 958 bytes} [Sun Oct 9 00:57:15 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:57:15.261650 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b677e2a2-667b-48ba-96b0-93c039574780 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:57:15.264187 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-b677e2a2-667b-48ba-96b0-93c039574780 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:57:15.303540 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:57:15.389416 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b677e2a2-667b-48ba-96b0-93c039574780 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:57:15.399981 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6b4728-f292-4e7e-8264-e79f109f88bf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff7cb78bcd91467abe5c2e2b48aedd1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f148d39ced534860abfbe8fc3f98ace4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:57:15.400826 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6b4728-f292-4e7e-8264-e79f109f88bf service cinder] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:57:15.401357 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6b4728-f292-4e7e-8264-e79f109f88bf service cinder] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:57:15.401526 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6b4728-f292-4e7e-8264-e79f109f88bf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:57:15.416136 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6b4728-f292-4e7e-8264-e79f109f88bf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:57:15.417681 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6b4728-f292-4e7e-8264-e79f109f88bf service cinder] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:57:15.438819 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 998/2019] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Oct 9 00:57:15 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 09 00:57:15.468602 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255339ed-283f-4800-b842-189c3b9cf9d6 None None] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:57:15.567248 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255339ed-283f-4800-b842-189c3b9cf9d6 None None] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:57:15.572886 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0648ff9f-6c7e-4e43-87ac-aa59e854fe85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:57:15.573803 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0648ff9f-6c7e-4e43-87ac-aa59e854fe85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:57:15.574015 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0648ff9f-6c7e-4e43-87ac-aa59e854fe85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:57:15.574295 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0648ff9f-6c7e-4e43-87ac-aa59e854fe85 admin admin] PATH_INFO: `/v3/users/bbb524afeac44dfabd87649ad48ba53b` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:57:15.575483 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0648ff9f-6c7e-4e43-87ac-aa59e854fe85 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bbb524afeac44dfabd87649ad48ba53b)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:57:15.577536 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0648ff9f-6c7e-4e43-87ac-aa59e854fe85 admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:57:15.635709 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-0648ff9f-6c7e-4e43-87ac-aa59e854fe85 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bbb524afeac44dfabd87649ad48ba53b'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:57:15.654099 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-0648ff9f-6c7e-4e43-87ac-aa59e854fe85 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bbb524afeac44dfabd87649ad48ba53b'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:57:15.664276 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-0648ff9f-6c7e-4e43-87ac-aa59e854fe85 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bbb524afeac44dfabd87649ad48ba53b'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:57:15.668059 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-0648ff9f-6c7e-4e43-87ac-aa59e854fe85 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bbb524afeac44dfabd87649ad48ba53b'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:57:15.678628 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-0648ff9f-6c7e-4e43-87ac-aa59e854fe85 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bbb524afeac44dfabd87649ad48ba53b'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:57:15.704384 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1022/2020] 10.222.0.15 () {58 vars in 1224 bytes} [Sun Oct 9 00:57:15 2022] DELETE /identity/v3/users/bbb524afeac44dfabd87649ad48ba53b => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 00:57:15.706286 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bafbd1-f7ed-41c4-abc6-51fdac5440d7 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:57:15.706572 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bafbd1-f7ed-41c4-abc6-51fdac5440d7 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:57:15.706844 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bafbd1-f7ed-41c4-abc6-51fdac5440d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:57:15.727013 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-88bafbd1-f7ed-41c4-abc6-51fdac5440d7 None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:57:15.728278 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-88bafbd1-f7ed-41c4-abc6-51fdac5440d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:57:15.755115 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d8524d-492e-4883-8504-3b644a428ec4 None None] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:57:15.755589 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d8524d-492e-4883-8504-3b644a428ec4 None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:57:15.756123 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d8524d-492e-4883-8504-3b644a428ec4 None None] PATH_INFO: `/` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:57:15.757825 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1023/2021] 10.222.0.15 () {54 vars in 921 bytes} [Sun Oct 9 00:57:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 09 00:57:15.771378 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d5047d-f106-47d5-b63c-612834b1cb01 None None] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:57:15.772000 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d5047d-f106-47d5-b63c-612834b1cb01 None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:57:15.772460 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d5047d-f106-47d5-b63c-612834b1cb01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:57:15.811782 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.auth.core [None req-b3d5047d-f106-47d5-b63c-612834b1cb01 None None] MFA Rules not processed for user `64be9d44437e4247a72334b9bab3cdd3`. Rule list: `[]` (Enabled: `True`). {{(pid=81525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:57:15.813213 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-b3d5047d-f106-47d5-b63c-612834b1cb01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:57:15.847250 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:57:15.864069 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 999/2022] 10.222.0.15 () {58 vars in 958 bytes} [Sun Oct 9 00:57:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:57:15.883314 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bafbd1-f7ed-41c4-abc6-51fdac5440d7 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:57:15.884881 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-88bafbd1-f7ed-41c4-abc6-51fdac5440d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:57:15.898970 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bafbd1-f7ed-41c4-abc6-51fdac5440d7 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:57:15.906329 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82fab52-2226-4c43-9675-f3dfe9c29d34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:57:15.907183 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82fab52-2226-4c43-9675-f3dfe9c29d34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:57:15.907580 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82fab52-2226-4c43-9675-f3dfe9c29d34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:57:15.908092 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82fab52-2226-4c43-9675-f3dfe9c29d34 admin admin] PATH_INFO: `/v3/users/08d6c41fef5c467e9826e5eabbbccc65` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:57:15.909535 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82fab52-2226-4c43-9675-f3dfe9c29d34 admin admin] RBAC: Authorizing `identity:delete_user(user_id=08d6c41fef5c467e9826e5eabbbccc65)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:57:15.912383 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1024/2023] 10.222.0.15 () {58 vars in 1018 bytes} [Sun Oct 9 00:57:15 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:57:15.912528 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82fab52-2226-4c43-9675-f3dfe9c29d34 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:57:15.913309 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d5047d-f106-47d5-b63c-612834b1cb01 None None] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:57:15.914635 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-b3d5047d-f106-47d5-b63c-612834b1cb01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:57:16.012576 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-d82fab52-2226-4c43-9675-f3dfe9c29d34 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '08d6c41fef5c467e9826e5eabbbccc65'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:57:16.023121 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-d82fab52-2226-4c43-9675-f3dfe9c29d34 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '08d6c41fef5c467e9826e5eabbbccc65'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:57:16.023881 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-d82fab52-2226-4c43-9675-f3dfe9c29d34 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '08d6c41fef5c467e9826e5eabbbccc65'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:57:16.024490 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-d82fab52-2226-4c43-9675-f3dfe9c29d34 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '08d6c41fef5c467e9826e5eabbbccc65'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:57:16.034824 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-d82fab52-2226-4c43-9675-f3dfe9c29d34 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '08d6c41fef5c467e9826e5eabbbccc65'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:57:16.036560 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d5047d-f106-47d5-b63c-612834b1cb01 None None] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:57:16.041806 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e62d5e9-8657-4753-990f-f5246297f52d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4ef90d456d2483e8ddafbe2d4d4fb5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f148d39ced534860abfbe8fc3f98ace4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:57:16.042509 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e62d5e9-8657-4753-990f-f5246297f52d service neutron] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:57:16.042850 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e62d5e9-8657-4753-990f-f5246297f52d service neutron] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:57:16.043181 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e62d5e9-8657-4753-990f-f5246297f52d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:57:16.045106 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-3e62d5e9-8657-4753-990f-f5246297f52d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:57:16.061486 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e62d5e9-8657-4753-990f-f5246297f52d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:57:16.066392 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1000/2024] 10.222.0.15 () {58 vars in 1224 bytes} [Sun Oct 9 00:57:15 2022] DELETE /identity/v3/users/08d6c41fef5c467e9826e5eabbbccc65 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 09 00:57:16.066392 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82fab52-2226-4c43-9675-f3dfe9c29d34 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:57:16.066632 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e62d5e9-8657-4753-990f-f5246297f52d service neutron] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:57:16.082758 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-d82fab52-2226-4c43-9675-f3dfe9c29d34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:57:16.101562 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1025/2025] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Oct 9 00:57:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 09 00:57:16.102769 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5a2b15-d7a2-4b13-927f-e34ce966a7a1 None None] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:57:16.103046 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5a2b15-d7a2-4b13-927f-e34ce966a7a1 None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:57:16.103812 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5a2b15-d7a2-4b13-927f-e34ce966a7a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:57:16.145725 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.auth.core [None req-5c5a2b15-d7a2-4b13-927f-e34ce966a7a1 None None] MFA Rules not processed for user `db1857277e4f48a598b69b8ea4c15ac3`. Rule list: `[]` (Enabled: `True`). {{(pid=81525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:57:16.147051 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-5c5a2b15-d7a2-4b13-927f-e34ce966a7a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:57:16.205334 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:57:16.260798 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82fab52-2226-4c43-9675-f3dfe9c29d34 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:57:16.281797 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1266d5f-acd2-49be-8668-bc7b8ac2f745 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64be9d44437e4247a72334b9bab3cdd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f148d39ced534860abfbe8fc3f98ace4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:57:16.282781 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1026/2026] 10.222.0.15 () {58 vars in 958 bytes} [Sun Oct 9 00:57:16 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:57:16.283103 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1266d5f-acd2-49be-8668-bc7b8ac2f745 service placement] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:57:16.283452 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1266d5f-acd2-49be-8668-bc7b8ac2f745 service placement] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:57:16.283792 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1266d5f-acd2-49be-8668-bc7b8ac2f745 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:57:16.288225 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-c1266d5f-acd2-49be-8668-bc7b8ac2f745 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:57:16.295954 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5a2b15-d7a2-4b13-927f-e34ce966a7a1 None None] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:57:16.297129 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-5c5a2b15-d7a2-4b13-927f-e34ce966a7a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:57:16.318918 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1266d5f-acd2-49be-8668-bc7b8ac2f745 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:57:16.322562 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1266d5f-acd2-49be-8668-bc7b8ac2f745 service placement] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:57:16.338863 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1001/2027] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Oct 9 00:57:16 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 275 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 09 00:57:16.381780 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:57:16.388781 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5a2b15-d7a2-4b13-927f-e34ce966a7a1 None None] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:57:16.393848 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edb0f47-2b0b-4c7e-8102-c7db8eb9008d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff7cb78bcd91467abe5c2e2b48aedd1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f148d39ced534860abfbe8fc3f98ace4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:57:16.394847 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edb0f47-2b0b-4c7e-8102-c7db8eb9008d service cinder] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:57:16.395125 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edb0f47-2b0b-4c7e-8102-c7db8eb9008d service cinder] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:57:16.395441 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edb0f47-2b0b-4c7e-8102-c7db8eb9008d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:57:16.412306 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edb0f47-2b0b-4c7e-8102-c7db8eb9008d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:57:16.413892 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edb0f47-2b0b-4c7e-8102-c7db8eb9008d service cinder] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:57:16.427537 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1027/2028] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Oct 9 00:57:16 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 09 00:57:16.445833 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1266d5f-acd2-49be-8668-bc7b8ac2f745 service placement] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:57:16.449044 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-c1266d5f-acd2-49be-8668-bc7b8ac2f745 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:57:16.536274 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edb0f47-2b0b-4c7e-8102-c7db8eb9008d service cinder] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:57:16.538267 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-2edb0f47-2b0b-4c7e-8102-c7db8eb9008d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:57:16.548975 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1266d5f-acd2-49be-8668-bc7b8ac2f745 service placement] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:57:16.555317 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47ac8c6-e832-4e14-905e-cbb204c2fa2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:57:16.556002 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47ac8c6-e832-4e14-905e-cbb204c2fa2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:57:16.556279 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47ac8c6-e832-4e14-905e-cbb204c2fa2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:57:16.556552 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47ac8c6-e832-4e14-905e-cbb204c2fa2d admin admin] PATH_INFO: `/v3/projects/2ac86a5c874c4a0b8da47d5144040d5d` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:57:16.557757 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47ac8c6-e832-4e14-905e-cbb204c2fa2d admin admin] RBAC: Authorizing `identity:delete_project(project_id=2ac86a5c874c4a0b8da47d5144040d5d)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:57:16.560413 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47ac8c6-e832-4e14-905e-cbb204c2fa2d admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:57:16.572488 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edb0f47-2b0b-4c7e-8102-c7db8eb9008d service cinder] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:57:16.578876 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651eb5f3-8aa0-4ac6-8b11-b9eda468a6ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:57:16.580598 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651eb5f3-8aa0-4ac6-8b11-b9eda468a6ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:57:16.580953 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651eb5f3-8aa0-4ac6-8b11-b9eda468a6ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:57:16.581320 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651eb5f3-8aa0-4ac6-8b11-b9eda468a6ab admin admin] PATH_INFO: `/v3/projects/c86058caac0745d4b438fb867c124263` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:57:16.583056 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651eb5f3-8aa0-4ac6-8b11-b9eda468a6ab admin admin] RBAC: Authorizing `identity:delete_project(project_id=c86058caac0745d4b438fb867c124263)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:57:16.585299 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651eb5f3-8aa0-4ac6-8b11-b9eda468a6ab admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:57:16.628477 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-e47ac8c6-e832-4e14-905e-cbb204c2fa2d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ac86a5c874c4a0b8da47d5144040d5d', 'request_id': 'req-e47ac8c6-e832-4e14-905e-cbb204c2fa2d'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:57:16.636451 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-e47ac8c6-e832-4e14-905e-cbb204c2fa2d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ac86a5c874c4a0b8da47d5144040d5d', 'request_id': 'req-e47ac8c6-e832-4e14-905e-cbb204c2fa2d'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:57:16.643850 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-e47ac8c6-e832-4e14-905e-cbb204c2fa2d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ac86a5c874c4a0b8da47d5144040d5d', 'request_id': 'req-e47ac8c6-e832-4e14-905e-cbb204c2fa2d'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:57:16.648213 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-651eb5f3-8aa0-4ac6-8b11-b9eda468a6ab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c86058caac0745d4b438fb867c124263', 'request_id': 'req-651eb5f3-8aa0-4ac6-8b11-b9eda468a6ab'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:57:16.658237 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-651eb5f3-8aa0-4ac6-8b11-b9eda468a6ab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c86058caac0745d4b438fb867c124263', 'request_id': 'req-651eb5f3-8aa0-4ac6-8b11-b9eda468a6ab'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:57:16.662688 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-e47ac8c6-e832-4e14-905e-cbb204c2fa2d admin admin] The token cache is being invalidate because project 2ac86a5c874c4a0b8da47d5144040d5d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81524) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 09 00:57:16.663223 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-e47ac8c6-e832-4e14-905e-cbb204c2fa2d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:57:16.664293 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-e47ac8c6-e832-4e14-905e-cbb204c2fa2d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:57:16.666400 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1002/2029] 10.222.0.15 () {58 vars in 1233 bytes} [Sun Oct 9 00:57:16 2022] DELETE /identity/v3/projects/2ac86a5c874c4a0b8da47d5144040d5d => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 00:57:16.666810 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-651eb5f3-8aa0-4ac6-8b11-b9eda468a6ab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c86058caac0745d4b438fb867c124263', 'request_id': 'req-651eb5f3-8aa0-4ac6-8b11-b9eda468a6ab'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:57:16.680219 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-651eb5f3-8aa0-4ac6-8b11-b9eda468a6ab admin admin] The token cache is being invalidate because project c86058caac0745d4b438fb867c124263 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81525) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 09 00:57:16.680765 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-651eb5f3-8aa0-4ac6-8b11-b9eda468a6ab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:57:16.681323 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388ba881-2777-4c0c-b384-ac8771100337 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:57:16.681707 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-651eb5f3-8aa0-4ac6-8b11-b9eda468a6ab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:57:16.681999 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388ba881-2777-4c0c-b384-ac8771100337 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:57:16.682499 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388ba881-2777-4c0c-b384-ac8771100337 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:57:16.684033 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1028/2030] 10.222.0.15 () {58 vars in 1233 bytes} [Sun Oct 9 00:57:16 2022] DELETE /identity/v3/projects/c86058caac0745d4b438fb867c124263 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 09 00:57:16.695086 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b74655f-35ac-4eb7-9413-3f2b1643fa09 None None] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:57:16.695515 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b74655f-35ac-4eb7-9413-3f2b1643fa09 None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:57:16.696392 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b74655f-35ac-4eb7-9413-3f2b1643fa09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:57:16.708345 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-388ba881-2777-4c0c-b384-ac8771100337 None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:57:16.709696 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-388ba881-2777-4c0c-b384-ac8771100337 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:57:16.728236 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.auth.core [None req-0b74655f-35ac-4eb7-9413-3f2b1643fa09 None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:57:16.729545 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-0b74655f-35ac-4eb7-9413-3f2b1643fa09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:57:16.775897 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:57:16.799388 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1003/2031] 10.222.0.15 () {58 vars in 958 bytes} [Sun Oct 9 00:57:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 09 00:57:16.805457 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45940597-b0bf-4b7e-9e4b-410a9334f92f None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:57:16.805739 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45940597-b0bf-4b7e-9e4b-410a9334f92f None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:57:16.806019 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45940597-b0bf-4b7e-9e4b-410a9334f92f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:57:16.823987 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1029/2032] 10.222.0.15 () {58 vars in 958 bytes} [Sun Oct 9 00:57:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:57:16.837074 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e37875f-44e4-41f8-ba9f-6e98b0e4f83b None None] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:57:16.837613 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e37875f-44e4-41f8-ba9f-6e98b0e4f83b None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:57:16.837982 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e37875f-44e4-41f8-ba9f-6e98b0e4f83b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:57:16.853792 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-45940597-b0bf-4b7e-9e4b-410a9334f92f None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:57:16.855398 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-45940597-b0bf-4b7e-9e4b-410a9334f92f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:57:16.877975 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1004/2033] 10.222.0.15 () {58 vars in 958 bytes} [Sun Oct 9 00:57:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:57:16.880759 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.auth.core [None req-9e37875f-44e4-41f8-ba9f-6e98b0e4f83b None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:57:16.883766 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45940597-b0bf-4b7e-9e4b-410a9334f92f None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:57:16.886700 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-9e37875f-44e4-41f8-ba9f-6e98b0e4f83b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:57:16.907244 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45940597-b0bf-4b7e-9e4b-410a9334f92f None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:57:16.909706 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1030/2034] 10.222.0.15 () {58 vars in 958 bytes} [Sun Oct 9 00:57:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 09 00:57:16.920826 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cc94a8-a070-49a9-8ebb-c7472e4b4a95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:57:16.921608 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cc94a8-a070-49a9-8ebb-c7472e4b4a95 admin admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:57:16.921982 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cc94a8-a070-49a9-8ebb-c7472e4b4a95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:57:16.922504 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cc94a8-a070-49a9-8ebb-c7472e4b4a95 admin admin] PATH_INFO: `/v3/domains` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:57:16.923365 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cc94a8-a070-49a9-8ebb-c7472e4b4a95 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:57:16.924133 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cc94a8-a070-49a9-8ebb-c7472e4b4a95 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:57:16.925527 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e37875f-44e4-41f8-ba9f-6e98b0e4f83b None None] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:57:16.926688 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cc94a8-a070-49a9-8ebb-c7472e4b4a95 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:57:16.943939 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e37875f-44e4-41f8-ba9f-6e98b0e4f83b None None] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:57:16.944870 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1005/2035] 10.222.0.15 () {58 vars in 1153 bytes} [Sun Oct 9 00:57:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:57:16.950652 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cc94a8-a070-49a9-8ebb-c7472e4b4a95 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:57:16.967989 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0688ad0b-2ec0-4455-8352-40e2b1a4a9de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:57:16.967989 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0688ad0b-2ec0-4455-8352-40e2b1a4a9de admin admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:57:16.969902 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0688ad0b-2ec0-4455-8352-40e2b1a4a9de admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:57:16.970528 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0688ad0b-2ec0-4455-8352-40e2b1a4a9de admin admin] PATH_INFO: `/v3/domains` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:57:16.971333 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0688ad0b-2ec0-4455-8352-40e2b1a4a9de admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:57:16.971785 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0688ad0b-2ec0-4455-8352-40e2b1a4a9de admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:57:16.973529 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0688ad0b-2ec0-4455-8352-40e2b1a4a9de admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:57:16.984017 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cc94a8-a070-49a9-8ebb-c7472e4b4a95 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:57:16.992733 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a0ac85-bc1c-41a2-96de-27a6d86bbaaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:57:16.993660 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a0ac85-bc1c-41a2-96de-27a6d86bbaaf admin admin] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:57:16.994154 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a0ac85-bc1c-41a2-96de-27a6d86bbaaf admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:57:16.994561 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a0ac85-bc1c-41a2-96de-27a6d86bbaaf admin admin] PATH_INFO: `/v3/projects` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:57:16.995482 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a0ac85-bc1c-41a2-96de-27a6d86bbaaf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:57:16.999106 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a0ac85-bc1c-41a2-96de-27a6d86bbaaf admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:57:17.009466 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1031/2036] 10.222.0.15 () {58 vars in 1153 bytes} [Sun Oct 9 00:57:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:57:17.014862 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0688ad0b-2ec0-4455-8352-40e2b1a4a9de admin admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:57:17.030906 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0688ad0b-2ec0-4455-8352-40e2b1a4a9de admin admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:57:17.038923 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6127eb69-0221-4a61-a8b5-79d35ed15899 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:57:17.040219 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6127eb69-0221-4a61-a8b5-79d35ed15899 admin admin] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:57:17.040569 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6127eb69-0221-4a61-a8b5-79d35ed15899 admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:57:17.040905 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6127eb69-0221-4a61-a8b5-79d35ed15899 admin admin] PATH_INFO: `/v3/projects` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:57:17.041636 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6127eb69-0221-4a61-a8b5-79d35ed15899 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:57:17.044389 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6127eb69-0221-4a61-a8b5-79d35ed15899 admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:57:17.046118 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1006/2037] 10.222.0.15 () {60 vars in 1153 bytes} [Sun Oct 9 00:57:16 2022] POST /identity/v3/projects => generated 373 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 09 00:57:17.051404 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a0ac85-bc1c-41a2-96de-27a6d86bbaaf admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:57:17.077782 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1032/2038] 10.222.0.15 () {60 vars in 1153 bytes} [Sun Oct 9 00:57:17 2022] POST /identity/v3/projects => generated 371 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 09 00:57:17.081919 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6127eb69-0221-4a61-a8b5-79d35ed15899 admin admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:57:17.122248 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:57:17.125998 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a0ac85-bc1c-41a2-96de-27a6d86bbaaf admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:57:17.157799 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6127eb69-0221-4a61-a8b5-79d35ed15899 admin admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:57:17.164508 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdf98fb-095b-41ff-8784-7981f0efa58d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:57:17.165206 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdf98fb-095b-41ff-8784-7981f0efa58d admin admin] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:57:17.165485 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdf98fb-095b-41ff-8784-7981f0efa58d admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:57:17.165760 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdf98fb-095b-41ff-8784-7981f0efa58d admin admin] PATH_INFO: `/v3/users` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:57:17.166396 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdf98fb-095b-41ff-8784-7981f0efa58d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:57:17.168434 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdf98fb-095b-41ff-8784-7981f0efa58d admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:57:17.192766 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac34cbaf-937b-4a50-a376-055645bbb4d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:57:17.193511 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac34cbaf-937b-4a50-a376-055645bbb4d9 admin admin] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:57:17.193991 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac34cbaf-937b-4a50-a376-055645bbb4d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:57:17.194357 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac34cbaf-937b-4a50-a376-055645bbb4d9 admin admin] PATH_INFO: `/v3/users` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:57:17.195241 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac34cbaf-937b-4a50-a376-055645bbb4d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:57:17.198611 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac34cbaf-937b-4a50-a376-055645bbb4d9 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:57:17.203573 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1033/2039] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Oct 9 00:57:17 2022] POST /identity/v3/users => generated 286 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 09 00:57:17.207849 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdf98fb-095b-41ff-8784-7981f0efa58d admin admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:57:17.223232 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1007/2040] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Oct 9 00:57:17 2022] POST /identity/v3/users => generated 287 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 09 00:57:17.226944 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdf98fb-095b-41ff-8784-7981f0efa58d admin admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:57:17.228659 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac34cbaf-937b-4a50-a376-055645bbb4d9 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:57:17.233680 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211a0863-fe4d-42eb-a448-eb9aa4f3e88d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:57:17.234434 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211a0863-fe4d-42eb-a448-eb9aa4f3e88d admin admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:57:17.235373 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211a0863-fe4d-42eb-a448-eb9aa4f3e88d admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:57:17.235592 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211a0863-fe4d-42eb-a448-eb9aa4f3e88d admin admin] PATH_INFO: `/v3/roles` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:57:17.236242 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211a0863-fe4d-42eb-a448-eb9aa4f3e88d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:57:17.238608 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211a0863-fe4d-42eb-a448-eb9aa4f3e88d admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:57:17.241637 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac34cbaf-937b-4a50-a376-055645bbb4d9 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:57:17.247978 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc04bc18-0225-48cd-aab5-292855d520af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:57:17.248758 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc04bc18-0225-48cd-aab5-292855d520af admin admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:57:17.249279 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc04bc18-0225-48cd-aab5-292855d520af admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:57:17.249631 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc04bc18-0225-48cd-aab5-292855d520af admin admin] PATH_INFO: `/v3/roles` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:57:17.250469 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc04bc18-0225-48cd-aab5-292855d520af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:57:17.251421 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1034/2041] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Oct 9 00:57:17 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 09 00:57:17.252615 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc04bc18-0225-48cd-aab5-292855d520af admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:57:17.253838 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211a0863-fe4d-42eb-a448-eb9aa4f3e88d admin admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:57:17.265166 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211a0863-fe4d-42eb-a448-eb9aa4f3e88d admin admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:57:17.266264 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1008/2042] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Oct 9 00:57:17 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 09 00:57:17.270048 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc04bc18-0225-48cd-aab5-292855d520af admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:57:17.277422 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ee085d-6f9c-40e0-a048-0963e8a74235 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:57:17.278699 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ee085d-6f9c-40e0-a048-0963e8a74235 admin admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:57:17.278980 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ee085d-6f9c-40e0-a048-0963e8a74235 admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:57:17.279250 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ee085d-6f9c-40e0-a048-0963e8a74235 admin admin] PATH_INFO: `/v3/roles` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:57:17.280024 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ee085d-6f9c-40e0-a048-0963e8a74235 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:57:17.280770 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc04bc18-0225-48cd-aab5-292855d520af admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:57:17.281695 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ee085d-6f9c-40e0-a048-0963e8a74235 admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:57:17.287094 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf38efe-0ecb-4314-a3ff-1477a43400c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:57:17.288244 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf38efe-0ecb-4314-a3ff-1477a43400c6 admin admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:57:17.288588 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf38efe-0ecb-4314-a3ff-1477a43400c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:57:17.288927 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf38efe-0ecb-4314-a3ff-1477a43400c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:57:17.289657 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf38efe-0ecb-4314-a3ff-1477a43400c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:57:17.291399 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf38efe-0ecb-4314-a3ff-1477a43400c6 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:57:17.298177 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1035/2043] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Oct 9 00:57:17 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 09 00:57:17.300146 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ee085d-6f9c-40e0-a048-0963e8a74235 admin admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:57:17.304469 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1009/2044] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Oct 9 00:57:17 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 09 00:57:17.309497 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf38efe-0ecb-4314-a3ff-1477a43400c6 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:57:17.312089 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ee085d-6f9c-40e0-a048-0963e8a74235 admin admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:57:17.317108 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9422aa68-e8de-4692-9307-9b6e64e04e90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:57:17.317778 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9422aa68-e8de-4692-9307-9b6e64e04e90 admin admin] REQUEST_METHOD: `PUT` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:57:17.318212 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9422aa68-e8de-4692-9307-9b6e64e04e90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:57:17.318422 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9422aa68-e8de-4692-9307-9b6e64e04e90 admin admin] PATH_INFO: `/v3/projects/4537b7bd396d4bc39e88007cc50f11f9/users/ac1bc7c5b4f64716816ac1e8d913e251/roles/afb0a01183d9497795eaa4fa1a4046ae` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:57:17.321383 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf38efe-0ecb-4314-a3ff-1477a43400c6 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:57:17.326674 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180bb96e-03ce-4dd9-bacf-edaafdd059ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:57:17.327487 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180bb96e-03ce-4dd9-bacf-edaafdd059ea admin admin] REQUEST_METHOD: `PUT` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:57:17.327898 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180bb96e-03ce-4dd9-bacf-edaafdd059ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:57:17.328180 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180bb96e-03ce-4dd9-bacf-edaafdd059ea admin admin] PATH_INFO: `/v3/projects/5ad0c9499b2947308f820317ca80d4ca/users/1cd31e75d31d4489b2d7a647ba8c0b5f/roles/afb0a01183d9497795eaa4fa1a4046ae` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:57:17.341495 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9422aa68-e8de-4692-9307-9b6e64e04e90 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4537b7bd396d4bc39e88007cc50f11f9, user_id=ac1bc7c5b4f64716816ac1e8d913e251, role_id=afb0a01183d9497795eaa4fa1a4046ae)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:57:17.344269 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9422aa68-e8de-4692-9307-9b6e64e04e90 admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:57:17.344855 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180bb96e-03ce-4dd9-bacf-edaafdd059ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ad0c9499b2947308f820317ca80d4ca, user_id=1cd31e75d31d4489b2d7a647ba8c0b5f, role_id=afb0a01183d9497795eaa4fa1a4046ae)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:57:17.348964 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180bb96e-03ce-4dd9-bacf-edaafdd059ea admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:57:17.366935 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1010/2045] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Oct 9 00:57:17 2022] PUT /identity/v3/projects/5ad0c9499b2947308f820317ca80d4ca/users/1cd31e75d31d4489b2d7a647ba8c0b5f/roles/afb0a01183d9497795eaa4fa1a4046ae => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 09 00:57:17.367068 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1036/2046] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Oct 9 00:57:17 2022] PUT /identity/v3/projects/4537b7bd396d4bc39e88007cc50f11f9/users/ac1bc7c5b4f64716816ac1e8d913e251/roles/afb0a01183d9497795eaa4fa1a4046ae => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 09 00:57:17.376098 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e6594e-ed83-4f78-a59a-b74f7e926a12 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:57:17.376225 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10623fa7-defa-43b3-a647-ca1b9d348579 None None] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:57:17.376379 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e6594e-ed83-4f78-a59a-b74f7e926a12 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:57:17.376500 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10623fa7-defa-43b3-a647-ca1b9d348579 None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:57:17.376677 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e6594e-ed83-4f78-a59a-b74f7e926a12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:57:17.376809 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10623fa7-defa-43b3-a647-ca1b9d348579 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:57:17.391601 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:57:17.410330 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.auth.core [None req-10623fa7-defa-43b3-a647-ca1b9d348579 None None] MFA Rules not processed for user `1cd31e75d31d4489b2d7a647ba8c0b5f`. Rule list: `[]` (Enabled: `True`). {{(pid=81525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:57:17.411770 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-10623fa7-defa-43b3-a647-ca1b9d348579 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:57:17.412090 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-87e6594e-ed83-4f78-a59a-b74f7e926a12 None None] MFA Rules not processed for user `ac1bc7c5b4f64716816ac1e8d913e251`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:57:17.421251 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-87e6594e-ed83-4f78-a59a-b74f7e926a12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:57:17.490932 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1037/2047] 10.222.0.15 () {58 vars in 958 bytes} [Sun Oct 9 00:57:17 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:57:17.498200 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1011/2048] 10.222.0.15 () {58 vars in 958 bytes} [Sun Oct 9 00:57:17 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:57:17.506581 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10623fa7-defa-43b3-a647-ca1b9d348579 None None] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:57:17.508989 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-10623fa7-defa-43b3-a647-ca1b9d348579 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:57:17.513139 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e6594e-ed83-4f78-a59a-b74f7e926a12 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:57:17.514173 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-87e6594e-ed83-4f78-a59a-b74f7e926a12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:57:17.591605 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e6594e-ed83-4f78-a59a-b74f7e926a12 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:57:17.596039 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c508bf22-b6ac-4817-962c-949be7338942 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd88a9f3d154c4cf98369972a0561b2b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f148d39ced534860abfbe8fc3f98ace4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:57:17.596670 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c508bf22-b6ac-4817-962c-949be7338942 service glance] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:57:17.596966 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c508bf22-b6ac-4817-962c-949be7338942 service glance] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:57:17.597227 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c508bf22-b6ac-4817-962c-949be7338942 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:57:17.605844 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:57:17.608106 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c508bf22-b6ac-4817-962c-949be7338942 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:57:17.610135 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c508bf22-b6ac-4817-962c-949be7338942 service glance] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:57:17.613578 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10623fa7-defa-43b3-a647-ca1b9d348579 None None] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:57:17.621575 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1012/2049] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Oct 9 00:57:17 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 09 00:57:17.622241 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d4aa56-39c0-4b6d-a9a2-32f513af70c4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ac83d57fba841e0a666710732249c49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f148d39ced534860abfbe8fc3f98ace4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:57:17.623058 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d4aa56-39c0-4b6d-a9a2-32f513af70c4 service nova] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:57:17.623507 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d4aa56-39c0-4b6d-a9a2-32f513af70c4 service nova] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:57:17.623894 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d4aa56-39c0-4b6d-a9a2-32f513af70c4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:57:17.634352 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d4aa56-39c0-4b6d-a9a2-32f513af70c4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:57:17.636331 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d4aa56-39c0-4b6d-a9a2-32f513af70c4 service nova] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:57:17.648056 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1038/2050] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Oct 9 00:57:17 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 09 00:57:17.950582 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c508bf22-b6ac-4817-962c-949be7338942 service glance] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:57:18.034019 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c508bf22-b6ac-4817-962c-949be7338942 service glance] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:57:18.040120 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3edb3d2-df43-40b3-b5ab-d500544dce6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:57:18.040451 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3edb3d2-df43-40b3-b5ab-d500544dce6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:57:18.040728 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3edb3d2-df43-40b3-b5ab-d500544dce6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:57:18.040996 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3edb3d2-df43-40b3-b5ab-d500544dce6e admin admin] PATH_INFO: `/v3/users/1cd31e75d31d4489b2d7a647ba8c0b5f` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:57:18.042120 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3edb3d2-df43-40b3-b5ab-d500544dce6e admin admin] RBAC: Authorizing `identity:delete_user(user_id=1cd31e75d31d4489b2d7a647ba8c0b5f)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:57:18.044096 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3edb3d2-df43-40b3-b5ab-d500544dce6e admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:57:18.064557 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde047f8-ac1c-4fd6-b88f-eb8c0104ec2c None None] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:57:18.065243 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde047f8-ac1c-4fd6-b88f-eb8c0104ec2c None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:57:18.065697 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde047f8-ac1c-4fd6-b88f-eb8c0104ec2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:57:18.091173 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.auth.core [None req-bde047f8-ac1c-4fd6-b88f-eb8c0104ec2c None None] MFA Rules not processed for user `db1857277e4f48a598b69b8ea4c15ac3`. Rule list: `[]` (Enabled: `True`). {{(pid=81525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:57:18.092700 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-bde047f8-ac1c-4fd6-b88f-eb8c0104ec2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:57:18.148925 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:57:18.160949 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-e3edb3d2-df43-40b3-b5ab-d500544dce6e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1cd31e75d31d4489b2d7a647ba8c0b5f'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:57:18.185381 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1039/2051] 10.222.0.15 () {58 vars in 958 bytes} [Sun Oct 9 00:57:18 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:57:18.187097 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-e3edb3d2-df43-40b3-b5ab-d500544dce6e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1cd31e75d31d4489b2d7a647ba8c0b5f'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:57:18.188010 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-e3edb3d2-df43-40b3-b5ab-d500544dce6e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1cd31e75d31d4489b2d7a647ba8c0b5f'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:57:18.188765 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-e3edb3d2-df43-40b3-b5ab-d500544dce6e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1cd31e75d31d4489b2d7a647ba8c0b5f'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:57:18.200812 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-e3edb3d2-df43-40b3-b5ab-d500544dce6e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1cd31e75d31d4489b2d7a647ba8c0b5f'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:57:18.238383 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1013/2052] 10.222.0.15 () {58 vars in 1224 bytes} [Sun Oct 9 00:57:17 2022] DELETE /identity/v3/users/1cd31e75d31d4489b2d7a647ba8c0b5f => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 00:57:18.243918 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8764e0-a2df-407b-8635-91ba2a971adb None None] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:57:18.244206 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8764e0-a2df-407b-8635-91ba2a971adb None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:57:18.244481 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8764e0-a2df-407b-8635-91ba2a971adb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:57:18.266703 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.auth.core [None req-9a8764e0-a2df-407b-8635-91ba2a971adb None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:57:18.267958 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-9a8764e0-a2df-407b-8635-91ba2a971adb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:57:18.331550 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1040/2053] 10.222.0.15 () {58 vars in 958 bytes} [Sun Oct 9 00:57:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:57:18.341805 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3edb3d2-df43-40b3-b5ab-d500544dce6e admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:57:18.343374 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-e3edb3d2-df43-40b3-b5ab-d500544dce6e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:57:18.407184 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3edb3d2-df43-40b3-b5ab-d500544dce6e admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:57:18.410887 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ae900f-54a2-4a2d-bb07-9311440bbc17 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4ef90d456d2483e8ddafbe2d4d4fb5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f148d39ced534860abfbe8fc3f98ace4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:57:18.411670 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ae900f-54a2-4a2d-bb07-9311440bbc17 service neutron] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:57:18.411939 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ae900f-54a2-4a2d-bb07-9311440bbc17 service neutron] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:57:18.412214 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ae900f-54a2-4a2d-bb07-9311440bbc17 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:57:18.421986 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ae900f-54a2-4a2d-bb07-9311440bbc17 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:57:18.423688 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ae900f-54a2-4a2d-bb07-9311440bbc17 service neutron] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:57:18.434261 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1014/2054] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Oct 9 00:57:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 09 00:57:18.805956 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8764e0-a2df-407b-8635-91ba2a971adb None None] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:57:18.808057 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-9a8764e0-a2df-407b-8635-91ba2a971adb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:57:18.842196 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8764e0-a2df-407b-8635-91ba2a971adb None None] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:57:18.848159 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f748bbf-6476-40e8-a42a-b7afa567322d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:57:18.848812 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f748bbf-6476-40e8-a42a-b7afa567322d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:57:18.849132 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f748bbf-6476-40e8-a42a-b7afa567322d admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:57:18.849447 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f748bbf-6476-40e8-a42a-b7afa567322d admin admin] PATH_INFO: `/v3/projects/5ad0c9499b2947308f820317ca80d4ca` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:57:18.851283 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f748bbf-6476-40e8-a42a-b7afa567322d admin admin] RBAC: Authorizing `identity:delete_project(project_id=5ad0c9499b2947308f820317ca80d4ca)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:57:18.852674 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f748bbf-6476-40e8-a42a-b7afa567322d admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:57:18.921530 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-9f748bbf-6476-40e8-a42a-b7afa567322d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ad0c9499b2947308f820317ca80d4ca', 'request_id': 'req-9f748bbf-6476-40e8-a42a-b7afa567322d'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:57:18.935445 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-9f748bbf-6476-40e8-a42a-b7afa567322d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ad0c9499b2947308f820317ca80d4ca', 'request_id': 'req-9f748bbf-6476-40e8-a42a-b7afa567322d'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:57:18.944342 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-9f748bbf-6476-40e8-a42a-b7afa567322d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ad0c9499b2947308f820317ca80d4ca', 'request_id': 'req-9f748bbf-6476-40e8-a42a-b7afa567322d'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:57:18.965384 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-9f748bbf-6476-40e8-a42a-b7afa567322d admin admin] The token cache is being invalidate because project 5ad0c9499b2947308f820317ca80d4ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81525) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 09 00:57:18.966163 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-9f748bbf-6476-40e8-a42a-b7afa567322d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:57:18.966813 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-9f748bbf-6476-40e8-a42a-b7afa567322d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:57:18.969535 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1041/2055] 10.222.0.15 () {58 vars in 1233 bytes} [Sun Oct 9 00:57:18 2022] DELETE /identity/v3/projects/5ad0c9499b2947308f820317ca80d4ca => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 00:57:18.974525 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05487774-cc8b-4bab-a4bf-de58e06ded12 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:57:18.975039 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05487774-cc8b-4bab-a4bf-de58e06ded12 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:57:18.975039 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05487774-cc8b-4bab-a4bf-de58e06ded12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:57:18.995206 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-05487774-cc8b-4bab-a4bf-de58e06ded12 None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:57:18.996461 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-05487774-cc8b-4bab-a4bf-de58e06ded12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:57:19.063479 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1015/2056] 10.222.0.15 () {58 vars in 958 bytes} [Sun Oct 9 00:57:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:57:19.072701 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f653be-88c5-46dd-9e37-ff2fe83d438f None None] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:57:19.073275 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f653be-88c5-46dd-9e37-ff2fe83d438f None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:57:19.073364 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f653be-88c5-46dd-9e37-ff2fe83d438f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:57:19.109805 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.auth.core [None req-49f653be-88c5-46dd-9e37-ff2fe83d438f None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:57:19.111059 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-49f653be-88c5-46dd-9e37-ff2fe83d438f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:57:19.119972 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1042/2057] 10.222.0.15 () {58 vars in 958 bytes} [Sun Oct 9 00:57:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:57:19.124811 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05487774-cc8b-4bab-a4bf-de58e06ded12 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:57:19.135053 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05487774-cc8b-4bab-a4bf-de58e06ded12 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:57:19.140701 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdd2eae-39c9-4416-aea2-9ab26bc1885f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:57:19.141350 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdd2eae-39c9-4416-aea2-9ab26bc1885f admin admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:57:19.141669 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdd2eae-39c9-4416-aea2-9ab26bc1885f admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:57:19.142023 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdd2eae-39c9-4416-aea2-9ab26bc1885f admin admin] PATH_INFO: `/v3/domains` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:57:19.142604 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdd2eae-39c9-4416-aea2-9ab26bc1885f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:57:19.142936 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdd2eae-39c9-4416-aea2-9ab26bc1885f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:57:19.144605 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdd2eae-39c9-4416-aea2-9ab26bc1885f admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:57:19.160695 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1016/2058] 10.222.0.15 () {58 vars in 1153 bytes} [Sun Oct 9 00:57:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 09 00:57:19.166192 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f653be-88c5-46dd-9e37-ff2fe83d438f None None] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:57:19.175549 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f653be-88c5-46dd-9e37-ff2fe83d438f None None] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:57:19.180589 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621a049f-500f-4a4d-a16b-794bf3913d34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:57:19.181263 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621a049f-500f-4a4d-a16b-794bf3913d34 admin admin] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:57:19.181599 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621a049f-500f-4a4d-a16b-794bf3913d34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:57:19.181975 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621a049f-500f-4a4d-a16b-794bf3913d34 admin admin] PATH_INFO: `/v3/projects` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:57:19.182787 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621a049f-500f-4a4d-a16b-794bf3913d34 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:57:19.184917 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621a049f-500f-4a4d-a16b-794bf3913d34 admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:57:19.199874 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:57:19.229631 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1043/2059] 10.222.0.15 () {60 vars in 1153 bytes} [Sun Oct 9 00:57:19 2022] POST /identity/v3/projects => generated 363 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 09 00:57:19.235536 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdd2eae-39c9-4416-aea2-9ab26bc1885f admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:57:19.254865 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdd2eae-39c9-4416-aea2-9ab26bc1885f admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:57:19.329263 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:57:19.346118 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8203be43-99d2-42e8-8a8f-173cf53ebda3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:57:19.347207 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8203be43-99d2-42e8-8a8f-173cf53ebda3 admin admin] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:57:19.347894 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8203be43-99d2-42e8-8a8f-173cf53ebda3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:57:19.348295 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8203be43-99d2-42e8-8a8f-173cf53ebda3 admin admin] PATH_INFO: `/v3/users` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:57:19.349419 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8203be43-99d2-42e8-8a8f-173cf53ebda3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:57:19.352081 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8203be43-99d2-42e8-8a8f-173cf53ebda3 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:57:19.377291 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1017/2060] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Oct 9 00:57:19 2022] POST /identity/v3/users => generated 282 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 09 00:57:19.381542 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621a049f-500f-4a4d-a16b-794bf3913d34 admin admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:57:19.392109 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621a049f-500f-4a4d-a16b-794bf3913d34 admin admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:57:19.396972 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bde123a-5e9d-4879-acb4-25f63f00bd3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:57:19.397594 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bde123a-5e9d-4879-acb4-25f63f00bd3a admin admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:57:19.399471 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bde123a-5e9d-4879-acb4-25f63f00bd3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:57:19.399471 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bde123a-5e9d-4879-acb4-25f63f00bd3a admin admin] PATH_INFO: `/v3/roles` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:57:19.399471 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bde123a-5e9d-4879-acb4-25f63f00bd3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:57:19.400596 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bde123a-5e9d-4879-acb4-25f63f00bd3a admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:57:19.412313 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1044/2061] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Oct 9 00:57:19 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 09 00:57:19.416717 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8203be43-99d2-42e8-8a8f-173cf53ebda3 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:57:19.431571 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8203be43-99d2-42e8-8a8f-173cf53ebda3 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:57:19.441833 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccb65f3-19dc-442a-9043-7c3c4097d252 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:57:19.442810 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccb65f3-19dc-442a-9043-7c3c4097d252 admin admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:57:19.443113 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccb65f3-19dc-442a-9043-7c3c4097d252 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:57:19.443640 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccb65f3-19dc-442a-9043-7c3c4097d252 admin admin] PATH_INFO: `/v3/roles` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:57:19.444392 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccb65f3-19dc-442a-9043-7c3c4097d252 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:57:19.446025 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccb65f3-19dc-442a-9043-7c3c4097d252 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:57:19.463079 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1018/2062] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Oct 9 00:57:19 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 09 00:57:19.464354 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bde123a-5e9d-4879-acb4-25f63f00bd3a admin admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:57:19.474796 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bde123a-5e9d-4879-acb4-25f63f00bd3a admin admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:57:19.482212 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d126819-16c0-4b25-909f-d9d97baa2bd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:57:19.482901 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d126819-16c0-4b25-909f-d9d97baa2bd8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:57:19.483317 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d126819-16c0-4b25-909f-d9d97baa2bd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:57:19.483737 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d126819-16c0-4b25-909f-d9d97baa2bd8 admin admin] PATH_INFO: `/v3/projects/9b17ee837b7a4771a22748bcbb1b4b6e/users/b254ccad998d4d849c492961f0fb4890/roles/afb0a01183d9497795eaa4fa1a4046ae` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:57:19.504713 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d126819-16c0-4b25-909f-d9d97baa2bd8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b17ee837b7a4771a22748bcbb1b4b6e, user_id=b254ccad998d4d849c492961f0fb4890, role_id=afb0a01183d9497795eaa4fa1a4046ae)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:57:19.507598 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d126819-16c0-4b25-909f-d9d97baa2bd8 admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:57:19.525156 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1045/2063] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Oct 9 00:57:19 2022] PUT /identity/v3/projects/9b17ee837b7a4771a22748bcbb1b4b6e/users/b254ccad998d4d849c492961f0fb4890/roles/afb0a01183d9497795eaa4fa1a4046ae => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 00:57:19.536568 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbb9874-2c6e-4f65-b7b8-2c0774863fb4 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:57:19.536952 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbb9874-2c6e-4f65-b7b8-2c0774863fb4 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:57:19.537233 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbb9874-2c6e-4f65-b7b8-2c0774863fb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:57:19.568854 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-ddbb9874-2c6e-4f65-b7b8-2c0774863fb4 None None] MFA Rules not processed for user `b254ccad998d4d849c492961f0fb4890`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:57:19.570130 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-ddbb9874-2c6e-4f65-b7b8-2c0774863fb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:57:19.644996 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1019/2064] 10.222.0.15 () {58 vars in 958 bytes} [Sun Oct 9 00:57:19 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:57:19.649740 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d126819-16c0-4b25-909f-d9d97baa2bd8 admin admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:57:19.713721 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d126819-16c0-4b25-909f-d9d97baa2bd8 admin admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:57:19.719163 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ffaed7-f453-475a-acec-ad9d8f658b9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:57:19.719948 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ffaed7-f453-475a-acec-ad9d8f658b9f admin admin] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:57:19.720228 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ffaed7-f453-475a-acec-ad9d8f658b9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:57:19.720500 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ffaed7-f453-475a-acec-ad9d8f658b9f admin admin] PATH_INFO: `/v3/projects` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:57:19.721134 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ffaed7-f453-475a-acec-ad9d8f658b9f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:57:19.723120 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ffaed7-f453-475a-acec-ad9d8f658b9f admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:57:19.752363 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1046/2065] 10.222.0.15 () {60 vars in 1153 bytes} [Sun Oct 9 00:57:19 2022] POST /identity/v3/projects => generated 363 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 09 00:57:19.758105 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbb9874-2c6e-4f65-b7b8-2c0774863fb4 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:57:19.769962 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbb9874-2c6e-4f65-b7b8-2c0774863fb4 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:57:19.832579 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9f0465-931a-4494-9a97-fbda69a28296 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:57:19.833209 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9f0465-931a-4494-9a97-fbda69a28296 admin admin] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:57:19.833553 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9f0465-931a-4494-9a97-fbda69a28296 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:57:19.833829 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9f0465-931a-4494-9a97-fbda69a28296 admin admin] PATH_INFO: `/v3/users` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:57:19.834870 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9f0465-931a-4494-9a97-fbda69a28296 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:57:19.836755 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9f0465-931a-4494-9a97-fbda69a28296 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:57:19.862077 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1020/2066] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Oct 9 00:57:19 2022] POST /identity/v3/users => generated 288 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 09 00:57:19.866698 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ffaed7-f453-475a-acec-ad9d8f658b9f admin admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:57:19.878995 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ffaed7-f453-475a-acec-ad9d8f658b9f admin admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:57:19.884065 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce94e02d-0e37-4f4a-a204-426e5a06c126 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:57:19.884676 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce94e02d-0e37-4f4a-a204-426e5a06c126 admin admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:57:19.884956 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce94e02d-0e37-4f4a-a204-426e5a06c126 admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:57:19.885228 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce94e02d-0e37-4f4a-a204-426e5a06c126 admin admin] PATH_INFO: `/v3/roles` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:57:19.885906 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce94e02d-0e37-4f4a-a204-426e5a06c126 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:57:19.887603 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce94e02d-0e37-4f4a-a204-426e5a06c126 admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:57:19.898957 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1047/2067] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Oct 9 00:57:19 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 09 00:57:19.903467 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9f0465-931a-4494-9a97-fbda69a28296 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:57:19.914649 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9f0465-931a-4494-9a97-fbda69a28296 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:57:19.919633 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24973f85-e9b7-44de-a9b7-a8e7f9766a54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:57:19.920400 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24973f85-e9b7-44de-a9b7-a8e7f9766a54 admin admin] REQUEST_METHOD: `PUT` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:57:19.920680 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24973f85-e9b7-44de-a9b7-a8e7f9766a54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:57:19.920953 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24973f85-e9b7-44de-a9b7-a8e7f9766a54 admin admin] PATH_INFO: `/v3/projects/b88ed96cd9234241b74cdcfd804caff0/users/eb32df1fb6e94dd9ba83cf8c5a712b26/roles/f69dddf26daf4dd79d4c962beb877af5` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:57:19.937418 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24973f85-e9b7-44de-a9b7-a8e7f9766a54 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b88ed96cd9234241b74cdcfd804caff0, user_id=eb32df1fb6e94dd9ba83cf8c5a712b26, role_id=f69dddf26daf4dd79d4c962beb877af5)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:57:19.940648 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24973f85-e9b7-44de-a9b7-a8e7f9766a54 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:57:19.958986 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1021/2068] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Oct 9 00:57:19 2022] PUT /identity/v3/projects/b88ed96cd9234241b74cdcfd804caff0/users/eb32df1fb6e94dd9ba83cf8c5a712b26/roles/f69dddf26daf4dd79d4c962beb877af5 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 00:57:19.963824 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce94e02d-0e37-4f4a-a204-426e5a06c126 admin admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:57:19.976790 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce94e02d-0e37-4f4a-a204-426e5a06c126 admin admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:57:20.036722 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf9a628-8d64-43e9-8f6e-24ea1a7918a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:57:20.037344 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf9a628-8d64-43e9-8f6e-24ea1a7918a0 admin admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:57:20.037624 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf9a628-8d64-43e9-8f6e-24ea1a7918a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:57:20.037986 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf9a628-8d64-43e9-8f6e-24ea1a7918a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:57:20.038554 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf9a628-8d64-43e9-8f6e-24ea1a7918a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:57:20.040226 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf9a628-8d64-43e9-8f6e-24ea1a7918a0 admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:57:20.052574 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1048/2069] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Oct 9 00:57:19 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 09 00:57:20.056667 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24973f85-e9b7-44de-a9b7-a8e7f9766a54 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:57:20.067481 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24973f85-e9b7-44de-a9b7-a8e7f9766a54 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:57:20.072300 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08301b2-2467-482b-97ef-c31b4e5f4222 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:57:20.072959 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08301b2-2467-482b-97ef-c31b4e5f4222 admin admin] REQUEST_METHOD: `PUT` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:57:20.073236 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08301b2-2467-482b-97ef-c31b4e5f4222 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:57:20.073504 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08301b2-2467-482b-97ef-c31b4e5f4222 admin admin] PATH_INFO: `/v3/projects/b88ed96cd9234241b74cdcfd804caff0/users/eb32df1fb6e94dd9ba83cf8c5a712b26/roles/f69dddf26daf4dd79d4c962beb877af5` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:57:20.075437 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08301b2-2467-482b-97ef-c31b4e5f4222 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b88ed96cd9234241b74cdcfd804caff0, user_id=eb32df1fb6e94dd9ba83cf8c5a712b26, role_id=f69dddf26daf4dd79d4c962beb877af5)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:57:20.078076 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08301b2-2467-482b-97ef-c31b4e5f4222 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:57:20.088747 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1022/2070] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Oct 9 00:57:20 2022] PUT /identity/v3/projects/b88ed96cd9234241b74cdcfd804caff0/users/eb32df1fb6e94dd9ba83cf8c5a712b26/roles/f69dddf26daf4dd79d4c962beb877af5 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 00:57:20.098912 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66eecf62-180e-4e3b-babe-c73137607351 None None] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:57:20.099508 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66eecf62-180e-4e3b-babe-c73137607351 None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:57:20.099630 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66eecf62-180e-4e3b-babe-c73137607351 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:57:20.132398 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.auth.core [None req-66eecf62-180e-4e3b-babe-c73137607351 None None] MFA Rules not processed for user `eb32df1fb6e94dd9ba83cf8c5a712b26`. Rule list: `[]` (Enabled: `True`). {{(pid=81525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:57:20.133644 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-66eecf62-180e-4e3b-babe-c73137607351 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:57:20.145127 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:57:20.212449 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1049/2071] 10.222.0.15 () {58 vars in 958 bytes} [Sun Oct 9 00:57:20 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:57:20.224647 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08301b2-2467-482b-97ef-c31b4e5f4222 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:57:20.226748 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-e08301b2-2467-482b-97ef-c31b4e5f4222 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:57:20.239329 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:57:20.290189 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08301b2-2467-482b-97ef-c31b4e5f4222 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:57:20.300346 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d7bbad-65d4-45cf-b921-57a02843e3da service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff7cb78bcd91467abe5c2e2b48aedd1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f148d39ced534860abfbe8fc3f98ace4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:57:20.300977 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d7bbad-65d4-45cf-b921-57a02843e3da service cinder] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:57:20.301215 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d7bbad-65d4-45cf-b921-57a02843e3da service cinder] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:57:20.301484 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d7bbad-65d4-45cf-b921-57a02843e3da service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:57:20.314389 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d7bbad-65d4-45cf-b921-57a02843e3da service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:57:20.316257 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d7bbad-65d4-45cf-b921-57a02843e3da service cinder] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:57:20.327317 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1023/2072] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Oct 9 00:57:20 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 09 00:57:20.850503 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66eecf62-180e-4e3b-babe-c73137607351 None None] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:57:20.918523 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66eecf62-180e-4e3b-babe-c73137607351 None None] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:57:20.923353 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf019be-0321-43df-ae34-223e69c3c274 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:57:20.924096 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf019be-0321-43df-ae34-223e69c3c274 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:57:20.924390 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf019be-0321-43df-ae34-223e69c3c274 admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:57:20.924664 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf019be-0321-43df-ae34-223e69c3c274 admin admin] PATH_INFO: `/v3/users/b254ccad998d4d849c492961f0fb4890` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:57:20.925832 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf019be-0321-43df-ae34-223e69c3c274 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b254ccad998d4d849c492961f0fb4890)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:57:20.928022 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf019be-0321-43df-ae34-223e69c3c274 admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:57:20.979237 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-6bf019be-0321-43df-ae34-223e69c3c274 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b254ccad998d4d849c492961f0fb4890'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:57:20.987514 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-6bf019be-0321-43df-ae34-223e69c3c274 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b254ccad998d4d849c492961f0fb4890'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:57:20.988376 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-6bf019be-0321-43df-ae34-223e69c3c274 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b254ccad998d4d849c492961f0fb4890'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:57:20.989152 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-6bf019be-0321-43df-ae34-223e69c3c274 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b254ccad998d4d849c492961f0fb4890'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:57:20.998271 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-6bf019be-0321-43df-ae34-223e69c3c274 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b254ccad998d4d849c492961f0fb4890'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:57:21.022027 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1050/2073] 10.222.0.15 () {58 vars in 1224 bytes} [Sun Oct 9 00:57:20 2022] DELETE /identity/v3/users/b254ccad998d4d849c492961f0fb4890 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 00:57:21.026908 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7832b3ef-907b-49e7-8b99-547063a344df None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:57:21.027288 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7832b3ef-907b-49e7-8b99-547063a344df None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:57:21.027627 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7832b3ef-907b-49e7-8b99-547063a344df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:57:21.047629 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-7832b3ef-907b-49e7-8b99-547063a344df None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:57:21.048868 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-7832b3ef-907b-49e7-8b99-547063a344df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:57:21.128065 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1024/2074] 10.222.0.15 () {58 vars in 958 bytes} [Sun Oct 9 00:57:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:57:21.138735 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf019be-0321-43df-ae34-223e69c3c274 admin admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:57:21.140349 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-6bf019be-0321-43df-ae34-223e69c3c274 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:57:21.182801 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:57:21.211771 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf019be-0321-43df-ae34-223e69c3c274 admin admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:57:21.216774 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c326b8dd-12d2-46e2-b7e9-4fe8324aa7fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4ef90d456d2483e8ddafbe2d4d4fb5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f148d39ced534860abfbe8fc3f98ace4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:57:21.217405 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c326b8dd-12d2-46e2-b7e9-4fe8324aa7fc service neutron] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:57:21.217683 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c326b8dd-12d2-46e2-b7e9-4fe8324aa7fc service neutron] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:57:21.217951 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c326b8dd-12d2-46e2-b7e9-4fe8324aa7fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:57:21.228444 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c326b8dd-12d2-46e2-b7e9-4fe8324aa7fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:57:21.229984 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c326b8dd-12d2-46e2-b7e9-4fe8324aa7fc service neutron] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:57:21.241265 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1051/2075] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Oct 9 00:57:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 09 00:57:21.951367 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7832b3ef-907b-49e7-8b99-547063a344df None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:57:21.953408 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-7832b3ef-907b-49e7-8b99-547063a344df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:57:21.967243 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7832b3ef-907b-49e7-8b99-547063a344df None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:57:21.987911 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28492214-0a0d-4ba3-81be-8ff52f960739 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:57:21.988595 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28492214-0a0d-4ba3-81be-8ff52f960739 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:57:21.988887 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28492214-0a0d-4ba3-81be-8ff52f960739 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:57:21.989133 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28492214-0a0d-4ba3-81be-8ff52f960739 admin admin] PATH_INFO: `/v3/projects/9b17ee837b7a4771a22748bcbb1b4b6e` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:57:21.991848 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28492214-0a0d-4ba3-81be-8ff52f960739 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9b17ee837b7a4771a22748bcbb1b4b6e)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:57:21.994277 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28492214-0a0d-4ba3-81be-8ff52f960739 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:57:22.059239 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-28492214-0a0d-4ba3-81be-8ff52f960739 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b17ee837b7a4771a22748bcbb1b4b6e', 'request_id': 'req-28492214-0a0d-4ba3-81be-8ff52f960739'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:57:22.070342 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-28492214-0a0d-4ba3-81be-8ff52f960739 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b17ee837b7a4771a22748bcbb1b4b6e', 'request_id': 'req-28492214-0a0d-4ba3-81be-8ff52f960739'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:57:22.077818 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-28492214-0a0d-4ba3-81be-8ff52f960739 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b17ee837b7a4771a22748bcbb1b4b6e', 'request_id': 'req-28492214-0a0d-4ba3-81be-8ff52f960739'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:57:22.091615 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-28492214-0a0d-4ba3-81be-8ff52f960739 admin admin] The token cache is being invalidate because project 9b17ee837b7a4771a22748bcbb1b4b6e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81524) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 09 00:57:22.092187 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-28492214-0a0d-4ba3-81be-8ff52f960739 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:57:22.093104 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-28492214-0a0d-4ba3-81be-8ff52f960739 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:57:22.095924 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1025/2076] 10.222.0.15 () {58 vars in 1233 bytes} [Sun Oct 9 00:57:21 2022] DELETE /identity/v3/projects/9b17ee837b7a4771a22748bcbb1b4b6e => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 00:57:22.100123 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c326b8dd-12d2-46e2-b7e9-4fe8324aa7fc service neutron] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:57:22.115935 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c326b8dd-12d2-46e2-b7e9-4fe8324aa7fc service neutron] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:57:22.190346 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dee932d-9c16-4af9-b65d-9dcdef0b2032 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:57:22.191815 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dee932d-9c16-4af9-b65d-9dcdef0b2032 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:57:22.192235 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dee932d-9c16-4af9-b65d-9dcdef0b2032 admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:57:22.192601 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dee932d-9c16-4af9-b65d-9dcdef0b2032 admin admin] PATH_INFO: `/v3/users/eb32df1fb6e94dd9ba83cf8c5a712b26` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:57:22.194270 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dee932d-9c16-4af9-b65d-9dcdef0b2032 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eb32df1fb6e94dd9ba83cf8c5a712b26)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:57:22.196806 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dee932d-9c16-4af9-b65d-9dcdef0b2032 admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:57:22.262083 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-4dee932d-9c16-4af9-b65d-9dcdef0b2032 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eb32df1fb6e94dd9ba83cf8c5a712b26'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:57:22.271867 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-4dee932d-9c16-4af9-b65d-9dcdef0b2032 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eb32df1fb6e94dd9ba83cf8c5a712b26'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:57:22.272798 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-4dee932d-9c16-4af9-b65d-9dcdef0b2032 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eb32df1fb6e94dd9ba83cf8c5a712b26'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:57:22.273467 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-4dee932d-9c16-4af9-b65d-9dcdef0b2032 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eb32df1fb6e94dd9ba83cf8c5a712b26'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:57:22.285371 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-4dee932d-9c16-4af9-b65d-9dcdef0b2032 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eb32df1fb6e94dd9ba83cf8c5a712b26'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:57:22.306756 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1052/2077] 10.222.0.15 () {58 vars in 1224 bytes} [Sun Oct 9 00:57:22 2022] DELETE /identity/v3/users/eb32df1fb6e94dd9ba83cf8c5a712b26 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 00:57:22.655182 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28492214-0a0d-4ba3-81be-8ff52f960739 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:57:22.656495 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-28492214-0a0d-4ba3-81be-8ff52f960739 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:57:22.660711 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dee932d-9c16-4af9-b65d-9dcdef0b2032 admin admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:57:22.662626 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-4dee932d-9c16-4af9-b65d-9dcdef0b2032 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:57:22.674100 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28492214-0a0d-4ba3-81be-8ff52f960739 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:57:22.735853 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:57:22.741343 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:57:22.758991 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dee932d-9c16-4af9-b65d-9dcdef0b2032 admin admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:57:22.766290 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181c51e0-fd65-4052-9210-eb3b8fede695 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:57:22.766953 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181c51e0-fd65-4052-9210-eb3b8fede695 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:57:22.767772 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181c51e0-fd65-4052-9210-eb3b8fede695 admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:57:22.769308 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181c51e0-fd65-4052-9210-eb3b8fede695 admin admin] PATH_INFO: `/v3/projects/b88ed96cd9234241b74cdcfd804caff0` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:57:22.771620 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181c51e0-fd65-4052-9210-eb3b8fede695 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b88ed96cd9234241b74cdcfd804caff0)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:57:22.774200 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181c51e0-fd65-4052-9210-eb3b8fede695 admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:57:22.790293 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8395259-8184-49e5-9ca0-b404356b5528 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:57:22.791017 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8395259-8184-49e5-9ca0-b404356b5528 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:57:22.795514 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8395259-8184-49e5-9ca0-b404356b5528 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:57:22.795948 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8395259-8184-49e5-9ca0-b404356b5528 admin admin] PATH_INFO: `/v3/users/a07b5b68f1eb4ecc915bdb473989262b` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:57:22.797569 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8395259-8184-49e5-9ca0-b404356b5528 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a07b5b68f1eb4ecc915bdb473989262b)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:57:22.799482 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8395259-8184-49e5-9ca0-b404356b5528 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:57:22.844505 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-181c51e0-fd65-4052-9210-eb3b8fede695 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b88ed96cd9234241b74cdcfd804caff0', 'request_id': 'req-181c51e0-fd65-4052-9210-eb3b8fede695'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:57:22.853229 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-181c51e0-fd65-4052-9210-eb3b8fede695 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b88ed96cd9234241b74cdcfd804caff0', 'request_id': 'req-181c51e0-fd65-4052-9210-eb3b8fede695'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:57:22.857732 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-c8395259-8184-49e5-9ca0-b404356b5528 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a07b5b68f1eb4ecc915bdb473989262b'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:57:22.861621 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-181c51e0-fd65-4052-9210-eb3b8fede695 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b88ed96cd9234241b74cdcfd804caff0', 'request_id': 'req-181c51e0-fd65-4052-9210-eb3b8fede695'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:57:22.865431 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-c8395259-8184-49e5-9ca0-b404356b5528 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a07b5b68f1eb4ecc915bdb473989262b'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:57:22.866149 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-c8395259-8184-49e5-9ca0-b404356b5528 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a07b5b68f1eb4ecc915bdb473989262b'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:57:22.866794 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-c8395259-8184-49e5-9ca0-b404356b5528 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a07b5b68f1eb4ecc915bdb473989262b'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:57:22.878854 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-181c51e0-fd65-4052-9210-eb3b8fede695 admin admin] The token cache is being invalidate because project b88ed96cd9234241b74cdcfd804caff0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81525) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 09 00:57:22.879305 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-c8395259-8184-49e5-9ca0-b404356b5528 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a07b5b68f1eb4ecc915bdb473989262b'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:57:22.879408 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-181c51e0-fd65-4052-9210-eb3b8fede695 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:57:22.879806 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-181c51e0-fd65-4052-9210-eb3b8fede695 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:57:22.881685 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1053/2078] 10.222.0.15 () {58 vars in 1233 bytes} [Sun Oct 9 00:57:22 2022] DELETE /identity/v3/projects/b88ed96cd9234241b74cdcfd804caff0 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 00:57:22.886380 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06b371b-8026-4972-a2cf-3997b38b5b09 None None] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:57:22.886713 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06b371b-8026-4972-a2cf-3997b38b5b09 None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:57:22.886992 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06b371b-8026-4972-a2cf-3997b38b5b09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:57:22.907787 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1026/2079] 10.222.0.15 () {58 vars in 1224 bytes} [Sun Oct 9 00:57:22 2022] DELETE /identity/v3/users/a07b5b68f1eb4ecc915bdb473989262b => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 00:57:22.908995 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.auth.core [None req-c06b371b-8026-4972-a2cf-3997b38b5b09 None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:57:22.910416 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-c06b371b-8026-4972-a2cf-3997b38b5b09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:57:22.912042 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7886ae8e-6286-4a20-a6c9-c1fee59e1721 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:57:22.912327 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7886ae8e-6286-4a20-a6c9-c1fee59e1721 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:57:22.912601 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7886ae8e-6286-4a20-a6c9-c1fee59e1721 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:57:22.936769 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-7886ae8e-6286-4a20-a6c9-c1fee59e1721 None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:57:22.937756 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-7886ae8e-6286-4a20-a6c9-c1fee59e1721 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:57:22.985349 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1054/2080] 10.222.0.15 () {58 vars in 958 bytes} [Sun Oct 9 00:57:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 09 00:57:22.994479 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6965eba1-0472-4bd7-895c-d1f6558c6986 None None] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:57:22.994762 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6965eba1-0472-4bd7-895c-d1f6558c6986 None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:57:22.995035 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6965eba1-0472-4bd7-895c-d1f6558c6986 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:57:23.007052 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1027/2081] 10.222.0.15 () {58 vars in 958 bytes} [Sun Oct 9 00:57:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:57:23.019166 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.auth.core [None req-6965eba1-0472-4bd7-895c-d1f6558c6986 None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:57:23.019859 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7886ae8e-6286-4a20-a6c9-c1fee59e1721 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:57:23.020372 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-6965eba1-0472-4bd7-895c-d1f6558c6986 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:57:23.021759 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-7886ae8e-6286-4a20-a6c9-c1fee59e1721 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:57:23.034925 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1055/2082] 10.222.0.15 () {58 vars in 958 bytes} [Sun Oct 9 00:57:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 09 00:57:23.039770 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6965eba1-0472-4bd7-895c-d1f6558c6986 None None] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:57:23.052863 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6965eba1-0472-4bd7-895c-d1f6558c6986 None None] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:57:23.058327 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9009e13e-110f-4c90-a8e4-8d352d49f4e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:57:23.058993 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9009e13e-110f-4c90-a8e4-8d352d49f4e6 admin admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:57:23.059361 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9009e13e-110f-4c90-a8e4-8d352d49f4e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:57:23.059681 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9009e13e-110f-4c90-a8e4-8d352d49f4e6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:57:23.060388 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9009e13e-110f-4c90-a8e4-8d352d49f4e6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:57:23.060690 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9009e13e-110f-4c90-a8e4-8d352d49f4e6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:57:23.062409 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9009e13e-110f-4c90-a8e4-8d352d49f4e6 admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:57:23.081789 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1056/2083] 10.222.0.15 () {58 vars in 1153 bytes} [Sun Oct 9 00:57:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 09 00:57:23.084119 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9009e13e-110f-4c90-a8e4-8d352d49f4e6 admin admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:57:23.096607 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9009e13e-110f-4c90-a8e4-8d352d49f4e6 admin admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:57:23.096858 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7886ae8e-6286-4a20-a6c9-c1fee59e1721 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:57:23.101295 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e40d00c-053f-4a2c-a940-527efaf4f78c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4ef90d456d2483e8ddafbe2d4d4fb5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f148d39ced534860abfbe8fc3f98ace4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:57:23.101915 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e40d00c-053f-4a2c-a940-527efaf4f78c service neutron] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:57:23.102190 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e40d00c-053f-4a2c-a940-527efaf4f78c service neutron] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:57:23.102471 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e40d00c-053f-4a2c-a940-527efaf4f78c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:57:23.105530 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c29f414-6dc7-4527-9440-46ec74ee3d54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:57:23.106417 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c29f414-6dc7-4527-9440-46ec74ee3d54 admin admin] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:57:23.106821 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c29f414-6dc7-4527-9440-46ec74ee3d54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:57:23.107328 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c29f414-6dc7-4527-9440-46ec74ee3d54 admin admin] PATH_INFO: `/v3/projects` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:57:23.108089 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c29f414-6dc7-4527-9440-46ec74ee3d54 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:57:23.110076 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c29f414-6dc7-4527-9440-46ec74ee3d54 admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:57:23.112723 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e40d00c-053f-4a2c-a940-527efaf4f78c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:57:23.114951 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e40d00c-053f-4a2c-a940-527efaf4f78c service neutron] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:57:23.119571 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:57:23.128951 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1028/2084] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Oct 9 00:57:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 09 00:57:23.151557 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1057/2085] 10.222.0.15 () {60 vars in 1153 bytes} [Sun Oct 9 00:57:23 2022] POST /identity/v3/projects => generated 357 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 09 00:57:23.153068 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e40d00c-053f-4a2c-a940-527efaf4f78c service neutron] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:57:23.165349 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e40d00c-053f-4a2c-a940-527efaf4f78c service neutron] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:57:23.250685 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fff0a9a-1c0a-4b5a-ad79-2b77efc41873 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:57:23.251407 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fff0a9a-1c0a-4b5a-ad79-2b77efc41873 admin admin] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:57:23.251806 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fff0a9a-1c0a-4b5a-ad79-2b77efc41873 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:57:23.252079 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fff0a9a-1c0a-4b5a-ad79-2b77efc41873 admin admin] PATH_INFO: `/v3/users` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:57:23.252733 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fff0a9a-1c0a-4b5a-ad79-2b77efc41873 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:57:23.254646 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fff0a9a-1c0a-4b5a-ad79-2b77efc41873 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:57:23.277258 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1029/2086] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Oct 9 00:57:23 2022] POST /identity/v3/users => generated 279 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 09 00:57:23.282892 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c29f414-6dc7-4527-9440-46ec74ee3d54 admin admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:57:23.309746 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c29f414-6dc7-4527-9440-46ec74ee3d54 admin admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:57:23.317443 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e565113f-0bee-4c19-8ff3-ea1cfc8b1e4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:57:23.318085 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e565113f-0bee-4c19-8ff3-ea1cfc8b1e4d admin admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:57:23.318480 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e565113f-0bee-4c19-8ff3-ea1cfc8b1e4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:57:23.318745 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e565113f-0bee-4c19-8ff3-ea1cfc8b1e4d admin admin] PATH_INFO: `/v3/roles` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:57:23.319670 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e565113f-0bee-4c19-8ff3-ea1cfc8b1e4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:57:23.321973 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e565113f-0bee-4c19-8ff3-ea1cfc8b1e4d admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:57:23.333349 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1058/2087] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Oct 9 00:57:23 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 09 00:57:23.337551 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fff0a9a-1c0a-4b5a-ad79-2b77efc41873 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:57:23.349096 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fff0a9a-1c0a-4b5a-ad79-2b77efc41873 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:57:23.354994 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6ded53-6f8d-4cbe-8c39-f7061bf8f89e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:57:23.355731 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6ded53-6f8d-4cbe-8c39-f7061bf8f89e admin admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:57:23.356014 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6ded53-6f8d-4cbe-8c39-f7061bf8f89e admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:57:23.356250 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6ded53-6f8d-4cbe-8c39-f7061bf8f89e admin admin] PATH_INFO: `/v3/roles` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:57:23.356900 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6ded53-6f8d-4cbe-8c39-f7061bf8f89e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:57:23.358564 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6ded53-6f8d-4cbe-8c39-f7061bf8f89e admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:57:23.373181 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1030/2088] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Oct 9 00:57:23 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 09 00:57:23.374419 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e565113f-0bee-4c19-8ff3-ea1cfc8b1e4d admin admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:57:23.385051 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e565113f-0bee-4c19-8ff3-ea1cfc8b1e4d admin admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:57:23.389978 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bd176b-f676-412e-8e4d-aee76c5465c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:57:23.390641 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bd176b-f676-412e-8e4d-aee76c5465c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:57:23.390917 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bd176b-f676-412e-8e4d-aee76c5465c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:57:23.391216 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bd176b-f676-412e-8e4d-aee76c5465c5 admin admin] PATH_INFO: `/v3/projects/98a1e34b79664ca98adcd7e6d029c7d7/users/661ed3797ccd467a82c951374f0d3808/roles/afb0a01183d9497795eaa4fa1a4046ae` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:57:23.408348 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bd176b-f676-412e-8e4d-aee76c5465c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=98a1e34b79664ca98adcd7e6d029c7d7, user_id=661ed3797ccd467a82c951374f0d3808, role_id=afb0a01183d9497795eaa4fa1a4046ae)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:57:23.413171 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bd176b-f676-412e-8e4d-aee76c5465c5 admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:57:23.425451 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6ded53-6f8d-4cbe-8c39-f7061bf8f89e admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:57:23.427814 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-dd6ded53-6f8d-4cbe-8c39-f7061bf8f89e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:57:23.433355 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1059/2089] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Oct 9 00:57:23 2022] PUT /identity/v3/projects/98a1e34b79664ca98adcd7e6d029c7d7/users/661ed3797ccd467a82c951374f0d3808/roles/afb0a01183d9497795eaa4fa1a4046ae => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 00:57:23.444771 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b65d899-f4d2-4f03-a26b-6efe8a6504a8 None None] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:57:23.444903 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b65d899-f4d2-4f03-a26b-6efe8a6504a8 None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:57:23.445132 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b65d899-f4d2-4f03-a26b-6efe8a6504a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:57:23.450877 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6ded53-6f8d-4cbe-8c39-f7061bf8f89e admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:57:23.456225 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:57:23.487529 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.auth.core [None req-4b65d899-f4d2-4f03-a26b-6efe8a6504a8 None None] MFA Rules not processed for user `661ed3797ccd467a82c951374f0d3808`. Rule list: `[]` (Enabled: `True`). {{(pid=81525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:57:23.489385 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-4b65d899-f4d2-4f03-a26b-6efe8a6504a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:57:23.510676 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe819d60-a9a3-44ef-a9e7-40eabab3d8d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:57:23.511391 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe819d60-a9a3-44ef-a9e7-40eabab3d8d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:57:23.511935 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe819d60-a9a3-44ef-a9e7-40eabab3d8d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:57:23.512069 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe819d60-a9a3-44ef-a9e7-40eabab3d8d1 admin admin] PATH_INFO: `/v3/projects/288269e173ae4155b5640873b0d56ec7` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:57:23.513538 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe819d60-a9a3-44ef-a9e7-40eabab3d8d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=288269e173ae4155b5640873b0d56ec7)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:57:23.515480 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe819d60-a9a3-44ef-a9e7-40eabab3d8d1 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:57:23.573701 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1060/2090] 10.222.0.15 () {58 vars in 958 bytes} [Sun Oct 9 00:57:23 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 09 00:57:23.577510 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-fe819d60-a9a3-44ef-a9e7-40eabab3d8d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '288269e173ae4155b5640873b0d56ec7', 'request_id': 'req-fe819d60-a9a3-44ef-a9e7-40eabab3d8d1'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:57:23.578261 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b65d899-f4d2-4f03-a26b-6efe8a6504a8 None None] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:57:23.586669 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-fe819d60-a9a3-44ef-a9e7-40eabab3d8d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '288269e173ae4155b5640873b0d56ec7', 'request_id': 'req-fe819d60-a9a3-44ef-a9e7-40eabab3d8d1'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:57:23.590276 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b65d899-f4d2-4f03-a26b-6efe8a6504a8 None None] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:57:23.594530 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-fe819d60-a9a3-44ef-a9e7-40eabab3d8d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '288269e173ae4155b5640873b0d56ec7', 'request_id': 'req-fe819d60-a9a3-44ef-a9e7-40eabab3d8d1'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:57:23.608222 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-fe819d60-a9a3-44ef-a9e7-40eabab3d8d1 admin admin] The token cache is being invalidate because project 288269e173ae4155b5640873b0d56ec7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81524) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 09 00:57:23.608518 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-fe819d60-a9a3-44ef-a9e7-40eabab3d8d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:57:23.609307 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-fe819d60-a9a3-44ef-a9e7-40eabab3d8d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:57:23.610830 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1031/2091] 10.222.0.15 () {58 vars in 1233 bytes} [Sun Oct 9 00:57:23 2022] DELETE /identity/v3/projects/288269e173ae4155b5640873b0d56ec7 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 00:57:23.615597 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd6123f-b7c4-4a56-9cf8-9661738441d8 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:57:23.615872 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd6123f-b7c4-4a56-9cf8-9661738441d8 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:57:23.616139 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd6123f-b7c4-4a56-9cf8-9661738441d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:57:23.631604 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:57:23.637570 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-8bd6123f-b7c4-4a56-9cf8-9661738441d8 None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:57:23.639122 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-8bd6123f-b7c4-4a56-9cf8-9661738441d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:57:23.651155 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e264974e-bbf1-4d13-9698-a490e1a65094 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:57:23.651903 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e264974e-bbf1-4d13-9698-a490e1a65094 admin admin] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:57:23.652086 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e264974e-bbf1-4d13-9698-a490e1a65094 admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:57:23.652349 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e264974e-bbf1-4d13-9698-a490e1a65094 admin admin] PATH_INFO: `/v3/projects` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:57:23.652996 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e264974e-bbf1-4d13-9698-a490e1a65094 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:57:23.654906 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e264974e-bbf1-4d13-9698-a490e1a65094 admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:57:23.689057 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1061/2092] 10.222.0.15 () {60 vars in 1153 bytes} [Sun Oct 9 00:57:23 2022] POST /identity/v3/projects => generated 357 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 09 00:57:23.690640 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e264974e-bbf1-4d13-9698-a490e1a65094 admin admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:57:23.692816 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-e264974e-bbf1-4d13-9698-a490e1a65094 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:57:23.707226 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1032/2093] 10.222.0.15 () {58 vars in 958 bytes} [Sun Oct 9 00:57:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 09 00:57:23.716976 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dc31e2-e3bc-4831-bb4d-5bafc2c249fb None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:57:23.717228 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dc31e2-e3bc-4831-bb4d-5bafc2c249fb None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:57:23.717499 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dc31e2-e3bc-4831-bb4d-5bafc2c249fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:57:23.740590 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-b7dc31e2-e3bc-4831-bb4d-5bafc2c249fb None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:57:23.742119 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-b7dc31e2-e3bc-4831-bb4d-5bafc2c249fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:57:23.767168 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e264974e-bbf1-4d13-9698-a490e1a65094 admin admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:57:23.772427 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65fafb3-b684-4544-84d3-ed6bd523f188 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:57:23.773060 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65fafb3-b684-4544-84d3-ed6bd523f188 admin admin] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:57:23.773427 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65fafb3-b684-4544-84d3-ed6bd523f188 admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:57:23.773698 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65fafb3-b684-4544-84d3-ed6bd523f188 admin admin] PATH_INFO: `/v3/users` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:57:23.774331 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65fafb3-b684-4544-84d3-ed6bd523f188 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:57:23.776403 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65fafb3-b684-4544-84d3-ed6bd523f188 admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:57:23.802970 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1062/2094] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Oct 9 00:57:23 2022] POST /identity/v3/users => generated 285 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 09 00:57:23.806824 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65fafb3-b684-4544-84d3-ed6bd523f188 admin admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:57:23.812354 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1033/2095] 10.222.0.15 () {58 vars in 958 bytes} [Sun Oct 9 00:57:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:57:23.814128 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dc31e2-e3bc-4831-bb4d-5bafc2c249fb None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:57:23.818033 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65fafb3-b684-4544-84d3-ed6bd523f188 admin admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:57:23.824709 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafcece3-8ca0-4d81-bc48-bd8fec48fb1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:57:23.825288 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dc31e2-e3bc-4831-bb4d-5bafc2c249fb None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:57:23.825422 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafcece3-8ca0-4d81-bc48-bd8fec48fb1f admin admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:57:23.825611 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafcece3-8ca0-4d81-bc48-bd8fec48fb1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:57:23.825883 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafcece3-8ca0-4d81-bc48-bd8fec48fb1f admin admin] PATH_INFO: `/v3/roles` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:57:23.826638 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafcece3-8ca0-4d81-bc48-bd8fec48fb1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:57:23.828364 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafcece3-8ca0-4d81-bc48-bd8fec48fb1f admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:57:23.831110 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:57:23.831584 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d780d05e-a85c-40a1-86c0-593d9d4f6e2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:57:23.832846 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d780d05e-a85c-40a1-86c0-593d9d4f6e2a admin admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:57:23.833748 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d780d05e-a85c-40a1-86c0-593d9d4f6e2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:57:23.835045 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d780d05e-a85c-40a1-86c0-593d9d4f6e2a admin admin] PATH_INFO: `/v3/domains` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:57:23.836047 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d780d05e-a85c-40a1-86c0-593d9d4f6e2a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:57:23.836417 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d780d05e-a85c-40a1-86c0-593d9d4f6e2a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:57:23.838296 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d780d05e-a85c-40a1-86c0-593d9d4f6e2a admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:57:23.842290 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1063/2096] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Oct 9 00:57:23 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 09 00:57:23.846539 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafcece3-8ca0-4d81-bc48-bd8fec48fb1f admin admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:57:23.855700 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1034/2097] 10.222.0.15 () {58 vars in 1153 bytes} [Sun Oct 9 00:57:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:57:23.857079 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d780d05e-a85c-40a1-86c0-593d9d4f6e2a admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:57:23.861817 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafcece3-8ca0-4d81-bc48-bd8fec48fb1f admin admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:57:23.868144 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f129508-edc6-48cc-b3c8-b01ddec85870 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:57:23.868330 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d780d05e-a85c-40a1-86c0-593d9d4f6e2a admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:57:23.869400 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f129508-edc6-48cc-b3c8-b01ddec85870 admin admin] REQUEST_METHOD: `PUT` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:57:23.869892 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f129508-edc6-48cc-b3c8-b01ddec85870 admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:57:23.870237 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f129508-edc6-48cc-b3c8-b01ddec85870 admin admin] PATH_INFO: `/v3/projects/92380d8e80224478a78478d9ab962ba5/users/542e76c350be413387dc0fcf6be9ec6b/roles/f69dddf26daf4dd79d4c962beb877af5` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:57:23.875792 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f02877-90df-4555-ac7f-c909dfe0345d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:57:23.876479 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f02877-90df-4555-ac7f-c909dfe0345d admin admin] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:57:23.876829 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f02877-90df-4555-ac7f-c909dfe0345d admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:57:23.877172 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f02877-90df-4555-ac7f-c909dfe0345d admin admin] PATH_INFO: `/v3/projects` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:57:23.877888 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f02877-90df-4555-ac7f-c909dfe0345d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:57:23.879934 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f02877-90df-4555-ac7f-c909dfe0345d admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:57:23.887739 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f129508-edc6-48cc-b3c8-b01ddec85870 admin admin] RBAC: Authorizing `identity:create_grant(project_id=92380d8e80224478a78478d9ab962ba5, user_id=542e76c350be413387dc0fcf6be9ec6b, role_id=f69dddf26daf4dd79d4c962beb877af5)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:57:23.891528 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f129508-edc6-48cc-b3c8-b01ddec85870 admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:57:23.914892 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1064/2098] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Oct 9 00:57:23 2022] PUT /identity/v3/projects/92380d8e80224478a78478d9ab962ba5/users/542e76c350be413387dc0fcf6be9ec6b/roles/f69dddf26daf4dd79d4c962beb877af5 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 09 00:57:23.918890 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f129508-edc6-48cc-b3c8-b01ddec85870 admin admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:57:23.923461 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1035/2099] 10.222.0.15 () {60 vars in 1153 bytes} [Sun Oct 9 00:57:23 2022] POST /identity/v3/projects => generated 399 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 09 00:57:23.924543 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f02877-90df-4555-ac7f-c909dfe0345d admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:57:23.999947 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f02877-90df-4555-ac7f-c909dfe0345d admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:57:24.004550 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8a627f-95c1-4986-81de-c862121b2282 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:57:24.004852 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f129508-edc6-48cc-b3c8-b01ddec85870 admin admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:57:24.005181 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8a627f-95c1-4986-81de-c862121b2282 admin admin] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:57:24.005450 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8a627f-95c1-4986-81de-c862121b2282 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:57:24.005723 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8a627f-95c1-4986-81de-c862121b2282 admin admin] PATH_INFO: `/v3/users` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:57:24.006497 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8a627f-95c1-4986-81de-c862121b2282 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:57:24.008437 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8a627f-95c1-4986-81de-c862121b2282 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:57:24.009734 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35cf5c5-97ed-4649-a8b0-fda86d39fff2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:57:24.010347 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35cf5c5-97ed-4649-a8b0-fda86d39fff2 admin admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:57:24.010618 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35cf5c5-97ed-4649-a8b0-fda86d39fff2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:57:24.010884 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35cf5c5-97ed-4649-a8b0-fda86d39fff2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:57:24.011657 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35cf5c5-97ed-4649-a8b0-fda86d39fff2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:57:24.013137 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35cf5c5-97ed-4649-a8b0-fda86d39fff2 admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:57:24.024079 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1065/2100] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Oct 9 00:57:23 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 09 00:57:24.029249 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35cf5c5-97ed-4649-a8b0-fda86d39fff2 admin admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:57:24.033124 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1036/2101] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Oct 9 00:57:23 2022] POST /identity/v3/users => generated 300 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 09 00:57:24.037714 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8a627f-95c1-4986-81de-c862121b2282 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:57:24.040516 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35cf5c5-97ed-4649-a8b0-fda86d39fff2 admin admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:57:24.043145 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:57:24.045606 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a724b2-c194-46c3-8bea-5e3d033486f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:57:24.046333 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a724b2-c194-46c3-8bea-5e3d033486f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:57:24.046619 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a724b2-c194-46c3-8bea-5e3d033486f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:57:24.046883 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a724b2-c194-46c3-8bea-5e3d033486f1 admin admin] PATH_INFO: `/v3/projects/92380d8e80224478a78478d9ab962ba5/users/542e76c350be413387dc0fcf6be9ec6b/roles/f69dddf26daf4dd79d4c962beb877af5` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:57:24.049428 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8a627f-95c1-4986-81de-c862121b2282 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:57:24.049698 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a724b2-c194-46c3-8bea-5e3d033486f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=92380d8e80224478a78478d9ab962ba5, user_id=542e76c350be413387dc0fcf6be9ec6b, role_id=f69dddf26daf4dd79d4c962beb877af5)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:57:24.052480 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a724b2-c194-46c3-8bea-5e3d033486f1 admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:57:24.054554 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76c5eab-33a0-440a-9a22-6a0889b81413 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:57:24.055163 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76c5eab-33a0-440a-9a22-6a0889b81413 admin admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:57:24.055468 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76c5eab-33a0-440a-9a22-6a0889b81413 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:57:24.055769 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76c5eab-33a0-440a-9a22-6a0889b81413 admin admin] PATH_INFO: `/v3/roles` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:57:24.056415 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76c5eab-33a0-440a-9a22-6a0889b81413 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:57:24.058043 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76c5eab-33a0-440a-9a22-6a0889b81413 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:57:24.063729 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1066/2102] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Oct 9 00:57:24 2022] PUT /identity/v3/projects/92380d8e80224478a78478d9ab962ba5/users/542e76c350be413387dc0fcf6be9ec6b/roles/f69dddf26daf4dd79d4c962beb877af5 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 09 00:57:24.071344 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1037/2103] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Oct 9 00:57:24 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 09 00:57:24.073068 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a724b2-c194-46c3-8bea-5e3d033486f1 admin admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:57:24.073434 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe74bf1b-d597-4c39-9fd0-a38016fb034c None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:57:24.073743 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe74bf1b-d597-4c39-9fd0-a38016fb034c None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:57:24.074013 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe74bf1b-d597-4c39-9fd0-a38016fb034c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:57:24.104266 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-fe74bf1b-d597-4c39-9fd0-a38016fb034c None None] MFA Rules not processed for user `542e76c350be413387dc0fcf6be9ec6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:57:24.106161 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-fe74bf1b-d597-4c39-9fd0-a38016fb034c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:57:24.139042 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a724b2-c194-46c3-8bea-5e3d033486f1 admin admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:57:24.144188 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffd0ed5-d7df-469b-bbe0-26e07467c2a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:57:24.144799 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffd0ed5-d7df-469b-bbe0-26e07467c2a9 admin admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:57:24.145071 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffd0ed5-d7df-469b-bbe0-26e07467c2a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:57:24.145337 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffd0ed5-d7df-469b-bbe0-26e07467c2a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:57:24.146142 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffd0ed5-d7df-469b-bbe0-26e07467c2a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:57:24.147766 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffd0ed5-d7df-469b-bbe0-26e07467c2a9 admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:57:24.158058 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1067/2104] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Oct 9 00:57:24 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 09 00:57:24.162562 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffd0ed5-d7df-469b-bbe0-26e07467c2a9 admin admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:57:24.172845 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffd0ed5-d7df-469b-bbe0-26e07467c2a9 admin admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:57:24.177935 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9be998f-dca5-4ba7-b0e1-51c1b5feccda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:57:24.178655 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9be998f-dca5-4ba7-b0e1-51c1b5feccda admin admin] REQUEST_METHOD: `PUT` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:57:24.178840 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9be998f-dca5-4ba7-b0e1-51c1b5feccda admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:57:24.179128 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9be998f-dca5-4ba7-b0e1-51c1b5feccda admin admin] PATH_INFO: `/v3/projects/04f5e1766a8b4fdfb255fa82fdb60e63/users/2b937f0c6f7d4a50b8aecd64a88f6d7d/roles/afb0a01183d9497795eaa4fa1a4046ae` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:57:24.179292 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1038/2105] 10.222.0.15 () {58 vars in 958 bytes} [Sun Oct 9 00:57:24 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 09 00:57:24.194022 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe74bf1b-d597-4c39-9fd0-a38016fb034c None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:57:24.196065 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-fe74bf1b-d597-4c39-9fd0-a38016fb034c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:57:24.201135 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9be998f-dca5-4ba7-b0e1-51c1b5feccda admin admin] RBAC: Authorizing `identity:create_grant(project_id=04f5e1766a8b4fdfb255fa82fdb60e63, user_id=2b937f0c6f7d4a50b8aecd64a88f6d7d, role_id=afb0a01183d9497795eaa4fa1a4046ae)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:57:24.204180 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9be998f-dca5-4ba7-b0e1-51c1b5feccda admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:57:24.225056 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1068/2106] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Oct 9 00:57:24 2022] PUT /identity/v3/projects/04f5e1766a8b4fdfb255fa82fdb60e63/users/2b937f0c6f7d4a50b8aecd64a88f6d7d/roles/afb0a01183d9497795eaa4fa1a4046ae => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 09 00:57:24.237138 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fa0509-1509-418e-a97e-3636a05037a4 None None] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:57:24.237423 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fa0509-1509-418e-a97e-3636a05037a4 None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:57:24.237691 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fa0509-1509-418e-a97e-3636a05037a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:57:24.272665 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.auth.core [None req-52fa0509-1509-418e-a97e-3636a05037a4 None None] MFA Rules not processed for user `2b937f0c6f7d4a50b8aecd64a88f6d7d`. Rule list: `[]` (Enabled: `True`). {{(pid=81525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:57:24.272665 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-52fa0509-1509-418e-a97e-3636a05037a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:57:24.275429 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe74bf1b-d597-4c39-9fd0-a38016fb034c None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:57:24.291477 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:57:24.336042 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ac7152-5f7b-486d-91c2-8d1fb56143d7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff7cb78bcd91467abe5c2e2b48aedd1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f148d39ced534860abfbe8fc3f98ace4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:57:24.336924 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ac7152-5f7b-486d-91c2-8d1fb56143d7 service cinder] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:57:24.337285 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ac7152-5f7b-486d-91c2-8d1fb56143d7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:57:24.338062 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ac7152-5f7b-486d-91c2-8d1fb56143d7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:57:24.352269 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1069/2107] 10.222.0.15 () {58 vars in 958 bytes} [Sun Oct 9 00:57:24 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 09 00:57:24.365176 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fa0509-1509-418e-a97e-3636a05037a4 None None] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:57:24.366487 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-52fa0509-1509-418e-a97e-3636a05037a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:57:24.380074 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fa0509-1509-418e-a97e-3636a05037a4 None None] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:57:24.389004 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e847c3-0e41-4b5c-87bb-077cddfe2e5f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff7cb78bcd91467abe5c2e2b48aedd1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f148d39ced534860abfbe8fc3f98ace4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:57:24.389732 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e847c3-0e41-4b5c-87bb-077cddfe2e5f service cinder] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:57:24.390097 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e847c3-0e41-4b5c-87bb-077cddfe2e5f service cinder] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:57:24.390453 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e847c3-0e41-4b5c-87bb-077cddfe2e5f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:57:24.396701 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:57:24.399434 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e847c3-0e41-4b5c-87bb-077cddfe2e5f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:57:24.401166 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e847c3-0e41-4b5c-87bb-077cddfe2e5f service cinder] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:57:24.410881 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1070/2108] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Oct 9 00:57:24 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 09 00:57:24.413839 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ac7152-5f7b-486d-91c2-8d1fb56143d7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:57:24.415374 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ac7152-5f7b-486d-91c2-8d1fb56143d7 service cinder] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:57:24.426863 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1039/2109] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Oct 9 00:57:24 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 09 00:57:24.535403 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e847c3-0e41-4b5c-87bb-077cddfe2e5f service cinder] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:57:24.545460 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e847c3-0e41-4b5c-87bb-077cddfe2e5f service cinder] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:57:24.550431 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d02db6-dacc-4559-b7e7-2b6be210e164 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff7cb78bcd91467abe5c2e2b48aedd1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f148d39ced534860abfbe8fc3f98ace4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:57:24.551042 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d02db6-dacc-4559-b7e7-2b6be210e164 service cinder] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:57:24.551341 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d02db6-dacc-4559-b7e7-2b6be210e164 service cinder] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:57:24.551615 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d02db6-dacc-4559-b7e7-2b6be210e164 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:57:24.553595 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-24d02db6-dacc-4559-b7e7-2b6be210e164 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:57:24.618839 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d02db6-dacc-4559-b7e7-2b6be210e164 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:57:24.620339 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d02db6-dacc-4559-b7e7-2b6be210e164 service cinder] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:57:24.630570 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1071/2110] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Oct 9 00:57:24 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 09 00:57:29.790744 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ac7152-5f7b-486d-91c2-8d1fb56143d7 service cinder] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:57:29.871282 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ac7152-5f7b-486d-91c2-8d1fb56143d7 service cinder] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:57:29.876800 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f33dbe6-6fb4-4e6d-9e1f-28b865a8b3cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:57:29.877427 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f33dbe6-6fb4-4e6d-9e1f-28b865a8b3cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:57:29.877726 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f33dbe6-6fb4-4e6d-9e1f-28b865a8b3cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:57:29.877995 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f33dbe6-6fb4-4e6d-9e1f-28b865a8b3cf admin admin] PATH_INFO: `/v3/users/2b937f0c6f7d4a50b8aecd64a88f6d7d` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:57:29.879535 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f33dbe6-6fb4-4e6d-9e1f-28b865a8b3cf admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b937f0c6f7d4a50b8aecd64a88f6d7d)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:57:29.881465 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f33dbe6-6fb4-4e6d-9e1f-28b865a8b3cf admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:57:29.950388 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-3f33dbe6-6fb4-4e6d-9e1f-28b865a8b3cf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b937f0c6f7d4a50b8aecd64a88f6d7d'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:57:29.957833 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-3f33dbe6-6fb4-4e6d-9e1f-28b865a8b3cf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b937f0c6f7d4a50b8aecd64a88f6d7d'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:57:29.958532 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-3f33dbe6-6fb4-4e6d-9e1f-28b865a8b3cf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b937f0c6f7d4a50b8aecd64a88f6d7d'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:57:29.959311 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-3f33dbe6-6fb4-4e6d-9e1f-28b865a8b3cf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b937f0c6f7d4a50b8aecd64a88f6d7d'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:57:29.968286 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-3f33dbe6-6fb4-4e6d-9e1f-28b865a8b3cf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b937f0c6f7d4a50b8aecd64a88f6d7d'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:57:29.993425 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1040/2111] 10.222.0.15 () {58 vars in 1224 bytes} [Sun Oct 9 00:57:29 2022] DELETE /identity/v3/users/2b937f0c6f7d4a50b8aecd64a88f6d7d => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 00:57:29.998501 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dedb8b-5274-4131-b96d-d747923ff859 None None] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:57:29.999004 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dedb8b-5274-4131-b96d-d747923ff859 None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:57:29.999149 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dedb8b-5274-4131-b96d-d747923ff859 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:57:30.018567 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.auth.core [None req-69dedb8b-5274-4131-b96d-d747923ff859 None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:57:30.019716 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-69dedb8b-5274-4131-b96d-d747923ff859 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:57:30.084516 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1072/2112] 10.222.0.15 () {58 vars in 958 bytes} [Sun Oct 9 00:57:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:57:30.094633 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f33dbe6-6fb4-4e6d-9e1f-28b865a8b3cf admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:57:30.096227 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-3f33dbe6-6fb4-4e6d-9e1f-28b865a8b3cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:57:30.170814 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f33dbe6-6fb4-4e6d-9e1f-28b865a8b3cf admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:57:30.175928 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6cb53a-2655-4dcd-80d9-2ee4d5bd3132 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4ef90d456d2483e8ddafbe2d4d4fb5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f148d39ced534860abfbe8fc3f98ace4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:57:30.176544 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6cb53a-2655-4dcd-80d9-2ee4d5bd3132 service neutron] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:57:30.176817 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6cb53a-2655-4dcd-80d9-2ee4d5bd3132 service neutron] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:57:30.177087 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6cb53a-2655-4dcd-80d9-2ee4d5bd3132 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:57:30.192166 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6cb53a-2655-4dcd-80d9-2ee4d5bd3132 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:57:30.192166 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6cb53a-2655-4dcd-80d9-2ee4d5bd3132 service neutron] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:57:30.203777 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1041/2113] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Oct 9 00:57:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 09 00:57:30.591450 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dedb8b-5274-4131-b96d-d747923ff859 None None] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:57:30.591450 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-69dedb8b-5274-4131-b96d-d747923ff859 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:57:30.605595 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dedb8b-5274-4131-b96d-d747923ff859 None None] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:57:30.611814 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f596ef-5243-4ebc-9456-3f11b485c072 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:57:30.612844 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f596ef-5243-4ebc-9456-3f11b485c072 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:57:30.613122 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f596ef-5243-4ebc-9456-3f11b485c072 admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:57:30.613399 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f596ef-5243-4ebc-9456-3f11b485c072 admin admin] PATH_INFO: `/v3/projects/04f5e1766a8b4fdfb255fa82fdb60e63` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:57:30.614588 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f596ef-5243-4ebc-9456-3f11b485c072 admin admin] RBAC: Authorizing `identity:delete_project(project_id=04f5e1766a8b4fdfb255fa82fdb60e63)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:57:30.616583 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f596ef-5243-4ebc-9456-3f11b485c072 admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:57:30.660129 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:57:30.667838 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-06f596ef-5243-4ebc-9456-3f11b485c072 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '04f5e1766a8b4fdfb255fa82fdb60e63', 'request_id': 'req-06f596ef-5243-4ebc-9456-3f11b485c072'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:57:30.676858 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-06f596ef-5243-4ebc-9456-3f11b485c072 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '04f5e1766a8b4fdfb255fa82fdb60e63', 'request_id': 'req-06f596ef-5243-4ebc-9456-3f11b485c072'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:57:30.683344 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-06f596ef-5243-4ebc-9456-3f11b485c072 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '04f5e1766a8b4fdfb255fa82fdb60e63', 'request_id': 'req-06f596ef-5243-4ebc-9456-3f11b485c072'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:57:30.695110 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-06f596ef-5243-4ebc-9456-3f11b485c072 admin admin] The token cache is being invalidate because project 04f5e1766a8b4fdfb255fa82fdb60e63 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81525) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 09 00:57:30.695532 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-06f596ef-5243-4ebc-9456-3f11b485c072 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:57:30.696109 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-06f596ef-5243-4ebc-9456-3f11b485c072 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:57:30.697702 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1073/2114] 10.222.0.15 () {58 vars in 1233 bytes} [Sun Oct 9 00:57:30 2022] DELETE /identity/v3/projects/04f5e1766a8b4fdfb255fa82fdb60e63 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 00:57:40.014016 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6cb53a-2655-4dcd-80d9-2ee4d5bd3132 service neutron] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:57:40.015613 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-6c6cb53a-2655-4dcd-80d9-2ee4d5bd3132 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:57:40.024858 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:57:40.031122 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6cb53a-2655-4dcd-80d9-2ee4d5bd3132 service neutron] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:57:40.092604 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4457931c-bdf7-4f13-8f71-3da54bcfacd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:57:40.093515 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4457931c-bdf7-4f13-8f71-3da54bcfacd2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:57:40.093793 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4457931c-bdf7-4f13-8f71-3da54bcfacd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:57:40.094061 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4457931c-bdf7-4f13-8f71-3da54bcfacd2 admin admin] PATH_INFO: `/v3/users/661ed3797ccd467a82c951374f0d3808` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:57:40.095195 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4457931c-bdf7-4f13-8f71-3da54bcfacd2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=661ed3797ccd467a82c951374f0d3808)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:57:40.097483 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4457931c-bdf7-4f13-8f71-3da54bcfacd2 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:57:40.147504 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-4457931c-bdf7-4f13-8f71-3da54bcfacd2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '661ed3797ccd467a82c951374f0d3808'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:57:40.154313 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-4457931c-bdf7-4f13-8f71-3da54bcfacd2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '661ed3797ccd467a82c951374f0d3808'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:57:40.154983 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-4457931c-bdf7-4f13-8f71-3da54bcfacd2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '661ed3797ccd467a82c951374f0d3808'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:57:40.155561 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-4457931c-bdf7-4f13-8f71-3da54bcfacd2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '661ed3797ccd467a82c951374f0d3808'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:57:40.165599 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-4457931c-bdf7-4f13-8f71-3da54bcfacd2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '661ed3797ccd467a82c951374f0d3808'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:57:40.182445 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1042/2115] 10.222.0.15 () {58 vars in 1224 bytes} [Sun Oct 9 00:57:40 2022] DELETE /identity/v3/users/661ed3797ccd467a82c951374f0d3808 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 00:57:40.187325 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102b1fc3-beff-4ea1-87d1-569a44c05009 None None] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:57:40.187813 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102b1fc3-beff-4ea1-87d1-569a44c05009 None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:57:40.187913 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102b1fc3-beff-4ea1-87d1-569a44c05009 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:57:40.208279 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.auth.core [None req-102b1fc3-beff-4ea1-87d1-569a44c05009 None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:57:40.209478 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-102b1fc3-beff-4ea1-87d1-569a44c05009 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:57:40.276489 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1074/2116] 10.222.0.15 () {58 vars in 958 bytes} [Sun Oct 9 00:57:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:57:40.283496 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4457931c-bdf7-4f13-8f71-3da54bcfacd2 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:57:40.284974 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-4457931c-bdf7-4f13-8f71-3da54bcfacd2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:57:40.354899 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4457931c-bdf7-4f13-8f71-3da54bcfacd2 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:57:40.359186 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d414d556-02aa-4042-a6b6-385ddfc9299d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4ef90d456d2483e8ddafbe2d4d4fb5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f148d39ced534860abfbe8fc3f98ace4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:57:40.359834 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d414d556-02aa-4042-a6b6-385ddfc9299d service neutron] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:57:40.360108 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d414d556-02aa-4042-a6b6-385ddfc9299d service neutron] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:57:40.360375 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d414d556-02aa-4042-a6b6-385ddfc9299d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:57:40.370576 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d414d556-02aa-4042-a6b6-385ddfc9299d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:57:40.372398 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d414d556-02aa-4042-a6b6-385ddfc9299d service neutron] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:57:40.381901 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1043/2117] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Oct 9 00:57:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 09 00:57:40.677712 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102b1fc3-beff-4ea1-87d1-569a44c05009 None None] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:57:40.679204 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-102b1fc3-beff-4ea1-87d1-569a44c05009 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:57:40.694156 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102b1fc3-beff-4ea1-87d1-569a44c05009 None None] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:57:40.701188 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e15c98-799d-4dca-9b57-de5f052f9973 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:57:40.701847 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e15c98-799d-4dca-9b57-de5f052f9973 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:57:40.702195 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e15c98-799d-4dca-9b57-de5f052f9973 admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:57:40.702375 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e15c98-799d-4dca-9b57-de5f052f9973 admin admin] PATH_INFO: `/v3/projects/98a1e34b79664ca98adcd7e6d029c7d7` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:57:40.703789 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e15c98-799d-4dca-9b57-de5f052f9973 admin admin] RBAC: Authorizing `identity:delete_project(project_id=98a1e34b79664ca98adcd7e6d029c7d7)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:57:40.705778 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e15c98-799d-4dca-9b57-de5f052f9973 admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:57:40.764880 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-d0e15c98-799d-4dca-9b57-de5f052f9973 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '98a1e34b79664ca98adcd7e6d029c7d7', 'request_id': 'req-d0e15c98-799d-4dca-9b57-de5f052f9973'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:57:40.774352 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-d0e15c98-799d-4dca-9b57-de5f052f9973 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '98a1e34b79664ca98adcd7e6d029c7d7', 'request_id': 'req-d0e15c98-799d-4dca-9b57-de5f052f9973'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:57:40.781095 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-d0e15c98-799d-4dca-9b57-de5f052f9973 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '98a1e34b79664ca98adcd7e6d029c7d7', 'request_id': 'req-d0e15c98-799d-4dca-9b57-de5f052f9973'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:57:40.793092 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-d0e15c98-799d-4dca-9b57-de5f052f9973 admin admin] The token cache is being invalidate because project 98a1e34b79664ca98adcd7e6d029c7d7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81525) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 09 00:57:40.793378 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-d0e15c98-799d-4dca-9b57-de5f052f9973 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:57:40.794112 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-d0e15c98-799d-4dca-9b57-de5f052f9973 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:57:40.795771 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1075/2118] 10.222.0.15 () {58 vars in 1233 bytes} [Sun Oct 9 00:57:40 2022] DELETE /identity/v3/projects/98a1e34b79664ca98adcd7e6d029c7d7 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 00:57:40.799925 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d414d556-02aa-4042-a6b6-385ddfc9299d service neutron] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:57:40.809963 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d414d556-02aa-4042-a6b6-385ddfc9299d service neutron] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:57:40.834148 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:57:40.872623 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69075689-37f2-4077-bcb9-f7aadf6f91bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:57:40.873418 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69075689-37f2-4077-bcb9-f7aadf6f91bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:57:40.873546 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69075689-37f2-4077-bcb9-f7aadf6f91bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:57:40.873832 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69075689-37f2-4077-bcb9-f7aadf6f91bf admin admin] PATH_INFO: `/v3/users/542e76c350be413387dc0fcf6be9ec6b` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:57:40.875031 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69075689-37f2-4077-bcb9-f7aadf6f91bf admin admin] RBAC: Authorizing `identity:delete_user(user_id=542e76c350be413387dc0fcf6be9ec6b)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:57:40.877225 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69075689-37f2-4077-bcb9-f7aadf6f91bf admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:57:40.928654 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-69075689-37f2-4077-bcb9-f7aadf6f91bf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '542e76c350be413387dc0fcf6be9ec6b'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:57:40.935989 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-69075689-37f2-4077-bcb9-f7aadf6f91bf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '542e76c350be413387dc0fcf6be9ec6b'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:57:40.936776 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-69075689-37f2-4077-bcb9-f7aadf6f91bf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '542e76c350be413387dc0fcf6be9ec6b'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:57:40.937460 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-69075689-37f2-4077-bcb9-f7aadf6f91bf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '542e76c350be413387dc0fcf6be9ec6b'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:57:40.946587 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-69075689-37f2-4077-bcb9-f7aadf6f91bf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '542e76c350be413387dc0fcf6be9ec6b'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:57:40.965792 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1044/2119] 10.222.0.15 () {58 vars in 1224 bytes} [Sun Oct 9 00:57:40 2022] DELETE /identity/v3/users/542e76c350be413387dc0fcf6be9ec6b => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 00:57:41.273884 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e15c98-799d-4dca-9b57-de5f052f9973 admin admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:57:41.276389 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-d0e15c98-799d-4dca-9b57-de5f052f9973 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:57:41.290779 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e15c98-799d-4dca-9b57-de5f052f9973 admin admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:57:41.344761 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:57:41.356097 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6901b71e-8c49-481b-90f7-4cde68d44417 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:57:41.357008 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6901b71e-8c49-481b-90f7-4cde68d44417 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:57:41.357337 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6901b71e-8c49-481b-90f7-4cde68d44417 admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:57:41.357747 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6901b71e-8c49-481b-90f7-4cde68d44417 admin admin] PATH_INFO: `/v3/projects/92380d8e80224478a78478d9ab962ba5` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:57:41.359076 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6901b71e-8c49-481b-90f7-4cde68d44417 admin admin] RBAC: Authorizing `identity:delete_project(project_id=92380d8e80224478a78478d9ab962ba5)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:57:41.361110 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6901b71e-8c49-481b-90f7-4cde68d44417 admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:57:41.409476 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-6901b71e-8c49-481b-90f7-4cde68d44417 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '92380d8e80224478a78478d9ab962ba5', 'request_id': 'req-6901b71e-8c49-481b-90f7-4cde68d44417'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:57:41.418478 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-6901b71e-8c49-481b-90f7-4cde68d44417 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '92380d8e80224478a78478d9ab962ba5', 'request_id': 'req-6901b71e-8c49-481b-90f7-4cde68d44417'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:57:41.425450 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-6901b71e-8c49-481b-90f7-4cde68d44417 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '92380d8e80224478a78478d9ab962ba5', 'request_id': 'req-6901b71e-8c49-481b-90f7-4cde68d44417'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:57:41.436517 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-6901b71e-8c49-481b-90f7-4cde68d44417 admin admin] The token cache is being invalidate because project 92380d8e80224478a78478d9ab962ba5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81525) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 09 00:57:41.436803 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-6901b71e-8c49-481b-90f7-4cde68d44417 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:57:41.437594 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-6901b71e-8c49-481b-90f7-4cde68d44417 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:57:41.439178 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1076/2120] 10.222.0.15 () {58 vars in 1233 bytes} [Sun Oct 9 00:57:41 2022] DELETE /identity/v3/projects/92380d8e80224478a78478d9ab962ba5 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 00:57:41.445009 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7881bc0a-af8d-464f-8df3-95686694f08c None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:57:41.445597 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7881bc0a-af8d-464f-8df3-95686694f08c None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:57:41.445597 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7881bc0a-af8d-464f-8df3-95686694f08c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:57:41.473957 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-7881bc0a-af8d-464f-8df3-95686694f08c None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:57:41.476488 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-7881bc0a-af8d-464f-8df3-95686694f08c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:57:41.546204 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1045/2121] 10.222.0.15 () {58 vars in 958 bytes} [Sun Oct 9 00:57:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:57:41.554076 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505fceb9-e489-41d4-ab66-380027e5e2cc None None] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:57:41.554333 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505fceb9-e489-41d4-ab66-380027e5e2cc None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:57:41.554637 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505fceb9-e489-41d4-ab66-380027e5e2cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:57:41.576747 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.auth.core [None req-505fceb9-e489-41d4-ab66-380027e5e2cc None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:57:41.577972 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-505fceb9-e489-41d4-ab66-380027e5e2cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:57:41.587701 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1077/2122] 10.222.0.15 () {58 vars in 958 bytes} [Sun Oct 9 00:57:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:57:41.592684 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7881bc0a-af8d-464f-8df3-95686694f08c None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:57:41.602876 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7881bc0a-af8d-464f-8df3-95686694f08c None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:57:41.608124 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0af920-70bf-4658-b81e-a1140fec48a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:57:41.608754 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0af920-70bf-4658-b81e-a1140fec48a1 admin admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:57:41.609025 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0af920-70bf-4658-b81e-a1140fec48a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:57:41.609287 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0af920-70bf-4658-b81e-a1140fec48a1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:57:41.609934 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0af920-70bf-4658-b81e-a1140fec48a1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:57:41.610251 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0af920-70bf-4658-b81e-a1140fec48a1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:57:41.611875 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0af920-70bf-4658-b81e-a1140fec48a1 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:57:41.624814 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1046/2123] 10.222.0.15 () {58 vars in 1153 bytes} [Sun Oct 9 00:57:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:57:41.629345 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505fceb9-e489-41d4-ab66-380027e5e2cc None None] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:57:41.639368 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505fceb9-e489-41d4-ab66-380027e5e2cc None None] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:57:41.644465 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0d1ac9-6058-4dae-a0ab-b7720e04d9dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:57:41.645151 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0d1ac9-6058-4dae-a0ab-b7720e04d9dc admin admin] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:57:41.645534 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0d1ac9-6058-4dae-a0ab-b7720e04d9dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:57:41.645826 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0d1ac9-6058-4dae-a0ab-b7720e04d9dc admin admin] PATH_INFO: `/v3/projects` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:57:41.646602 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0d1ac9-6058-4dae-a0ab-b7720e04d9dc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:57:41.648674 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0d1ac9-6058-4dae-a0ab-b7720e04d9dc admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:57:41.679219 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1078/2124] 10.222.0.15 () {60 vars in 1153 bytes} [Sun Oct 9 00:57:41 2022] POST /identity/v3/projects => generated 387 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 09 00:57:41.683645 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0af920-70bf-4658-b81e-a1140fec48a1 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:57:41.694922 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0af920-70bf-4658-b81e-a1140fec48a1 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:57:41.740994 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:57:41.775934 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ad96b5-1aef-4c35-9d25-eaae0403e8f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:57:41.776550 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ad96b5-1aef-4c35-9d25-eaae0403e8f0 admin admin] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:57:41.776844 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ad96b5-1aef-4c35-9d25-eaae0403e8f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:57:41.777095 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ad96b5-1aef-4c35-9d25-eaae0403e8f0 admin admin] PATH_INFO: `/v3/users` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:57:41.777747 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ad96b5-1aef-4c35-9d25-eaae0403e8f0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:57:41.779694 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ad96b5-1aef-4c35-9d25-eaae0403e8f0 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:57:41.801837 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1047/2125] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Oct 9 00:57:41 2022] POST /identity/v3/users => generated 294 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 09 00:57:41.806305 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0d1ac9-6058-4dae-a0ab-b7720e04d9dc admin admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:57:41.819457 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0d1ac9-6058-4dae-a0ab-b7720e04d9dc admin admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:57:41.824535 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb09e58-a6e3-4014-8db4-041ca44da54d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:57:41.825149 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb09e58-a6e3-4014-8db4-041ca44da54d admin admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:57:41.825426 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb09e58-a6e3-4014-8db4-041ca44da54d admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:57:41.825701 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb09e58-a6e3-4014-8db4-041ca44da54d admin admin] PATH_INFO: `/v3/roles` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:57:41.826349 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb09e58-a6e3-4014-8db4-041ca44da54d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:57:41.828010 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb09e58-a6e3-4014-8db4-041ca44da54d admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:57:41.839427 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1079/2126] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Oct 9 00:57:41 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 09 00:57:41.844047 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ad96b5-1aef-4c35-9d25-eaae0403e8f0 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:57:41.857519 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ad96b5-1aef-4c35-9d25-eaae0403e8f0 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:57:41.865283 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af133ce-bda1-4146-b5c7-d9d1f38bd8fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:57:41.865900 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af133ce-bda1-4146-b5c7-d9d1f38bd8fa admin admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:57:41.866229 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af133ce-bda1-4146-b5c7-d9d1f38bd8fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:57:41.866557 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af133ce-bda1-4146-b5c7-d9d1f38bd8fa admin admin] PATH_INFO: `/v3/roles` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:57:41.867198 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af133ce-bda1-4146-b5c7-d9d1f38bd8fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:57:41.869121 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af133ce-bda1-4146-b5c7-d9d1f38bd8fa admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:57:41.880926 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1048/2127] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Oct 9 00:57:41 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 09 00:57:41.885371 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb09e58-a6e3-4014-8db4-041ca44da54d admin admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:57:41.896181 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb09e58-a6e3-4014-8db4-041ca44da54d admin admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:57:41.900843 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9726fbfc-fe17-40a5-89b7-5455cd114dcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:57:41.901494 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9726fbfc-fe17-40a5-89b7-5455cd114dcf admin admin] REQUEST_METHOD: `PUT` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:57:41.901768 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9726fbfc-fe17-40a5-89b7-5455cd114dcf admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:57:41.902037 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9726fbfc-fe17-40a5-89b7-5455cd114dcf admin admin] PATH_INFO: `/v3/projects/aeb5c3c5e4164ae7af8629170df12fb3/users/04c315a206f2417e81765a7526506084/roles/afb0a01183d9497795eaa4fa1a4046ae` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:57:41.918450 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9726fbfc-fe17-40a5-89b7-5455cd114dcf admin admin] RBAC: Authorizing `identity:create_grant(project_id=aeb5c3c5e4164ae7af8629170df12fb3, user_id=04c315a206f2417e81765a7526506084, role_id=afb0a01183d9497795eaa4fa1a4046ae)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:57:41.921175 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9726fbfc-fe17-40a5-89b7-5455cd114dcf admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:57:41.937456 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1080/2128] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Oct 9 00:57:41 2022] PUT /identity/v3/projects/aeb5c3c5e4164ae7af8629170df12fb3/users/04c315a206f2417e81765a7526506084/roles/afb0a01183d9497795eaa4fa1a4046ae => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 00:57:41.948029 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd98f84-8ff6-4cdc-94bc-53bd1afac8fe None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:57:41.948306 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd98f84-8ff6-4cdc-94bc-53bd1afac8fe None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:57:41.948599 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd98f84-8ff6-4cdc-94bc-53bd1afac8fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:57:41.978537 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-4dd98f84-8ff6-4cdc-94bc-53bd1afac8fe None None] MFA Rules not processed for user `04c315a206f2417e81765a7526506084`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:57:41.979879 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-4dd98f84-8ff6-4cdc-94bc-53bd1afac8fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:57:42.048222 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1049/2129] 10.222.0.15 () {58 vars in 958 bytes} [Sun Oct 9 00:57:41 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:57:42.053265 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9726fbfc-fe17-40a5-89b7-5455cd114dcf admin admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:57:42.122404 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9726fbfc-fe17-40a5-89b7-5455cd114dcf admin admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:57:42.130053 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e962e140-9d7e-4517-a864-7cc205bcda78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:57:42.130743 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e962e140-9d7e-4517-a864-7cc205bcda78 admin admin] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:57:42.131241 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e962e140-9d7e-4517-a864-7cc205bcda78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:57:42.131432 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e962e140-9d7e-4517-a864-7cc205bcda78 admin admin] PATH_INFO: `/v3/projects` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:57:42.132081 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e962e140-9d7e-4517-a864-7cc205bcda78 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:57:42.134224 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e962e140-9d7e-4517-a864-7cc205bcda78 admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:57:42.172490 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1081/2130] 10.222.0.15 () {60 vars in 1153 bytes} [Sun Oct 9 00:57:42 2022] POST /identity/v3/projects => generated 385 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 09 00:57:42.176931 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd98f84-8ff6-4cdc-94bc-53bd1afac8fe None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:57:42.187368 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd98f84-8ff6-4cdc-94bc-53bd1afac8fe None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:57:42.249908 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a55809-6fa7-41fa-be18-d316748fe8e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:57:42.251176 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a55809-6fa7-41fa-be18-d316748fe8e3 admin admin] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:57:42.251176 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a55809-6fa7-41fa-be18-d316748fe8e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:57:42.251855 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a55809-6fa7-41fa-be18-d316748fe8e3 admin admin] PATH_INFO: `/v3/users` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:57:42.252636 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a55809-6fa7-41fa-be18-d316748fe8e3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:57:42.254712 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a55809-6fa7-41fa-be18-d316748fe8e3 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:57:42.278734 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1050/2131] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Oct 9 00:57:42 2022] POST /identity/v3/users => generated 299 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 09 00:57:42.283402 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e962e140-9d7e-4517-a864-7cc205bcda78 admin admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:57:42.288838 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:57:42.297710 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e962e140-9d7e-4517-a864-7cc205bcda78 admin admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:57:42.304486 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9786d5-c53a-4dba-9e11-fae8e69d7944 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:57:42.305169 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9786d5-c53a-4dba-9e11-fae8e69d7944 admin admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:57:42.305565 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9786d5-c53a-4dba-9e11-fae8e69d7944 admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:57:42.306214 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9786d5-c53a-4dba-9e11-fae8e69d7944 admin admin] PATH_INFO: `/v3/roles` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:57:42.307251 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9786d5-c53a-4dba-9e11-fae8e69d7944 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:57:42.309215 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9786d5-c53a-4dba-9e11-fae8e69d7944 admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:57:42.324289 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1082/2132] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Oct 9 00:57:42 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 09 00:57:42.328640 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a55809-6fa7-41fa-be18-d316748fe8e3 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:57:42.339034 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a55809-6fa7-41fa-be18-d316748fe8e3 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:57:42.345446 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238fa637-18db-40ac-aa48-c58f960d23cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:57:42.346040 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238fa637-18db-40ac-aa48-c58f960d23cc admin admin] REQUEST_METHOD: `PUT` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:57:42.346355 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238fa637-18db-40ac-aa48-c58f960d23cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:57:42.346571 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238fa637-18db-40ac-aa48-c58f960d23cc admin admin] PATH_INFO: `/v3/projects/3a9b64b8fcec400687f0f584e3791c26/users/cf2c74dee17d4987add89a4f2fb45b60/roles/f69dddf26daf4dd79d4c962beb877af5` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:57:42.367126 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238fa637-18db-40ac-aa48-c58f960d23cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a9b64b8fcec400687f0f584e3791c26, user_id=cf2c74dee17d4987add89a4f2fb45b60, role_id=f69dddf26daf4dd79d4c962beb877af5)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:57:42.371347 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238fa637-18db-40ac-aa48-c58f960d23cc admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:57:42.392678 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1051/2133] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Oct 9 00:57:42 2022] PUT /identity/v3/projects/3a9b64b8fcec400687f0f584e3791c26/users/cf2c74dee17d4987add89a4f2fb45b60/roles/f69dddf26daf4dd79d4c962beb877af5 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 09 00:57:42.396444 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9786d5-c53a-4dba-9e11-fae8e69d7944 admin admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:57:42.409936 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9786d5-c53a-4dba-9e11-fae8e69d7944 admin admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:57:42.475461 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a16b28-867d-421d-943a-ed0e9351be67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:57:42.476077 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a16b28-867d-421d-943a-ed0e9351be67 admin admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:57:42.476352 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a16b28-867d-421d-943a-ed0e9351be67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:57:42.476617 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a16b28-867d-421d-943a-ed0e9351be67 admin admin] PATH_INFO: `/v3/roles` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:57:42.477304 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a16b28-867d-421d-943a-ed0e9351be67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:57:42.478897 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a16b28-867d-421d-943a-ed0e9351be67 admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:57:42.488638 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1083/2134] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Oct 9 00:57:42 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 09 00:57:42.493297 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238fa637-18db-40ac-aa48-c58f960d23cc admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:57:42.503902 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238fa637-18db-40ac-aa48-c58f960d23cc admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:57:42.508490 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86ebe73-cf99-400f-a414-4471a98b9c50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:57:42.509175 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86ebe73-cf99-400f-a414-4471a98b9c50 admin admin] REQUEST_METHOD: `PUT` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:57:42.509454 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86ebe73-cf99-400f-a414-4471a98b9c50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:57:42.509718 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86ebe73-cf99-400f-a414-4471a98b9c50 admin admin] PATH_INFO: `/v3/projects/3a9b64b8fcec400687f0f584e3791c26/users/cf2c74dee17d4987add89a4f2fb45b60/roles/f69dddf26daf4dd79d4c962beb877af5` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:57:42.511635 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86ebe73-cf99-400f-a414-4471a98b9c50 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a9b64b8fcec400687f0f584e3791c26, user_id=cf2c74dee17d4987add89a4f2fb45b60, role_id=f69dddf26daf4dd79d4c962beb877af5)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:57:42.514262 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86ebe73-cf99-400f-a414-4471a98b9c50 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:57:42.516683 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:57:42.527508 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1052/2135] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Oct 9 00:57:42 2022] PUT /identity/v3/projects/3a9b64b8fcec400687f0f584e3791c26/users/cf2c74dee17d4987add89a4f2fb45b60/roles/f69dddf26daf4dd79d4c962beb877af5 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 00:57:42.538801 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94eb6320-d718-4eac-9555-732fde6d2638 None None] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:57:42.539106 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94eb6320-d718-4eac-9555-732fde6d2638 None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:57:42.539410 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94eb6320-d718-4eac-9555-732fde6d2638 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:57:42.569199 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.auth.core [None req-94eb6320-d718-4eac-9555-732fde6d2638 None None] MFA Rules not processed for user `cf2c74dee17d4987add89a4f2fb45b60`. Rule list: `[]` (Enabled: `True`). {{(pid=81525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:57:42.570356 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-94eb6320-d718-4eac-9555-732fde6d2638 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:57:42.637699 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1084/2136] 10.222.0.15 () {58 vars in 958 bytes} [Sun Oct 9 00:57:42 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:57:42.653399 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86ebe73-cf99-400f-a414-4471a98b9c50 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:57:42.655211 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-e86ebe73-cf99-400f-a414-4471a98b9c50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:57:42.716259 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86ebe73-cf99-400f-a414-4471a98b9c50 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:57:42.720266 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66055938-19cd-453e-84fe-db0d3c8b4577 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff7cb78bcd91467abe5c2e2b48aedd1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f148d39ced534860abfbe8fc3f98ace4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:57:42.720870 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66055938-19cd-453e-84fe-db0d3c8b4577 service cinder] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:57:42.721142 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66055938-19cd-453e-84fe-db0d3c8b4577 service cinder] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:57:42.721390 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66055938-19cd-453e-84fe-db0d3c8b4577 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:57:42.730835 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66055938-19cd-453e-84fe-db0d3c8b4577 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:57:42.732283 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66055938-19cd-453e-84fe-db0d3c8b4577 service cinder] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:57:42.742468 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1053/2137] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Oct 9 00:57:42 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 09 00:57:42.823181 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94eb6320-d718-4eac-9555-732fde6d2638 None None] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:57:42.893912 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94eb6320-d718-4eac-9555-732fde6d2638 None None] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:57:42.898403 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf147cf-dfe3-47b5-b9ba-263708f1a960 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:57:42.899080 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf147cf-dfe3-47b5-b9ba-263708f1a960 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:57:42.899385 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf147cf-dfe3-47b5-b9ba-263708f1a960 admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:57:42.899660 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf147cf-dfe3-47b5-b9ba-263708f1a960 admin admin] PATH_INFO: `/v3/users/04c315a206f2417e81765a7526506084` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:57:42.900834 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf147cf-dfe3-47b5-b9ba-263708f1a960 admin admin] RBAC: Authorizing `identity:delete_user(user_id=04c315a206f2417e81765a7526506084)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:57:42.902817 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf147cf-dfe3-47b5-b9ba-263708f1a960 admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:57:42.920527 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:57:42.961911 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-2cf147cf-dfe3-47b5-b9ba-263708f1a960 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '04c315a206f2417e81765a7526506084'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:57:42.969293 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-2cf147cf-dfe3-47b5-b9ba-263708f1a960 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '04c315a206f2417e81765a7526506084'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:57:42.970035 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-2cf147cf-dfe3-47b5-b9ba-263708f1a960 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '04c315a206f2417e81765a7526506084'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:57:42.970645 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-2cf147cf-dfe3-47b5-b9ba-263708f1a960 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '04c315a206f2417e81765a7526506084'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:57:42.979457 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-2cf147cf-dfe3-47b5-b9ba-263708f1a960 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '04c315a206f2417e81765a7526506084'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:57:43.003641 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1085/2138] 10.222.0.15 () {58 vars in 1224 bytes} [Sun Oct 9 00:57:42 2022] DELETE /identity/v3/users/04c315a206f2417e81765a7526506084 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 00:57:43.009897 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25be0659-4285-4d99-b879-1b96e30a8e97 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:57:43.010174 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25be0659-4285-4d99-b879-1b96e30a8e97 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:57:43.010442 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25be0659-4285-4d99-b879-1b96e30a8e97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:57:43.029041 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-25be0659-4285-4d99-b879-1b96e30a8e97 None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:57:43.030266 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-25be0659-4285-4d99-b879-1b96e30a8e97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:57:43.094243 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1054/2139] 10.222.0.15 () {58 vars in 958 bytes} [Sun Oct 9 00:57:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 09 00:57:43.106434 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf147cf-dfe3-47b5-b9ba-263708f1a960 admin admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:57:43.107853 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-2cf147cf-dfe3-47b5-b9ba-263708f1a960 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:57:43.173933 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf147cf-dfe3-47b5-b9ba-263708f1a960 admin admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:57:43.178248 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1bb3fc-37fb-428d-8642-207a3991d7d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4ef90d456d2483e8ddafbe2d4d4fb5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f148d39ced534860abfbe8fc3f98ace4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:57:43.178853 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1bb3fc-37fb-428d-8642-207a3991d7d0 service neutron] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:57:43.179142 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1bb3fc-37fb-428d-8642-207a3991d7d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:57:43.179544 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1bb3fc-37fb-428d-8642-207a3991d7d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:57:43.190020 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1bb3fc-37fb-428d-8642-207a3991d7d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:57:43.191772 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1bb3fc-37fb-428d-8642-207a3991d7d0 service neutron] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:57:43.203247 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1086/2140] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Oct 9 00:57:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 09 00:57:43.585546 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25be0659-4285-4d99-b879-1b96e30a8e97 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:57:43.587188 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-25be0659-4285-4d99-b879-1b96e30a8e97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:57:43.603546 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25be0659-4285-4d99-b879-1b96e30a8e97 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:57:43.609382 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654d364e-2cce-497c-89b3-d4d4a2813515 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:57:43.610378 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654d364e-2cce-497c-89b3-d4d4a2813515 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:57:43.610378 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654d364e-2cce-497c-89b3-d4d4a2813515 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:57:43.610601 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654d364e-2cce-497c-89b3-d4d4a2813515 admin admin] PATH_INFO: `/v3/projects/aeb5c3c5e4164ae7af8629170df12fb3` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:57:43.611748 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654d364e-2cce-497c-89b3-d4d4a2813515 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aeb5c3c5e4164ae7af8629170df12fb3)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:57:43.614038 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654d364e-2cce-497c-89b3-d4d4a2813515 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:57:43.662875 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-654d364e-2cce-497c-89b3-d4d4a2813515 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aeb5c3c5e4164ae7af8629170df12fb3', 'request_id': 'req-654d364e-2cce-497c-89b3-d4d4a2813515'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:57:43.670781 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-654d364e-2cce-497c-89b3-d4d4a2813515 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aeb5c3c5e4164ae7af8629170df12fb3', 'request_id': 'req-654d364e-2cce-497c-89b3-d4d4a2813515'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:57:43.677065 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-654d364e-2cce-497c-89b3-d4d4a2813515 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aeb5c3c5e4164ae7af8629170df12fb3', 'request_id': 'req-654d364e-2cce-497c-89b3-d4d4a2813515'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:57:43.687184 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-654d364e-2cce-497c-89b3-d4d4a2813515 admin admin] The token cache is being invalidate because project aeb5c3c5e4164ae7af8629170df12fb3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81524) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 09 00:57:43.687508 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-654d364e-2cce-497c-89b3-d4d4a2813515 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:57:43.688151 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-654d364e-2cce-497c-89b3-d4d4a2813515 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:57:43.689652 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1055/2141] 10.222.0.15 () {58 vars in 1233 bytes} [Sun Oct 9 00:57:43 2022] DELETE /identity/v3/projects/aeb5c3c5e4164ae7af8629170df12fb3 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 09 00:57:43.693702 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1bb3fc-37fb-428d-8642-207a3991d7d0 service neutron] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:57:43.703752 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1bb3fc-37fb-428d-8642-207a3991d7d0 service neutron] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:57:43.767198 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2240f0-af88-4ea9-8952-781487a653b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:57:43.767882 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2240f0-af88-4ea9-8952-781487a653b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:57:43.768140 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2240f0-af88-4ea9-8952-781487a653b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:57:43.768429 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2240f0-af88-4ea9-8952-781487a653b7 admin admin] PATH_INFO: `/v3/users/cf2c74dee17d4987add89a4f2fb45b60` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:57:43.769527 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2240f0-af88-4ea9-8952-781487a653b7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cf2c74dee17d4987add89a4f2fb45b60)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:57:43.771532 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2240f0-af88-4ea9-8952-781487a653b7 admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:57:43.815541 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:57:43.825355 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-bc2240f0-af88-4ea9-8952-781487a653b7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cf2c74dee17d4987add89a4f2fb45b60'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:57:43.833881 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-bc2240f0-af88-4ea9-8952-781487a653b7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cf2c74dee17d4987add89a4f2fb45b60'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:57:43.834637 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-bc2240f0-af88-4ea9-8952-781487a653b7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cf2c74dee17d4987add89a4f2fb45b60'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:57:43.835230 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-bc2240f0-af88-4ea9-8952-781487a653b7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cf2c74dee17d4987add89a4f2fb45b60'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:57:43.845542 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-bc2240f0-af88-4ea9-8952-781487a653b7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cf2c74dee17d4987add89a4f2fb45b60'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:57:43.866668 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1087/2142] 10.222.0.15 () {58 vars in 1224 bytes} [Sun Oct 9 00:57:43 2022] DELETE /identity/v3/users/cf2c74dee17d4987add89a4f2fb45b60 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 00:57:44.168958 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654d364e-2cce-497c-89b3-d4d4a2813515 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:57:44.170478 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-654d364e-2cce-497c-89b3-d4d4a2813515 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:57:44.183966 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654d364e-2cce-497c-89b3-d4d4a2813515 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:57:44.201201 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:INSERT=2,keystone:SELECT=91,keystone:DELETE=7 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:57:44.253919 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca7672d-3d75-48fa-8859-7bfef5af5263 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:57:44.254530 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca7672d-3d75-48fa-8859-7bfef5af5263 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:57:44.254921 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca7672d-3d75-48fa-8859-7bfef5af5263 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:57:44.255219 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca7672d-3d75-48fa-8859-7bfef5af5263 admin admin] PATH_INFO: `/v3/projects/3a9b64b8fcec400687f0f584e3791c26` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:57:44.256418 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca7672d-3d75-48fa-8859-7bfef5af5263 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a9b64b8fcec400687f0f584e3791c26)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:57:44.258378 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca7672d-3d75-48fa-8859-7bfef5af5263 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:57:44.311625 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-5ca7672d-3d75-48fa-8859-7bfef5af5263 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a9b64b8fcec400687f0f584e3791c26', 'request_id': 'req-5ca7672d-3d75-48fa-8859-7bfef5af5263'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:57:44.320407 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-5ca7672d-3d75-48fa-8859-7bfef5af5263 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a9b64b8fcec400687f0f584e3791c26', 'request_id': 'req-5ca7672d-3d75-48fa-8859-7bfef5af5263'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:57:44.327738 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-5ca7672d-3d75-48fa-8859-7bfef5af5263 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a9b64b8fcec400687f0f584e3791c26', 'request_id': 'req-5ca7672d-3d75-48fa-8859-7bfef5af5263'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:57:44.338686 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-5ca7672d-3d75-48fa-8859-7bfef5af5263 admin admin] The token cache is being invalidate because project 3a9b64b8fcec400687f0f584e3791c26 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81524) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 09 00:57:44.339004 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-5ca7672d-3d75-48fa-8859-7bfef5af5263 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:57:44.339697 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-5ca7672d-3d75-48fa-8859-7bfef5af5263 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:57:44.341571 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1056/2143] 10.222.0.15 () {58 vars in 1233 bytes} [Sun Oct 9 00:57:44 2022] DELETE /identity/v3/projects/3a9b64b8fcec400687f0f584e3791c26 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 00:57:44.348302 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6054d3-9674-42cd-a631-c8d2df3fafd5 None None] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:57:44.348514 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6054d3-9674-42cd-a631-c8d2df3fafd5 None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:57:44.348795 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6054d3-9674-42cd-a631-c8d2df3fafd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:57:44.371035 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.auth.core [None req-9a6054d3-9674-42cd-a631-c8d2df3fafd5 None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:57:44.372670 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-9a6054d3-9674-42cd-a631-c8d2df3fafd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:57:44.444634 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1088/2144] 10.222.0.15 () {58 vars in 958 bytes} [Sun Oct 9 00:57:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:57:44.449717 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd87a0a-4c3b-4c91-baaa-13203ff41c1a None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:57:44.449991 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd87a0a-4c3b-4c91-baaa-13203ff41c1a None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:57:44.450199 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd87a0a-4c3b-4c91-baaa-13203ff41c1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:57:44.472519 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-0fd87a0a-4c3b-4c91-baaa-13203ff41c1a None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:57:44.473679 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-0fd87a0a-4c3b-4c91-baaa-13203ff41c1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:57:44.481655 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1057/2145] 10.222.0.15 () {58 vars in 958 bytes} [Sun Oct 9 00:57:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:57:44.486024 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6054d3-9674-42cd-a631-c8d2df3fafd5 None None] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:57:44.495716 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6054d3-9674-42cd-a631-c8d2df3fafd5 None None] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:57:44.501166 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12a70b5-3a3e-42d2-a1f7-1946cc3244b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:57:44.501815 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12a70b5-3a3e-42d2-a1f7-1946cc3244b2 admin admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:57:44.502093 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12a70b5-3a3e-42d2-a1f7-1946cc3244b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:57:44.502391 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12a70b5-3a3e-42d2-a1f7-1946cc3244b2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:57:44.503047 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12a70b5-3a3e-42d2-a1f7-1946cc3244b2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:57:44.503415 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12a70b5-3a3e-42d2-a1f7-1946cc3244b2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:57:44.505122 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12a70b5-3a3e-42d2-a1f7-1946cc3244b2 admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:57:44.519166 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1089/2146] 10.222.0.15 () {58 vars in 1153 bytes} [Sun Oct 9 00:57:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:57:44.523733 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd87a0a-4c3b-4c91-baaa-13203ff41c1a None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:57:44.533718 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd87a0a-4c3b-4c91-baaa-13203ff41c1a None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:57:44.538846 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4088196-7f40-4026-b728-893aa23a6ba0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:57:44.539517 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4088196-7f40-4026-b728-893aa23a6ba0 admin admin] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:57:44.539899 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4088196-7f40-4026-b728-893aa23a6ba0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:57:44.540178 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4088196-7f40-4026-b728-893aa23a6ba0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:57:44.540866 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4088196-7f40-4026-b728-893aa23a6ba0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:57:44.543024 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4088196-7f40-4026-b728-893aa23a6ba0 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:57:44.573478 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1058/2147] 10.222.0.15 () {60 vars in 1153 bytes} [Sun Oct 9 00:57:44 2022] POST /identity/v3/projects => generated 375 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 09 00:57:44.577416 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12a70b5-3a3e-42d2-a1f7-1946cc3244b2 admin admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:57:44.588386 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12a70b5-3a3e-42d2-a1f7-1946cc3244b2 admin admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:57:44.650808 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccafff0-8c02-4e65-ac89-ff58a84d4772 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:57:44.651569 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccafff0-8c02-4e65-ac89-ff58a84d4772 admin admin] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:57:44.651920 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccafff0-8c02-4e65-ac89-ff58a84d4772 admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:57:44.652296 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccafff0-8c02-4e65-ac89-ff58a84d4772 admin admin] PATH_INFO: `/v3/users` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:57:44.653013 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ccafff0-8c02-4e65-ac89-ff58a84d4772 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:57:44.655097 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ccafff0-8c02-4e65-ac89-ff58a84d4772 admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:57:44.683685 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1090/2148] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Oct 9 00:57:44 2022] POST /identity/v3/users => generated 288 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 09 00:57:44.685022 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4088196-7f40-4026-b728-893aa23a6ba0 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:57:44.695999 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4088196-7f40-4026-b728-893aa23a6ba0 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:57:44.700968 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18de9f39-1fdb-4df9-b0e3-a5a7b367f1fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:57:44.701641 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18de9f39-1fdb-4df9-b0e3-a5a7b367f1fb admin admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:57:44.701922 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18de9f39-1fdb-4df9-b0e3-a5a7b367f1fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:57:44.702194 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18de9f39-1fdb-4df9-b0e3-a5a7b367f1fb admin admin] PATH_INFO: `/v3/roles` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:57:44.703934 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18de9f39-1fdb-4df9-b0e3-a5a7b367f1fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:57:44.705729 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18de9f39-1fdb-4df9-b0e3-a5a7b367f1fb admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:57:44.718692 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1059/2149] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Oct 9 00:57:44 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 09 00:57:44.720511 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccafff0-8c02-4e65-ac89-ff58a84d4772 admin admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:57:44.730788 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccafff0-8c02-4e65-ac89-ff58a84d4772 admin admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:57:44.736195 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137c3c50-08f4-4070-bdd1-c4c2c7bd6238 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:57:44.736962 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137c3c50-08f4-4070-bdd1-c4c2c7bd6238 admin admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:57:44.737374 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137c3c50-08f4-4070-bdd1-c4c2c7bd6238 admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:57:44.737746 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137c3c50-08f4-4070-bdd1-c4c2c7bd6238 admin admin] PATH_INFO: `/v3/roles` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:57:44.738513 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137c3c50-08f4-4070-bdd1-c4c2c7bd6238 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:57:44.740538 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137c3c50-08f4-4070-bdd1-c4c2c7bd6238 admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:57:44.752715 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1091/2150] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Oct 9 00:57:44 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 09 00:57:44.757513 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18de9f39-1fdb-4df9-b0e3-a5a7b367f1fb admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:57:44.773385 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18de9f39-1fdb-4df9-b0e3-a5a7b367f1fb admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:57:44.779869 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc01e4fc-9ae5-4617-907f-02bc9a26c9b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:57:44.780550 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc01e4fc-9ae5-4617-907f-02bc9a26c9b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:57:44.780853 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc01e4fc-9ae5-4617-907f-02bc9a26c9b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:57:44.781120 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc01e4fc-9ae5-4617-907f-02bc9a26c9b3 admin admin] PATH_INFO: `/v3/projects/d7088ea02ed34060a776bb43d13cd5b3/users/86ce232200994152a5d56afe59104340/roles/afb0a01183d9497795eaa4fa1a4046ae` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:57:44.796597 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc01e4fc-9ae5-4617-907f-02bc9a26c9b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d7088ea02ed34060a776bb43d13cd5b3, user_id=86ce232200994152a5d56afe59104340, role_id=afb0a01183d9497795eaa4fa1a4046ae)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:57:44.799241 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc01e4fc-9ae5-4617-907f-02bc9a26c9b3 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:57:44.814525 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1060/2151] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Oct 9 00:57:44 2022] PUT /identity/v3/projects/d7088ea02ed34060a776bb43d13cd5b3/users/86ce232200994152a5d56afe59104340/roles/afb0a01183d9497795eaa4fa1a4046ae => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 00:57:44.826143 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2f9ec8-de98-44f1-834f-3d20e59517a3 None None] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:57:44.826434 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2f9ec8-de98-44f1-834f-3d20e59517a3 None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:57:44.826676 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2f9ec8-de98-44f1-834f-3d20e59517a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:57:44.856551 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.auth.core [None req-0b2f9ec8-de98-44f1-834f-3d20e59517a3 None None] MFA Rules not processed for user `86ce232200994152a5d56afe59104340`. Rule list: `[]` (Enabled: `True`). {{(pid=81525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:57:44.857834 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-0b2f9ec8-de98-44f1-834f-3d20e59517a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:57:44.866631 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:57:44.933349 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1092/2152] 10.222.0.15 () {58 vars in 958 bytes} [Sun Oct 9 00:57:44 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:57:44.945700 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc01e4fc-9ae5-4617-907f-02bc9a26c9b3 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:57:44.947487 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-fc01e4fc-9ae5-4617-907f-02bc9a26c9b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:57:45.005595 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:57:45.011924 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc01e4fc-9ae5-4617-907f-02bc9a26c9b3 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:57:45.017257 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2d7854-6785-4fa6-bdb3-606fef5dcc93 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff7cb78bcd91467abe5c2e2b48aedd1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f148d39ced534860abfbe8fc3f98ace4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:57:45.017956 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2d7854-6785-4fa6-bdb3-606fef5dcc93 service cinder] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:57:45.018303 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2d7854-6785-4fa6-bdb3-606fef5dcc93 service cinder] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:57:45.018573 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2d7854-6785-4fa6-bdb3-606fef5dcc93 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:57:45.030639 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2d7854-6785-4fa6-bdb3-606fef5dcc93 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:57:45.032166 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2d7854-6785-4fa6-bdb3-606fef5dcc93 service cinder] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:57:45.043128 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1061/2153] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Oct 9 00:57:44 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 09 00:57:50.192389 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2f9ec8-de98-44f1-834f-3d20e59517a3 None None] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:57:50.193815 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-0b2f9ec8-de98-44f1-834f-3d20e59517a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:57:50.260427 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2f9ec8-de98-44f1-834f-3d20e59517a3 None None] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:57:50.264952 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31cf50b-e692-47e5-b8c0-f79abb919ec2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:57:50.265635 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31cf50b-e692-47e5-b8c0-f79abb919ec2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:57:50.265917 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31cf50b-e692-47e5-b8c0-f79abb919ec2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:57:50.266243 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31cf50b-e692-47e5-b8c0-f79abb919ec2 admin admin] PATH_INFO: `/v3/users/ac1bc7c5b4f64716816ac1e8d913e251` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:57:50.267312 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31cf50b-e692-47e5-b8c0-f79abb919ec2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac1bc7c5b4f64716816ac1e8d913e251)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:57:50.269280 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31cf50b-e692-47e5-b8c0-f79abb919ec2 admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:57:50.323493 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-a31cf50b-e692-47e5-b8c0-f79abb919ec2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac1bc7c5b4f64716816ac1e8d913e251'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:57:50.331704 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-a31cf50b-e692-47e5-b8c0-f79abb919ec2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac1bc7c5b4f64716816ac1e8d913e251'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:57:50.332392 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-a31cf50b-e692-47e5-b8c0-f79abb919ec2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac1bc7c5b4f64716816ac1e8d913e251'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:57:50.333007 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-a31cf50b-e692-47e5-b8c0-f79abb919ec2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac1bc7c5b4f64716816ac1e8d913e251'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:57:50.340844 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-a31cf50b-e692-47e5-b8c0-f79abb919ec2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac1bc7c5b4f64716816ac1e8d913e251'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:57:50.359200 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1093/2154] 10.222.0.15 () {58 vars in 1224 bytes} [Sun Oct 9 00:57:50 2022] DELETE /identity/v3/users/ac1bc7c5b4f64716816ac1e8d913e251 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 00:57:50.364147 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ec7015-f802-4fe8-88df-ae9c5928773c None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:57:50.364628 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ec7015-f802-4fe8-88df-ae9c5928773c None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:57:50.364720 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ec7015-f802-4fe8-88df-ae9c5928773c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:57:50.391396 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-62ec7015-f802-4fe8-88df-ae9c5928773c None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:57:50.392598 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-62ec7015-f802-4fe8-88df-ae9c5928773c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:57:50.457449 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1062/2155] 10.222.0.15 () {58 vars in 958 bytes} [Sun Oct 9 00:57:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:57:50.467449 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31cf50b-e692-47e5-b8c0-f79abb919ec2 admin admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:57:50.469146 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-a31cf50b-e692-47e5-b8c0-f79abb919ec2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:57:50.503967 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:57:50.534292 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31cf50b-e692-47e5-b8c0-f79abb919ec2 admin admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:57:50.539366 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d984235f-61e3-4adb-80d5-8c3cf1b94699 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4ef90d456d2483e8ddafbe2d4d4fb5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f148d39ced534860abfbe8fc3f98ace4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:57:50.539997 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d984235f-61e3-4adb-80d5-8c3cf1b94699 service neutron] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:57:50.540272 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d984235f-61e3-4adb-80d5-8c3cf1b94699 service neutron] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:57:50.540539 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d984235f-61e3-4adb-80d5-8c3cf1b94699 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:57:50.552004 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d984235f-61e3-4adb-80d5-8c3cf1b94699 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:57:50.553496 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d984235f-61e3-4adb-80d5-8c3cf1b94699 service neutron] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:57:50.563977 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1094/2156] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Oct 9 00:57:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 09 00:57:50.854869 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ec7015-f802-4fe8-88df-ae9c5928773c None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:57:50.856463 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-62ec7015-f802-4fe8-88df-ae9c5928773c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:57:50.869281 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ec7015-f802-4fe8-88df-ae9c5928773c None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:57:50.875965 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257a6986-7fec-45a4-b46f-0c73e65df643 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:57:50.876833 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257a6986-7fec-45a4-b46f-0c73e65df643 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:57:50.877112 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257a6986-7fec-45a4-b46f-0c73e65df643 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:57:50.877381 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257a6986-7fec-45a4-b46f-0c73e65df643 admin admin] PATH_INFO: `/v3/projects/4537b7bd396d4bc39e88007cc50f11f9` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:57:50.878684 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257a6986-7fec-45a4-b46f-0c73e65df643 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4537b7bd396d4bc39e88007cc50f11f9)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:57:50.880658 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257a6986-7fec-45a4-b46f-0c73e65df643 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:57:50.939967 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-257a6986-7fec-45a4-b46f-0c73e65df643 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4537b7bd396d4bc39e88007cc50f11f9', 'request_id': 'req-257a6986-7fec-45a4-b46f-0c73e65df643'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:57:50.949595 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-257a6986-7fec-45a4-b46f-0c73e65df643 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4537b7bd396d4bc39e88007cc50f11f9', 'request_id': 'req-257a6986-7fec-45a4-b46f-0c73e65df643'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:57:50.956082 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-257a6986-7fec-45a4-b46f-0c73e65df643 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4537b7bd396d4bc39e88007cc50f11f9', 'request_id': 'req-257a6986-7fec-45a4-b46f-0c73e65df643'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:57:50.966309 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-257a6986-7fec-45a4-b46f-0c73e65df643 admin admin] The token cache is being invalidate because project 4537b7bd396d4bc39e88007cc50f11f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81524) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 09 00:57:50.966594 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-257a6986-7fec-45a4-b46f-0c73e65df643 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:57:50.967241 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-257a6986-7fec-45a4-b46f-0c73e65df643 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:57:50.970761 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1063/2157] 10.222.0.15 () {58 vars in 1233 bytes} [Sun Oct 9 00:57:50 2022] DELETE /identity/v3/projects/4537b7bd396d4bc39e88007cc50f11f9 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 00:57:50.975724 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce6577d-0ba1-4215-ab35-155b1fc11ca7 None None] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:57:50.976016 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce6577d-0ba1-4215-ab35-155b1fc11ca7 None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:57:50.976270 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce6577d-0ba1-4215-ab35-155b1fc11ca7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:57:50.997940 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.auth.core [None req-8ce6577d-0ba1-4215-ab35-155b1fc11ca7 None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:57:50.999157 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-8ce6577d-0ba1-4215-ab35-155b1fc11ca7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:57:51.065740 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1095/2158] 10.222.0.15 () {58 vars in 958 bytes} [Sun Oct 9 00:57:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:57:51.075022 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a7e63c-1a92-4e85-9208-e921be1cd046 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:57:51.075327 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a7e63c-1a92-4e85-9208-e921be1cd046 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:57:51.075602 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a7e63c-1a92-4e85-9208-e921be1cd046 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:57:51.096842 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-e9a7e63c-1a92-4e85-9208-e921be1cd046 None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:57:51.098076 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-e9a7e63c-1a92-4e85-9208-e921be1cd046 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:57:51.106218 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1064/2159] 10.222.0.15 () {58 vars in 958 bytes} [Sun Oct 9 00:57:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:57:51.110751 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce6577d-0ba1-4215-ab35-155b1fc11ca7 None None] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:57:51.121162 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce6577d-0ba1-4215-ab35-155b1fc11ca7 None None] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:57:51.126739 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa829b3-ee78-487a-99da-0d257f5e7a96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:57:51.127407 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa829b3-ee78-487a-99da-0d257f5e7a96 admin admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:57:51.127811 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa829b3-ee78-487a-99da-0d257f5e7a96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:57:51.128105 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa829b3-ee78-487a-99da-0d257f5e7a96 admin admin] PATH_INFO: `/v3/domains` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:57:51.128869 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa829b3-ee78-487a-99da-0d257f5e7a96 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:57:51.129172 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa829b3-ee78-487a-99da-0d257f5e7a96 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:57:51.130775 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa829b3-ee78-487a-99da-0d257f5e7a96 admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:57:51.142990 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1096/2160] 10.222.0.15 () {58 vars in 1153 bytes} [Sun Oct 9 00:57:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:57:51.152353 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a7e63c-1a92-4e85-9208-e921be1cd046 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:57:51.162379 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a7e63c-1a92-4e85-9208-e921be1cd046 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:57:51.167283 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fd3e6f-3ac7-4f11-a22a-59c7a2ff9bea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:57:51.167897 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fd3e6f-3ac7-4f11-a22a-59c7a2ff9bea admin admin] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:57:51.168192 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fd3e6f-3ac7-4f11-a22a-59c7a2ff9bea admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:57:51.168460 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fd3e6f-3ac7-4f11-a22a-59c7a2ff9bea admin admin] PATH_INFO: `/v3/projects` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:57:51.175655 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fd3e6f-3ac7-4f11-a22a-59c7a2ff9bea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:57:51.175655 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fd3e6f-3ac7-4f11-a22a-59c7a2ff9bea admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:57:51.202448 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1065/2161] 10.222.0.15 () {60 vars in 1153 bytes} [Sun Oct 9 00:57:51 2022] POST /identity/v3/projects => generated 365 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 09 00:57:51.207156 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa829b3-ee78-487a-99da-0d257f5e7a96 admin admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:57:51.219594 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa829b3-ee78-487a-99da-0d257f5e7a96 admin admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:57:51.293898 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c19ac8-95f6-45f0-a368-5d346f4f5e39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:57:51.294699 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c19ac8-95f6-45f0-a368-5d346f4f5e39 admin admin] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:57:51.295051 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c19ac8-95f6-45f0-a368-5d346f4f5e39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:57:51.295355 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c19ac8-95f6-45f0-a368-5d346f4f5e39 admin admin] PATH_INFO: `/v3/users` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:57:51.295993 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c19ac8-95f6-45f0-a368-5d346f4f5e39 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:57:51.297992 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c19ac8-95f6-45f0-a368-5d346f4f5e39 admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:57:51.329184 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1097/2162] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Oct 9 00:57:51 2022] POST /identity/v3/users => generated 283 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 09 00:57:51.330689 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fd3e6f-3ac7-4f11-a22a-59c7a2ff9bea admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:57:51.344137 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fd3e6f-3ac7-4f11-a22a-59c7a2ff9bea admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:57:51.349653 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c979d43a-bc32-4b65-a1f4-60a6cca62e58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:57:51.350280 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c979d43a-bc32-4b65-a1f4-60a6cca62e58 admin admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:57:51.350580 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c979d43a-bc32-4b65-a1f4-60a6cca62e58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:57:51.350994 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c979d43a-bc32-4b65-a1f4-60a6cca62e58 admin admin] PATH_INFO: `/v3/roles` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:57:51.351862 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c979d43a-bc32-4b65-a1f4-60a6cca62e58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:57:51.353474 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c979d43a-bc32-4b65-a1f4-60a6cca62e58 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:57:51.366997 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1066/2163] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Oct 9 00:57:51 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 09 00:57:51.371622 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c19ac8-95f6-45f0-a368-5d346f4f5e39 admin admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:57:51.382089 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c19ac8-95f6-45f0-a368-5d346f4f5e39 admin admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:57:51.387171 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bf3620-5344-4c43-a477-e12852506d3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:57:51.388232 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bf3620-5344-4c43-a477-e12852506d3f admin admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:57:51.388232 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bf3620-5344-4c43-a477-e12852506d3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:57:51.388409 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bf3620-5344-4c43-a477-e12852506d3f admin admin] PATH_INFO: `/v3/roles` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:57:51.388988 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bf3620-5344-4c43-a477-e12852506d3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:57:51.390702 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bf3620-5344-4c43-a477-e12852506d3f admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:57:51.402856 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1098/2164] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Oct 9 00:57:51 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 09 00:57:51.407571 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c979d43a-bc32-4b65-a1f4-60a6cca62e58 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:57:51.445519 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c979d43a-bc32-4b65-a1f4-60a6cca62e58 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:57:51.455387 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8758e08-246d-4622-87be-a9b9e723aeea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:57:51.455387 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8758e08-246d-4622-87be-a9b9e723aeea admin admin] REQUEST_METHOD: `PUT` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:57:51.455387 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8758e08-246d-4622-87be-a9b9e723aeea admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:57:51.455387 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8758e08-246d-4622-87be-a9b9e723aeea admin admin] PATH_INFO: `/v3/projects/b582c037afe647f1b856e524138daa76/users/5937e684d1784949a6b54405b5558035/roles/afb0a01183d9497795eaa4fa1a4046ae` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:57:51.479053 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8758e08-246d-4622-87be-a9b9e723aeea admin admin] RBAC: Authorizing `identity:create_grant(project_id=b582c037afe647f1b856e524138daa76, user_id=5937e684d1784949a6b54405b5558035, role_id=afb0a01183d9497795eaa4fa1a4046ae)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:57:51.482140 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8758e08-246d-4622-87be-a9b9e723aeea admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:57:51.506649 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1067/2165] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Oct 9 00:57:51 2022] PUT /identity/v3/projects/b582c037afe647f1b856e524138daa76/users/5937e684d1784949a6b54405b5558035/roles/afb0a01183d9497795eaa4fa1a4046ae => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 00:57:51.516904 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7d399c-382b-454c-a77f-9ed97f9f18f1 None None] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:57:51.517188 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7d399c-382b-454c-a77f-9ed97f9f18f1 None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:57:51.517458 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7d399c-382b-454c-a77f-9ed97f9f18f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:57:51.547523 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.auth.core [None req-8d7d399c-382b-454c-a77f-9ed97f9f18f1 None None] MFA Rules not processed for user `5937e684d1784949a6b54405b5558035`. Rule list: `[]` (Enabled: `True`). {{(pid=81525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:57:51.548820 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-8d7d399c-382b-454c-a77f-9ed97f9f18f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:57:51.582023 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:57:51.627605 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1099/2166] 10.222.0.15 () {58 vars in 958 bytes} [Sun Oct 9 00:57:51 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:57:51.639845 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8758e08-246d-4622-87be-a9b9e723aeea admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:57:51.641730 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-c8758e08-246d-4622-87be-a9b9e723aeea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:57:51.653094 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:57:51.700425 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8758e08-246d-4622-87be-a9b9e723aeea admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:57:51.704160 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f47696-89e3-4bf8-8eee-09b0b85e1a04 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff7cb78bcd91467abe5c2e2b48aedd1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f148d39ced534860abfbe8fc3f98ace4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:57:51.704763 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f47696-89e3-4bf8-8eee-09b0b85e1a04 service cinder] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:57:51.705040 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f47696-89e3-4bf8-8eee-09b0b85e1a04 service cinder] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:57:51.705308 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f47696-89e3-4bf8-8eee-09b0b85e1a04 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:57:51.713706 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f47696-89e3-4bf8-8eee-09b0b85e1a04 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:57:51.715145 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f47696-89e3-4bf8-8eee-09b0b85e1a04 service cinder] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:57:51.724773 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1068/2167] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Oct 9 00:57:51 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 09 00:57:57.777152 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7d399c-382b-454c-a77f-9ed97f9f18f1 None None] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:57:57.779657 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-8d7d399c-382b-454c-a77f-9ed97f9f18f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:57:57.855580 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7d399c-382b-454c-a77f-9ed97f9f18f1 None None] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:57:57.860754 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5180b2e-3284-4979-9fe3-2606f2d759ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:57:57.861381 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5180b2e-3284-4979-9fe3-2606f2d759ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:57:57.861656 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5180b2e-3284-4979-9fe3-2606f2d759ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:57:57.861922 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5180b2e-3284-4979-9fe3-2606f2d759ef admin admin] PATH_INFO: `/v3/users/86ce232200994152a5d56afe59104340` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:57:57.863042 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5180b2e-3284-4979-9fe3-2606f2d759ef admin admin] RBAC: Authorizing `identity:delete_user(user_id=86ce232200994152a5d56afe59104340)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:57:57.865086 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5180b2e-3284-4979-9fe3-2606f2d759ef admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:57:57.915878 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-c5180b2e-3284-4979-9fe3-2606f2d759ef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '86ce232200994152a5d56afe59104340'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:57:57.922682 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-c5180b2e-3284-4979-9fe3-2606f2d759ef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '86ce232200994152a5d56afe59104340'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:57:57.923397 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-c5180b2e-3284-4979-9fe3-2606f2d759ef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '86ce232200994152a5d56afe59104340'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:57:57.924004 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-c5180b2e-3284-4979-9fe3-2606f2d759ef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '86ce232200994152a5d56afe59104340'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:57:57.934368 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-c5180b2e-3284-4979-9fe3-2606f2d759ef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '86ce232200994152a5d56afe59104340'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:57:57.957459 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1100/2168] 10.222.0.15 () {58 vars in 1224 bytes} [Sun Oct 9 00:57:57 2022] DELETE /identity/v3/users/86ce232200994152a5d56afe59104340 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 00:57:57.962845 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f032c1a-59c4-4bea-bc0a-673283a64bfc None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:57:57.963646 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f032c1a-59c4-4bea-bc0a-673283a64bfc None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:57:57.963646 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f032c1a-59c4-4bea-bc0a-673283a64bfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:57:57.984845 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-6f032c1a-59c4-4bea-bc0a-673283a64bfc None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:57:57.986093 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-6f032c1a-59c4-4bea-bc0a-673283a64bfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:57:58.057734 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1069/2169] 10.222.0.15 () {58 vars in 958 bytes} [Sun Oct 9 00:57:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:57:58.068326 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5180b2e-3284-4979-9fe3-2606f2d759ef admin admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:57:58.070055 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-c5180b2e-3284-4979-9fe3-2606f2d759ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:57:58.124672 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:57:58.130541 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5180b2e-3284-4979-9fe3-2606f2d759ef admin admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:57:58.134839 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbad6c6-2a97-41de-9667-ad1f8dcd5566 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4ef90d456d2483e8ddafbe2d4d4fb5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f148d39ced534860abfbe8fc3f98ace4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:57:58.135483 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbad6c6-2a97-41de-9667-ad1f8dcd5566 service neutron] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:57:58.135936 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbad6c6-2a97-41de-9667-ad1f8dcd5566 service neutron] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:57:58.136344 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbad6c6-2a97-41de-9667-ad1f8dcd5566 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:57:58.145528 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbad6c6-2a97-41de-9667-ad1f8dcd5566 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:57:58.146970 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbad6c6-2a97-41de-9667-ad1f8dcd5566 service neutron] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:57:58.156527 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1101/2170] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Oct 9 00:57:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 09 00:57:58.498175 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f032c1a-59c4-4bea-bc0a-673283a64bfc None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:57:58.499670 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-6f032c1a-59c4-4bea-bc0a-673283a64bfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:57:58.511504 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f032c1a-59c4-4bea-bc0a-673283a64bfc None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:57:58.516113 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5933c110-3a3b-4b5a-9148-e54549d22479 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:57:58.516929 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5933c110-3a3b-4b5a-9148-e54549d22479 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:57:58.517197 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5933c110-3a3b-4b5a-9148-e54549d22479 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:57:58.517465 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5933c110-3a3b-4b5a-9148-e54549d22479 admin admin] PATH_INFO: `/v3/projects/d7088ea02ed34060a776bb43d13cd5b3` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:57:58.518598 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5933c110-3a3b-4b5a-9148-e54549d22479 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d7088ea02ed34060a776bb43d13cd5b3)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:57:58.521139 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5933c110-3a3b-4b5a-9148-e54549d22479 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:57:58.587068 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-5933c110-3a3b-4b5a-9148-e54549d22479 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd7088ea02ed34060a776bb43d13cd5b3', 'request_id': 'req-5933c110-3a3b-4b5a-9148-e54549d22479'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:57:58.596270 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-5933c110-3a3b-4b5a-9148-e54549d22479 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd7088ea02ed34060a776bb43d13cd5b3', 'request_id': 'req-5933c110-3a3b-4b5a-9148-e54549d22479'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:57:58.602961 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-5933c110-3a3b-4b5a-9148-e54549d22479 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd7088ea02ed34060a776bb43d13cd5b3', 'request_id': 'req-5933c110-3a3b-4b5a-9148-e54549d22479'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:57:58.614830 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-5933c110-3a3b-4b5a-9148-e54549d22479 admin admin] The token cache is being invalidate because project d7088ea02ed34060a776bb43d13cd5b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81524) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 09 00:57:58.615209 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-5933c110-3a3b-4b5a-9148-e54549d22479 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:57:58.615805 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-5933c110-3a3b-4b5a-9148-e54549d22479 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:57:58.617614 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1070/2171] 10.222.0.15 () {58 vars in 1233 bytes} [Sun Oct 9 00:57:58 2022] DELETE /identity/v3/projects/d7088ea02ed34060a776bb43d13cd5b3 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 00:57:58.623048 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6584650e-18a9-411a-b9e6-cf6956fd0f22 None None] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:57:58.623402 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6584650e-18a9-411a-b9e6-cf6956fd0f22 None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:57:58.623707 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6584650e-18a9-411a-b9e6-cf6956fd0f22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:57:58.644138 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.auth.core [None req-6584650e-18a9-411a-b9e6-cf6956fd0f22 None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:57:58.645389 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-6584650e-18a9-411a-b9e6-cf6956fd0f22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:57:58.708502 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1102/2172] 10.222.0.15 () {58 vars in 958 bytes} [Sun Oct 9 00:57:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:57:58.716692 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8bde75-30f6-4755-8882-e39621a90cd0 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:57:58.716977 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8bde75-30f6-4755-8882-e39621a90cd0 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:57:58.717251 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8bde75-30f6-4755-8882-e39621a90cd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:57:58.743816 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-0a8bde75-30f6-4755-8882-e39621a90cd0 None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:57:58.745042 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-0a8bde75-30f6-4755-8882-e39621a90cd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:57:58.753576 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1071/2173] 10.222.0.15 () {58 vars in 958 bytes} [Sun Oct 9 00:57:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:57:58.757984 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6584650e-18a9-411a-b9e6-cf6956fd0f22 None None] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:57:58.768287 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6584650e-18a9-411a-b9e6-cf6956fd0f22 None None] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:57:58.773159 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef17f4a3-016a-4c33-8867-ef022798611f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:57:58.773948 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef17f4a3-016a-4c33-8867-ef022798611f admin admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:57:58.774398 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef17f4a3-016a-4c33-8867-ef022798611f admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:57:58.774677 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef17f4a3-016a-4c33-8867-ef022798611f admin admin] PATH_INFO: `/v3/domains` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:57:58.775358 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef17f4a3-016a-4c33-8867-ef022798611f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 00:57:58.775660 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef17f4a3-016a-4c33-8867-ef022798611f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:57:58.777248 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef17f4a3-016a-4c33-8867-ef022798611f admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:57:58.796408 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1103/2174] 10.222.0.15 () {58 vars in 1153 bytes} [Sun Oct 9 00:57:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 00:57:58.797590 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8bde75-30f6-4755-8882-e39621a90cd0 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:57:58.808408 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8bde75-30f6-4755-8882-e39621a90cd0 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:57:58.813294 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362e1b2c-405b-4afc-b3c9-1674b9ca8a7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:57:58.813907 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362e1b2c-405b-4afc-b3c9-1674b9ca8a7e admin admin] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:57:58.814207 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362e1b2c-405b-4afc-b3c9-1674b9ca8a7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:57:58.814473 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362e1b2c-405b-4afc-b3c9-1674b9ca8a7e admin admin] PATH_INFO: `/v3/projects` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:57:58.815119 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362e1b2c-405b-4afc-b3c9-1674b9ca8a7e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:57:58.817131 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362e1b2c-405b-4afc-b3c9-1674b9ca8a7e admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:57:58.846516 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1072/2175] 10.222.0.15 () {60 vars in 1153 bytes} [Sun Oct 9 00:57:58 2022] POST /identity/v3/projects => generated 373 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 09 00:57:58.850844 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef17f4a3-016a-4c33-8867-ef022798611f admin admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:57:58.860952 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef17f4a3-016a-4c33-8867-ef022798611f admin admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:57:58.922664 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ff8be4-58d2-4ac0-bc33-991aca5411af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:57:58.923073 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ff8be4-58d2-4ac0-bc33-991aca5411af admin admin] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:57:58.923383 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ff8be4-58d2-4ac0-bc33-991aca5411af admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:57:58.923652 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ff8be4-58d2-4ac0-bc33-991aca5411af admin admin] PATH_INFO: `/v3/users` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:57:58.924321 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ff8be4-58d2-4ac0-bc33-991aca5411af admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:57:58.926317 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ff8be4-58d2-4ac0-bc33-991aca5411af admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:57:58.950288 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1104/2176] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Oct 9 00:57:58 2022] POST /identity/v3/users => generated 287 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 09 00:57:58.954439 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362e1b2c-405b-4afc-b3c9-1674b9ca8a7e admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:57:58.964754 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362e1b2c-405b-4afc-b3c9-1674b9ca8a7e admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:57:58.970027 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b455164-e757-403e-962e-8202cb41dfed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:57:58.970636 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b455164-e757-403e-962e-8202cb41dfed admin admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:57:58.970938 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b455164-e757-403e-962e-8202cb41dfed admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:57:58.971205 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b455164-e757-403e-962e-8202cb41dfed admin admin] PATH_INFO: `/v3/roles` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:57:58.971890 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b455164-e757-403e-962e-8202cb41dfed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:57:58.973632 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b455164-e757-403e-962e-8202cb41dfed admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:57:58.975026 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:57:58.987420 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1073/2177] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Oct 9 00:57:58 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 09 00:57:58.990983 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ff8be4-58d2-4ac0-bc33-991aca5411af admin admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:57:59.005010 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ff8be4-58d2-4ac0-bc33-991aca5411af admin admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:57:59.010793 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79f83eb-5ce2-4e43-b13b-f952ab2114c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:57:59.011430 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79f83eb-5ce2-4e43-b13b-f952ab2114c1 admin admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:57:59.011706 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79f83eb-5ce2-4e43-b13b-f952ab2114c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:57:59.011949 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79f83eb-5ce2-4e43-b13b-f952ab2114c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:57:59.012620 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79f83eb-5ce2-4e43-b13b-f952ab2114c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:57:59.014216 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79f83eb-5ce2-4e43-b13b-f952ab2114c1 admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:57:59.025357 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1105/2178] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Oct 9 00:57:58 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 09 00:57:59.029738 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b455164-e757-403e-962e-8202cb41dfed admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:57:59.040265 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b455164-e757-403e-962e-8202cb41dfed admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:57:59.045336 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af64abf-3372-476d-90b3-fd55bd871cfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:57:59.045981 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af64abf-3372-476d-90b3-fd55bd871cfc admin admin] REQUEST_METHOD: `PUT` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:57:59.046247 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af64abf-3372-476d-90b3-fd55bd871cfc admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:57:59.046496 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af64abf-3372-476d-90b3-fd55bd871cfc admin admin] PATH_INFO: `/v3/projects/27085b15cb064048ab88d052c6310c4e/users/28670c0284654296bd516e2ebde9831b/roles/afb0a01183d9497795eaa4fa1a4046ae` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:57:59.061355 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af64abf-3372-476d-90b3-fd55bd871cfc admin admin] RBAC: Authorizing `identity:create_grant(project_id=27085b15cb064048ab88d052c6310c4e, user_id=28670c0284654296bd516e2ebde9831b, role_id=afb0a01183d9497795eaa4fa1a4046ae)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:57:59.064302 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af64abf-3372-476d-90b3-fd55bd871cfc admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:57:59.079650 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1074/2179] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Oct 9 00:57:59 2022] PUT /identity/v3/projects/27085b15cb064048ab88d052c6310c4e/users/28670c0284654296bd516e2ebde9831b/roles/afb0a01183d9497795eaa4fa1a4046ae => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 09 00:57:59.090178 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4d52a9-4756-4b2f-88e5-2f32f795fc36 None None] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:57:59.090483 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4d52a9-4756-4b2f-88e5-2f32f795fc36 None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:57:59.090756 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4d52a9-4756-4b2f-88e5-2f32f795fc36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:57:59.123716 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.auth.core [None req-1b4d52a9-4756-4b2f-88e5-2f32f795fc36 None None] MFA Rules not processed for user `28670c0284654296bd516e2ebde9831b`. Rule list: `[]` (Enabled: `True`). {{(pid=81525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:57:59.124943 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-1b4d52a9-4756-4b2f-88e5-2f32f795fc36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:57:59.176807 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:57:59.200713 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1106/2180] 10.222.0.15 () {58 vars in 958 bytes} [Sun Oct 9 00:57:59 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:57:59.213677 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af64abf-3372-476d-90b3-fd55bd871cfc admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:57:59.215470 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-1af64abf-3372-476d-90b3-fd55bd871cfc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:57:59.276475 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af64abf-3372-476d-90b3-fd55bd871cfc admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:57:59.281226 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0040d39d-ce8c-44d1-8768-a18f8c47d3ab service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff7cb78bcd91467abe5c2e2b48aedd1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f148d39ced534860abfbe8fc3f98ace4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:57:59.281837 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0040d39d-ce8c-44d1-8768-a18f8c47d3ab service cinder] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:57:59.282113 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0040d39d-ce8c-44d1-8768-a18f8c47d3ab service cinder] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:57:59.282411 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0040d39d-ce8c-44d1-8768-a18f8c47d3ab service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:57:59.291237 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0040d39d-ce8c-44d1-8768-a18f8c47d3ab service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:57:59.292713 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0040d39d-ce8c-44d1-8768-a18f8c47d3ab service cinder] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:57:59.302377 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1075/2181] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Oct 9 00:57:59 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 09 00:58:02.417913 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4d52a9-4756-4b2f-88e5-2f32f795fc36 None None] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:58:02.492876 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4d52a9-4756-4b2f-88e5-2f32f795fc36 None None] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:58:02.499153 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfa82e3-f6c9-4de3-8ce5-0c8cd6c55747 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:58:02.499820 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfa82e3-f6c9-4de3-8ce5-0c8cd6c55747 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:58:02.500216 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfa82e3-f6c9-4de3-8ce5-0c8cd6c55747 admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:58:02.500487 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfa82e3-f6c9-4de3-8ce5-0c8cd6c55747 admin admin] PATH_INFO: `/v3/users/28670c0284654296bd516e2ebde9831b` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:58:02.501836 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfa82e3-f6c9-4de3-8ce5-0c8cd6c55747 admin admin] RBAC: Authorizing `identity:delete_user(user_id=28670c0284654296bd516e2ebde9831b)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:58:02.503802 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfa82e3-f6c9-4de3-8ce5-0c8cd6c55747 admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:58:02.563922 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-cdfa82e3-f6c9-4de3-8ce5-0c8cd6c55747 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '28670c0284654296bd516e2ebde9831b'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:58:02.570746 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-cdfa82e3-f6c9-4de3-8ce5-0c8cd6c55747 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '28670c0284654296bd516e2ebde9831b'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:58:02.571446 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-cdfa82e3-f6c9-4de3-8ce5-0c8cd6c55747 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '28670c0284654296bd516e2ebde9831b'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:58:02.572049 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-cdfa82e3-f6c9-4de3-8ce5-0c8cd6c55747 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '28670c0284654296bd516e2ebde9831b'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:58:02.581537 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-cdfa82e3-f6c9-4de3-8ce5-0c8cd6c55747 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '28670c0284654296bd516e2ebde9831b'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:58:02.599479 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1107/2182] 10.222.0.15 () {58 vars in 1224 bytes} [Sun Oct 9 00:58:02 2022] DELETE /identity/v3/users/28670c0284654296bd516e2ebde9831b => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 00:58:02.604458 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe87fcf-1a2b-4540-b0eb-9f19b2797d51 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:58:02.604926 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe87fcf-1a2b-4540-b0eb-9f19b2797d51 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:58:02.605125 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe87fcf-1a2b-4540-b0eb-9f19b2797d51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:58:02.628030 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-bbe87fcf-1a2b-4540-b0eb-9f19b2797d51 None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:58:02.629245 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-bbe87fcf-1a2b-4540-b0eb-9f19b2797d51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:58:02.695322 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1076/2183] 10.222.0.15 () {58 vars in 958 bytes} [Sun Oct 9 00:58:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:58:02.712022 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfa82e3-f6c9-4de3-8ce5-0c8cd6c55747 admin admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:58:02.713540 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-cdfa82e3-f6c9-4de3-8ce5-0c8cd6c55747 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:58:02.794238 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfa82e3-f6c9-4de3-8ce5-0c8cd6c55747 admin admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:58:02.798530 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c1b22d-bafc-4eb5-af60-a5b421425d69 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4ef90d456d2483e8ddafbe2d4d4fb5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f148d39ced534860abfbe8fc3f98ace4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:58:02.799226 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c1b22d-bafc-4eb5-af60-a5b421425d69 service neutron] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:58:02.799451 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c1b22d-bafc-4eb5-af60-a5b421425d69 service neutron] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:58:02.799875 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c1b22d-bafc-4eb5-af60-a5b421425d69 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:58:02.810949 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c1b22d-bafc-4eb5-af60-a5b421425d69 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:58:02.812471 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c1b22d-bafc-4eb5-af60-a5b421425d69 service neutron] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:58:02.823904 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1108/2184] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Oct 9 00:58:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 09 00:58:03.191806 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe87fcf-1a2b-4540-b0eb-9f19b2797d51 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:58:03.193900 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-bbe87fcf-1a2b-4540-b0eb-9f19b2797d51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:58:03.214133 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe87fcf-1a2b-4540-b0eb-9f19b2797d51 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:58:03.227414 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7913e881-17c9-468d-af04-0d4d512c2259 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:58:03.228386 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7913e881-17c9-468d-af04-0d4d512c2259 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:58:03.228888 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7913e881-17c9-468d-af04-0d4d512c2259 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:58:03.229547 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7913e881-17c9-468d-af04-0d4d512c2259 admin admin] PATH_INFO: `/v3/projects/27085b15cb064048ab88d052c6310c4e` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:58:03.231456 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7913e881-17c9-468d-af04-0d4d512c2259 admin admin] RBAC: Authorizing `identity:delete_project(project_id=27085b15cb064048ab88d052c6310c4e)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:58:03.233847 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7913e881-17c9-468d-af04-0d4d512c2259 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:58:03.330173 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-7913e881-17c9-468d-af04-0d4d512c2259 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '27085b15cb064048ab88d052c6310c4e', 'request_id': 'req-7913e881-17c9-468d-af04-0d4d512c2259'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:58:03.342505 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-7913e881-17c9-468d-af04-0d4d512c2259 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '27085b15cb064048ab88d052c6310c4e', 'request_id': 'req-7913e881-17c9-468d-af04-0d4d512c2259'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:58:03.350879 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-7913e881-17c9-468d-af04-0d4d512c2259 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '27085b15cb064048ab88d052c6310c4e', 'request_id': 'req-7913e881-17c9-468d-af04-0d4d512c2259'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:58:03.359300 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:58:03.366046 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-7913e881-17c9-468d-af04-0d4d512c2259 admin admin] The token cache is being invalidate because project 27085b15cb064048ab88d052c6310c4e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81524) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 09 00:58:03.366339 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-7913e881-17c9-468d-af04-0d4d512c2259 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:58:03.367558 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-7913e881-17c9-468d-af04-0d4d512c2259 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:58:03.370196 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1077/2185] 10.222.0.15 () {58 vars in 1233 bytes} [Sun Oct 9 00:58:03 2022] DELETE /identity/v3/projects/27085b15cb064048ab88d052c6310c4e => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 00:58:07.123015 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d432bbb-1584-4983-847b-f5bca047d188 None None] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:58:07.123690 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d432bbb-1584-4983-847b-f5bca047d188 None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:58:07.123690 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d432bbb-1584-4983-847b-f5bca047d188 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:58:07.138460 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:58:07.144998 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.auth.core [None req-6d432bbb-1584-4983-847b-f5bca047d188 None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:58:07.146878 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-6d432bbb-1584-4983-847b-f5bca047d188 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:58:07.213374 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1109/2186] 10.222.0.48 () {58 vars in 1016 bytes} [Sun Oct 9 00:58:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 09 00:58:07.253839 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7913e881-17c9-468d-af04-0d4d512c2259 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:58:07.256132 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-7913e881-17c9-468d-af04-0d4d512c2259 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:58:07.337565 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7913e881-17c9-468d-af04-0d4d512c2259 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:58:07.343492 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b66b67-d0a9-4f8e-9dea-df0f8da220a3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ac83d57fba841e0a666710732249c49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f148d39ced534860abfbe8fc3f98ace4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:58:07.344103 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b66b67-d0a9-4f8e-9dea-df0f8da220a3 service nova] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:58:07.344379 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b66b67-d0a9-4f8e-9dea-df0f8da220a3 service nova] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:58:07.344651 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b66b67-d0a9-4f8e-9dea-df0f8da220a3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:58:07.353061 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b66b67-d0a9-4f8e-9dea-df0f8da220a3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:58:07.354860 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b66b67-d0a9-4f8e-9dea-df0f8da220a3 service nova] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:58:07.365472 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1078/2187] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Oct 9 00:58:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 09 00:58:11.194564 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c225c8-7490-4dbb-bd6f-d0e3fb19be92 None None] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:58:11.195134 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c225c8-7490-4dbb-bd6f-d0e3fb19be92 None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:58:11.195395 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c225c8-7490-4dbb-bd6f-d0e3fb19be92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:58:11.216799 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.auth.core [None req-79c225c8-7490-4dbb-bd6f-d0e3fb19be92 None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:58:11.218020 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-79c225c8-7490-4dbb-bd6f-d0e3fb19be92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:58:11.226883 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1110/2188] 10.222.0.48 () {58 vars in 1016 bytes} [Sun Oct 9 00:58:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:58:11.257129 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b66b67-d0a9-4f8e-9dea-df0f8da220a3 service nova] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:58:11.259626 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-35b66b67-d0a9-4f8e-9dea-df0f8da220a3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:58:11.280452 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b66b67-d0a9-4f8e-9dea-df0f8da220a3 service nova] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:58:11.287584 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb18e229-fddd-4fbc-8556-02a93a8ef260 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ac83d57fba841e0a666710732249c49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f148d39ced534860abfbe8fc3f98ace4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:58:11.288211 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb18e229-fddd-4fbc-8556-02a93a8ef260 service nova] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:58:11.288487 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb18e229-fddd-4fbc-8556-02a93a8ef260 service nova] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:58:11.288753 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb18e229-fddd-4fbc-8556-02a93a8ef260 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:58:11.299482 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb18e229-fddd-4fbc-8556-02a93a8ef260 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:58:11.301071 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb18e229-fddd-4fbc-8556-02a93a8ef260 service nova] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:58:11.311367 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1079/2189] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Oct 9 00:58:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 09 00:58:15.516585 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789c5a59-7727-496c-acf4-17b6b60f8a19 None None] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:58:15.517044 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789c5a59-7727-496c-acf4-17b6b60f8a19 None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:58:15.517134 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789c5a59-7727-496c-acf4-17b6b60f8a19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:58:15.541092 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.auth.core [None req-789c5a59-7727-496c-acf4-17b6b60f8a19 None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:58:15.542316 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-789c5a59-7727-496c-acf4-17b6b60f8a19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:58:15.551539 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1111/2190] 10.222.0.48 () {58 vars in 1016 bytes} [Sun Oct 9 00:58:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 09 00:58:15.576926 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb18e229-fddd-4fbc-8556-02a93a8ef260 service nova] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:58:15.592862 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb18e229-fddd-4fbc-8556-02a93a8ef260 service nova] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:58:15.602169 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24f7ffb-f8f2-45ab-95dc-201be34f3832 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ac83d57fba841e0a666710732249c49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f148d39ced534860abfbe8fc3f98ace4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:58:15.603031 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24f7ffb-f8f2-45ab-95dc-201be34f3832 service nova] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:58:15.603434 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24f7ffb-f8f2-45ab-95dc-201be34f3832 service nova] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:58:15.603821 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24f7ffb-f8f2-45ab-95dc-201be34f3832 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:58:15.614956 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24f7ffb-f8f2-45ab-95dc-201be34f3832 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:58:15.616607 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24f7ffb-f8f2-45ab-95dc-201be34f3832 service nova] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:58:15.629482 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1080/2191] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Oct 9 00:58:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 09 00:58:18.543085 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b2197c-e802-4198-8cf5-390adbba11f7 None None] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:58:18.543734 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b2197c-e802-4198-8cf5-390adbba11f7 None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:58:18.543734 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b2197c-e802-4198-8cf5-390adbba11f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:58:18.571993 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.auth.core [None req-b7b2197c-e802-4198-8cf5-390adbba11f7 None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:58:18.573283 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-b7b2197c-e802-4198-8cf5-390adbba11f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:58:18.581741 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1112/2192] 10.222.0.48 () {58 vars in 1016 bytes} [Sun Oct 9 00:58:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:58:18.610349 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24f7ffb-f8f2-45ab-95dc-201be34f3832 service nova] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:58:18.623000 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24f7ffb-f8f2-45ab-95dc-201be34f3832 service nova] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:58:18.628791 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cad779a-4525-41e0-bb43-b961e3f36ab8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ac83d57fba841e0a666710732249c49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f148d39ced534860abfbe8fc3f98ace4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:58:18.629354 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cad779a-4525-41e0-bb43-b961e3f36ab8 service nova] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:58:18.629519 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cad779a-4525-41e0-bb43-b961e3f36ab8 service nova] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:58:18.629785 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cad779a-4525-41e0-bb43-b961e3f36ab8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:58:18.639610 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cad779a-4525-41e0-bb43-b961e3f36ab8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:58:18.641244 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cad779a-4525-41e0-bb43-b961e3f36ab8 service nova] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:58:18.651665 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1081/2193] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Oct 9 00:58:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 09 00:58:24.750226 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba9f10c-5e19-4350-ba0d-74e7080c1b2a None None] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:58:24.751105 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba9f10c-5e19-4350-ba0d-74e7080c1b2a None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:58:24.751350 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba9f10c-5e19-4350-ba0d-74e7080c1b2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:58:24.773980 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.auth.core [None req-aba9f10c-5e19-4350-ba0d-74e7080c1b2a None None] MFA Rules not processed for user `5eaab5e4f7f14847b5c2ca8eb490d21c`. Rule list: `[]` (Enabled: `True`). {{(pid=81525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:58:24.775185 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-aba9f10c-5e19-4350-ba0d-74e7080c1b2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:58:24.832926 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1113/2194] 10.222.0.15 () {58 vars in 958 bytes} [Sun Oct 9 00:58:24 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:58:25.840547 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c01500a-20b7-486a-8e4f-5f10f64e3a08 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:58:25.841071 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c01500a-20b7-486a-8e4f-5f10f64e3a08 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:58:25.841579 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c01500a-20b7-486a-8e4f-5f10f64e3a08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:58:25.866428 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-7c01500a-20b7-486a-8e4f-5f10f64e3a08 None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:58:25.868062 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-7c01500a-20b7-486a-8e4f-5f10f64e3a08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:58:25.877068 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1082/2195] 10.222.0.48 () {58 vars in 1016 bytes} [Sun Oct 9 00:58:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:58:25.902351 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba9f10c-5e19-4350-ba0d-74e7080c1b2a None None] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:58:25.922003 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba9f10c-5e19-4350-ba0d-74e7080c1b2a None None] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:58:25.929284 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab9c6c0-6c8a-4ee8-9afe-f986c3d05e92 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ac83d57fba841e0a666710732249c49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f148d39ced534860abfbe8fc3f98ace4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:58:25.929925 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab9c6c0-6c8a-4ee8-9afe-f986c3d05e92 service nova] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:58:25.930493 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab9c6c0-6c8a-4ee8-9afe-f986c3d05e92 service nova] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:58:25.930751 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab9c6c0-6c8a-4ee8-9afe-f986c3d05e92 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:58:25.942557 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab9c6c0-6c8a-4ee8-9afe-f986c3d05e92 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:58:25.944759 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab9c6c0-6c8a-4ee8-9afe-f986c3d05e92 service nova] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:58:25.958416 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1114/2196] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Oct 9 00:58:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 09 00:58:26.778868 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe10313-0f41-48f5-aed0-1096e438fbb8 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:58:26.779455 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe10313-0f41-48f5-aed0-1096e438fbb8 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:58:26.779951 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe10313-0f41-48f5-aed0-1096e438fbb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:58:26.821006 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-afe10313-0f41-48f5-aed0-1096e438fbb8 None None] MFA Rules not processed for user `6a2d7675a1fe4301b2920c86a35312dd`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:58:26.822244 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-afe10313-0f41-48f5-aed0-1096e438fbb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:58:26.909612 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1083/2197] 10.222.0.15 () {58 vars in 958 bytes} [Sun Oct 9 00:58:26 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:58:28.423491 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab9c6c0-6c8a-4ee8-9afe-f986c3d05e92 service nova] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:58:28.425157 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-3ab9c6c0-6c8a-4ee8-9afe-f986c3d05e92 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:58:28.438682 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab9c6c0-6c8a-4ee8-9afe-f986c3d05e92 service nova] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:58:28.444854 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8379354-2094-44f5-8596-a47bb432ec80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:58:28.445461 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8379354-2094-44f5-8596-a47bb432ec80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:58:28.445730 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8379354-2094-44f5-8596-a47bb432ec80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:58:28.445992 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8379354-2094-44f5-8596-a47bb432ec80 admin admin] PATH_INFO: `/v3/users/5937e684d1784949a6b54405b5558035` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:58:28.447164 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8379354-2094-44f5-8596-a47bb432ec80 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5937e684d1784949a6b54405b5558035)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:58:28.449182 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8379354-2094-44f5-8596-a47bb432ec80 admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:58:28.511620 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-a8379354-2094-44f5-8596-a47bb432ec80 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5937e684d1784949a6b54405b5558035'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:58:28.519431 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-a8379354-2094-44f5-8596-a47bb432ec80 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5937e684d1784949a6b54405b5558035'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:58:28.520179 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-a8379354-2094-44f5-8596-a47bb432ec80 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5937e684d1784949a6b54405b5558035'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:58:28.520817 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-a8379354-2094-44f5-8596-a47bb432ec80 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5937e684d1784949a6b54405b5558035'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:58:28.532153 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-a8379354-2094-44f5-8596-a47bb432ec80 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5937e684d1784949a6b54405b5558035'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:58:28.540606 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:58:28.552625 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1115/2198] 10.222.0.15 () {58 vars in 1224 bytes} [Sun Oct 9 00:58:28 2022] DELETE /identity/v3/users/5937e684d1784949a6b54405b5558035 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 00:58:28.557635 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce0c2a0-5412-4722-b4b6-8b982d85aed7 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:58:28.558151 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce0c2a0-5412-4722-b4b6-8b982d85aed7 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:58:28.558151 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce0c2a0-5412-4722-b4b6-8b982d85aed7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:58:28.577712 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-cce0c2a0-5412-4722-b4b6-8b982d85aed7 None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:58:28.579167 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-cce0c2a0-5412-4722-b4b6-8b982d85aed7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:58:28.621276 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:58:28.643546 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1084/2199] 10.222.0.15 () {58 vars in 958 bytes} [Sun Oct 9 00:58:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:58:28.654657 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8379354-2094-44f5-8596-a47bb432ec80 admin admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:58:28.656078 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-a8379354-2094-44f5-8596-a47bb432ec80 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:58:28.722984 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8379354-2094-44f5-8596-a47bb432ec80 admin admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:58:28.726890 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b237f42-4a64-4200-a1b6-9fe1ca723f2b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4ef90d456d2483e8ddafbe2d4d4fb5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f148d39ced534860abfbe8fc3f98ace4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:58:28.727493 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b237f42-4a64-4200-a1b6-9fe1ca723f2b service neutron] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:58:28.727766 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b237f42-4a64-4200-a1b6-9fe1ca723f2b service neutron] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:58:28.728034 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b237f42-4a64-4200-a1b6-9fe1ca723f2b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:58:28.737175 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b237f42-4a64-4200-a1b6-9fe1ca723f2b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:58:28.738616 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b237f42-4a64-4200-a1b6-9fe1ca723f2b service neutron] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:58:28.748714 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1116/2200] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Oct 9 00:58:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 09 00:58:29.424671 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce0c2a0-5412-4722-b4b6-8b982d85aed7 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:58:29.426350 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-cce0c2a0-5412-4722-b4b6-8b982d85aed7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:58:29.458784 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce0c2a0-5412-4722-b4b6-8b982d85aed7 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:58:29.466626 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2a8759-6368-46ce-9b4a-9564a4ac6259 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:58:29.467327 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2a8759-6368-46ce-9b4a-9564a4ac6259 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:58:29.467769 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2a8759-6368-46ce-9b4a-9564a4ac6259 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:58:29.468044 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2a8759-6368-46ce-9b4a-9564a4ac6259 admin admin] PATH_INFO: `/v3/projects/b582c037afe647f1b856e524138daa76` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:58:29.470072 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2a8759-6368-46ce-9b4a-9564a4ac6259 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b582c037afe647f1b856e524138daa76)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:58:29.472753 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2a8759-6368-46ce-9b4a-9564a4ac6259 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:58:29.534654 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-da2a8759-6368-46ce-9b4a-9564a4ac6259 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b582c037afe647f1b856e524138daa76', 'request_id': 'req-da2a8759-6368-46ce-9b4a-9564a4ac6259'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:58:29.544429 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-da2a8759-6368-46ce-9b4a-9564a4ac6259 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b582c037afe647f1b856e524138daa76', 'request_id': 'req-da2a8759-6368-46ce-9b4a-9564a4ac6259'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:58:29.551631 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-da2a8759-6368-46ce-9b4a-9564a4ac6259 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b582c037afe647f1b856e524138daa76', 'request_id': 'req-da2a8759-6368-46ce-9b4a-9564a4ac6259'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:58:29.562785 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-da2a8759-6368-46ce-9b4a-9564a4ac6259 admin admin] The token cache is being invalidate because project b582c037afe647f1b856e524138daa76 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81524) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 09 00:58:29.563374 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-da2a8759-6368-46ce-9b4a-9564a4ac6259 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:58:29.563800 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-da2a8759-6368-46ce-9b4a-9564a4ac6259 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 00:58:29.565301 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1085/2201] 10.222.0.15 () {58 vars in 1233 bytes} [Sun Oct 9 00:58:29 2022] DELETE /identity/v3/projects/b582c037afe647f1b856e524138daa76 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 00:58:30.190421 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c093b0-c56b-44b5-9aac-569a3cb62575 None None] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:58:30.191431 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c093b0-c56b-44b5-9aac-569a3cb62575 None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:58:30.191926 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c093b0-c56b-44b5-9aac-569a3cb62575 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:58:30.272540 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.auth.core [None req-44c093b0-c56b-44b5-9aac-569a3cb62575 None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:58:30.273779 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-44c093b0-c56b-44b5-9aac-569a3cb62575 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:58:30.341396 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1117/2202] 10.222.0.48 () {58 vars in 1016 bytes} [Sun Oct 9 00:58:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:58:30.367367 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2a8759-6368-46ce-9b4a-9564a4ac6259 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:58:30.369236 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-da2a8759-6368-46ce-9b4a-9564a4ac6259 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:58:30.537424 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2a8759-6368-46ce-9b4a-9564a4ac6259 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:58:30.544348 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f75a6f4-2282-4acd-ad85-181f2d075d30 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ac83d57fba841e0a666710732249c49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f148d39ced534860abfbe8fc3f98ace4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:58:30.545195 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f75a6f4-2282-4acd-ad85-181f2d075d30 service nova] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:58:30.545616 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f75a6f4-2282-4acd-ad85-181f2d075d30 service nova] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:58:30.545958 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f75a6f4-2282-4acd-ad85-181f2d075d30 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:58:30.556930 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f75a6f4-2282-4acd-ad85-181f2d075d30 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:58:30.558553 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f75a6f4-2282-4acd-ad85-181f2d075d30 service nova] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:58:30.583477 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1086/2203] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Oct 9 00:58:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 09 00:58:35.741032 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2637897a-d3dd-4c30-a4f5-4a712f9be4fc None None] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:58:35.741633 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2637897a-d3dd-4c30-a4f5-4a712f9be4fc None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:58:35.741808 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2637897a-d3dd-4c30-a4f5-4a712f9be4fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:58:35.762895 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.auth.core [None req-2637897a-d3dd-4c30-a4f5-4a712f9be4fc None None] MFA Rules not processed for user `3a6cfef106c84f759ce0874be77f7380`. Rule list: `[]` (Enabled: `True`). {{(pid=81525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:58:35.764150 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-2637897a-d3dd-4c30-a4f5-4a712f9be4fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:58:35.826931 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1118/2204] 10.222.0.15 () {58 vars in 1009 bytes} [Sun Oct 9 00:58:35 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:58:35.878786 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f75a6f4-2282-4acd-ad85-181f2d075d30 service nova] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:58:35.880677 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-4f75a6f4-2282-4acd-ad85-181f2d075d30 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:58:35.941222 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:58:35.962000 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f75a6f4-2282-4acd-ad85-181f2d075d30 service nova] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:58:35.968318 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6660ca99-0f9e-4925-b532-05acd2567f82 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4c467943b8f4d31a2f067ca6ed3b25c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f148d39ced534860abfbe8fc3f98ace4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:58:35.968934 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6660ca99-0f9e-4925-b532-05acd2567f82 service swift] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:58:35.969214 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6660ca99-0f9e-4925-b532-05acd2567f82 service swift] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:58:35.969486 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6660ca99-0f9e-4925-b532-05acd2567f82 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:58:35.978436 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6660ca99-0f9e-4925-b532-05acd2567f82 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:58:35.980183 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6660ca99-0f9e-4925-b532-05acd2567f82 service swift] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:58:35.988873 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1087/2205] 10.222.0.15 () {60 vars in 1384 bytes} [Sun Oct 9 00:58:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 09 00:58:45.818083 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=81,keystone:DELETE=1 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:58:45.985529 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=9 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:58:55.106062 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53fccc3-c2d9-466d-8995-56f13fc6cf04 None None] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:58:55.106611 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53fccc3-c2d9-466d-8995-56f13fc6cf04 None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:58:55.106735 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53fccc3-c2d9-466d-8995-56f13fc6cf04 None None] PATH_INFO: `/` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:58:55.108180 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1119/2206] 10.222.0.15 () {54 vars in 921 bytes} [Sun Oct 9 00:58:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:58:55.114544 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd85666c-cf28-423b-9bbc-57060af3361e None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:58:55.115019 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd85666c-cf28-423b-9bbc-57060af3361e None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:58:55.115109 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd85666c-cf28-423b-9bbc-57060af3361e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:58:55.139108 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-bd85666c-cf28-423b-9bbc-57060af3361e None None] MFA Rules not processed for user `4ac83d57fba841e0a666710732249c49`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:58:55.140387 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-bd85666c-cf28-423b-9bbc-57060af3361e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:58:55.150681 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1088/2207] 10.222.0.15 () {58 vars in 1018 bytes} [Sun Oct 9 00:58:55 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:58:55.162350 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53fccc3-c2d9-466d-8995-56f13fc6cf04 None None] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:58:55.164262 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-d53fccc3-c2d9-466d-8995-56f13fc6cf04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:58:55.224483 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53fccc3-c2d9-466d-8995-56f13fc6cf04 None None] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:58:55.227954 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb56d75-abee-4e60-9960-8620102a1fce service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd88a9f3d154c4cf98369972a0561b2b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f148d39ced534860abfbe8fc3f98ace4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:58:55.228590 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb56d75-abee-4e60-9960-8620102a1fce service glance] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:58:55.228861 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb56d75-abee-4e60-9960-8620102a1fce service glance] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:58:55.229128 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb56d75-abee-4e60-9960-8620102a1fce service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:58:55.239517 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb56d75-abee-4e60-9960-8620102a1fce service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:58:55.241037 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb56d75-abee-4e60-9960-8620102a1fce service glance] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:58:55.252160 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1120/2208] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Oct 9 00:58:55 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 09 00:58:55.329270 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91716b1-df4b-436d-83e7-c3d9a952f882 None None] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:58:55.329538 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91716b1-df4b-436d-83e7-c3d9a952f882 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:58:55.329821 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91716b1-df4b-436d-83e7-c3d9a952f882 None None] PATH_INFO: `/` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:58:55.331174 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1089/2209] 10.222.0.15 () {54 vars in 921 bytes} [Sun Oct 9 00:58:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:58:55.336132 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c029bb27-d217-4168-97f8-4c5196c102bd None None] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:58:55.336409 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c029bb27-d217-4168-97f8-4c5196c102bd None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:58:55.336671 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c029bb27-d217-4168-97f8-4c5196c102bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:58:55.356323 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.auth.core [None req-c029bb27-d217-4168-97f8-4c5196c102bd None None] MFA Rules not processed for user `f4ef90d456d2483e8ddafbe2d4d4fb5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:58:55.357529 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-c029bb27-d217-4168-97f8-4c5196c102bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:58:55.410373 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1121/2210] 10.222.0.15 () {58 vars in 1018 bytes} [Sun Oct 9 00:58:55 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:58:55.422531 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91716b1-df4b-436d-83e7-c3d9a952f882 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:58:55.424498 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-f91716b1-df4b-436d-83e7-c3d9a952f882 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:58:55.438707 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91716b1-df4b-436d-83e7-c3d9a952f882 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:58:55.442726 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60025cb-a11b-4213-bfb1-a0d4f118cdcf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4ef90d456d2483e8ddafbe2d4d4fb5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f148d39ced534860abfbe8fc3f98ace4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:58:55.443769 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60025cb-a11b-4213-bfb1-a0d4f118cdcf service neutron] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:58:55.443769 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60025cb-a11b-4213-bfb1-a0d4f118cdcf service neutron] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:58:55.443769 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60025cb-a11b-4213-bfb1-a0d4f118cdcf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:58:55.452007 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60025cb-a11b-4213-bfb1-a0d4f118cdcf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:58:55.453443 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60025cb-a11b-4213-bfb1-a0d4f118cdcf service neutron] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:58:55.460868 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e4a268-6925-4612-ad22-6da6dfcca8d2 None None] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:58:55.461088 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e4a268-6925-4612-ad22-6da6dfcca8d2 None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:58:55.461361 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e4a268-6925-4612-ad22-6da6dfcca8d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:58:55.463133 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1090/2211] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Oct 9 00:58:55 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 09 00:58:55.480584 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.auth.core [None req-e6e4a268-6925-4612-ad22-6da6dfcca8d2 None None] MFA Rules not processed for user `db1857277e4f48a598b69b8ea4c15ac3`. Rule list: `[]` (Enabled: `True`). {{(pid=81525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:58:55.481706 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-e6e4a268-6925-4612-ad22-6da6dfcca8d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:58:55.541895 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1122/2212] 10.222.0.15 () {58 vars in 958 bytes} [Sun Oct 9 00:58:55 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:58:55.547291 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44042e80-b70c-474d-adc8-ab78cba9d26b None None] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:58:55.547585 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44042e80-b70c-474d-adc8-ab78cba9d26b None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:58:55.547861 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44042e80-b70c-474d-adc8-ab78cba9d26b None None] PATH_INFO: `/` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:58:55.549262 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1091/2213] 10.222.0.15 () {54 vars in 921 bytes} [Sun Oct 9 00:58:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:58:55.554505 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad69fc5b-15ec-42bf-b3b6-55358602640d None None] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:58:55.555089 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad69fc5b-15ec-42bf-b3b6-55358602640d None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:58:55.555446 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad69fc5b-15ec-42bf-b3b6-55358602640d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:58:55.577441 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.auth.core [None req-ad69fc5b-15ec-42bf-b3b6-55358602640d None None] MFA Rules not processed for user `4ac83d57fba841e0a666710732249c49`. Rule list: `[]` (Enabled: `True`). {{(pid=81525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:58:55.578671 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-ad69fc5b-15ec-42bf-b3b6-55358602640d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:58:55.588237 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1123/2214] 10.222.0.15 () {58 vars in 1018 bytes} [Sun Oct 9 00:58:55 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:58:55.599141 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44042e80-b70c-474d-adc8-ab78cba9d26b None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:58:55.610423 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44042e80-b70c-474d-adc8-ab78cba9d26b None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:58:55.614127 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64982cf-80a9-4421-ad06-e3d9820d5cf6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4ef90d456d2483e8ddafbe2d4d4fb5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f148d39ced534860abfbe8fc3f98ace4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:58:55.614725 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64982cf-80a9-4421-ad06-e3d9820d5cf6 service neutron] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:58:55.614996 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64982cf-80a9-4421-ad06-e3d9820d5cf6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:58:55.615292 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64982cf-80a9-4421-ad06-e3d9820d5cf6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:58:55.626473 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64982cf-80a9-4421-ad06-e3d9820d5cf6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:58:55.627931 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64982cf-80a9-4421-ad06-e3d9820d5cf6 service neutron] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:58:55.639140 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1092/2215] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Oct 9 00:58:55 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 09 00:58:59.613400 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10104cbc-d854-46dc-9756-48bdf0444b6a None None] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:58:59.613905 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10104cbc-d854-46dc-9756-48bdf0444b6a None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:58:59.613999 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10104cbc-d854-46dc-9756-48bdf0444b6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:58:59.634535 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.auth.core [None req-10104cbc-d854-46dc-9756-48bdf0444b6a None None] MFA Rules not processed for user `3a6cfef106c84f759ce0874be77f7380`. Rule list: `[]` (Enabled: `True`). {{(pid=81525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:58:59.635801 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-10104cbc-d854-46dc-9756-48bdf0444b6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:58:59.643499 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1124/2216] 10.222.0.15 () {58 vars in 1009 bytes} [Sun Oct 9 00:58:59 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:58:59.656021 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64982cf-80a9-4421-ad06-e3d9820d5cf6 service neutron] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:58:59.667764 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64982cf-80a9-4421-ad06-e3d9820d5cf6 service neutron] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:58:59.674454 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d14fe02-10a4-4b0c-8803-c999a90c2537 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4c467943b8f4d31a2f067ca6ed3b25c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f148d39ced534860abfbe8fc3f98ace4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:58:59.675190 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d14fe02-10a4-4b0c-8803-c999a90c2537 service swift] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:58:59.676170 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d14fe02-10a4-4b0c-8803-c999a90c2537 service swift] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:58:59.676170 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d14fe02-10a4-4b0c-8803-c999a90c2537 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:58:59.685591 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d14fe02-10a4-4b0c-8803-c999a90c2537 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:58:59.686727 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d14fe02-10a4-4b0c-8803-c999a90c2537 service swift] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:58:59.695659 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1093/2217] 10.222.0.15 () {60 vars in 1384 bytes} [Sun Oct 9 00:58:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 09 00:59:09.629140 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=80 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:59:09.691818 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=21 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:59:14.249190 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285b92c5-7fab-4d80-98e1-36cc317c6493 None None] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:59:14.249702 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285b92c5-7fab-4d80-98e1-36cc317c6493 None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:59:14.249804 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285b92c5-7fab-4d80-98e1-36cc317c6493 None None] PATH_INFO: `/` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:59:14.251165 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1125/2218] 10.222.0.15 () {54 vars in 961 bytes} [Sun Oct 9 00:59:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 00:59:14.257041 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473f0123-48f9-465f-b8ed-017f10a1d9ac None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:59:14.257466 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473f0123-48f9-465f-b8ed-017f10a1d9ac None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:59:14.257778 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473f0123-48f9-465f-b8ed-017f10a1d9ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:59:14.281608 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-473f0123-48f9-465f-b8ed-017f10a1d9ac None None] MFA Rules not processed for user `64be9d44437e4247a72334b9bab3cdd3`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:59:14.282993 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-473f0123-48f9-465f-b8ed-017f10a1d9ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:59:14.354047 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1094/2219] 10.222.0.15 () {58 vars in 1058 bytes} [Sun Oct 9 00:59:14 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:59:14.361873 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285b92c5-7fab-4d80-98e1-36cc317c6493 None None] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:59:14.376578 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285b92c5-7fab-4d80-98e1-36cc317c6493 None None] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:59:14.382191 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda574be-1cbb-44fe-bdb9-43116f2dd2cb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64be9d44437e4247a72334b9bab3cdd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f148d39ced534860abfbe8fc3f98ace4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:59:14.382837 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda574be-1cbb-44fe-bdb9-43116f2dd2cb service placement] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:59:14.383222 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda574be-1cbb-44fe-bdb9-43116f2dd2cb service placement] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:59:14.383552 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda574be-1cbb-44fe-bdb9-43116f2dd2cb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:59:14.385359 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-fda574be-1cbb-44fe-bdb9-43116f2dd2cb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:59:14.397748 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda574be-1cbb-44fe-bdb9-43116f2dd2cb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:59:14.399360 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda574be-1cbb-44fe-bdb9-43116f2dd2cb service placement] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:59:14.409810 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1126/2220] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Oct 9 00:59:14 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 09 00:59:18.264211 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dd6e74-79af-4cc5-90f9-43a36ae064d4 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:59:18.264742 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dd6e74-79af-4cc5-90f9-43a36ae064d4 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:59:18.264742 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dd6e74-79af-4cc5-90f9-43a36ae064d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:59:18.286738 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-a3dd6e74-79af-4cc5-90f9-43a36ae064d4 None None] MFA Rules not processed for user `3a6cfef106c84f759ce0874be77f7380`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:59:18.287999 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-a3dd6e74-79af-4cc5-90f9-43a36ae064d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:59:18.296853 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1095/2221] 10.222.0.15 () {58 vars in 967 bytes} [Sun Oct 9 00:59:18 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:59:18.310169 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda574be-1cbb-44fe-bdb9-43116f2dd2cb service placement] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:59:18.322620 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda574be-1cbb-44fe-bdb9-43116f2dd2cb service placement] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:59:18.328062 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac62dd8d-f872-49ea-887b-db9e9818c066 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4c467943b8f4d31a2f067ca6ed3b25c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f148d39ced534860abfbe8fc3f98ace4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:59:18.328660 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac62dd8d-f872-49ea-887b-db9e9818c066 service swift] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:59:18.329053 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac62dd8d-f872-49ea-887b-db9e9818c066 service swift] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:59:18.329324 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac62dd8d-f872-49ea-887b-db9e9818c066 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:59:18.337924 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac62dd8d-f872-49ea-887b-db9e9818c066 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:59:18.339550 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac62dd8d-f872-49ea-887b-db9e9818c066 service swift] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:59:18.349147 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1127/2222] 10.222.0.15 () {60 vars in 1384 bytes} [Sun Oct 9 00:59:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 09 00:59:23.893271 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe50147-63db-47b3-b9f1-9f7ec88431b4 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:59:23.893887 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe50147-63db-47b3-b9f1-9f7ec88431b4 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:59:23.893887 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe50147-63db-47b3-b9f1-9f7ec88431b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:59:23.919022 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-1fe50147-63db-47b3-b9f1-9f7ec88431b4 None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:59:23.920276 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-1fe50147-63db-47b3-b9f1-9f7ec88431b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:59:23.929589 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1096/2223] 10.222.0.48 () {58 vars in 1016 bytes} [Sun Oct 9 00:59:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:59:23.952393 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac62dd8d-f872-49ea-887b-db9e9818c066 service swift] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:59:23.953962 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-ac62dd8d-f872-49ea-887b-db9e9818c066 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:59:23.970533 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac62dd8d-f872-49ea-887b-db9e9818c066 service swift] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:59:23.977748 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75b19ad-828a-422b-a7ea-80eee5a8990e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ac83d57fba841e0a666710732249c49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f148d39ced534860abfbe8fc3f98ace4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:59:23.978350 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75b19ad-828a-422b-a7ea-80eee5a8990e service nova] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:59:23.978625 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75b19ad-828a-422b-a7ea-80eee5a8990e service nova] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:59:23.978890 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75b19ad-828a-422b-a7ea-80eee5a8990e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:59:23.987479 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75b19ad-828a-422b-a7ea-80eee5a8990e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:59:23.989100 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75b19ad-828a-422b-a7ea-80eee5a8990e service nova] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:59:23.999136 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1128/2224] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Oct 9 00:59:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 09 00:59:27.205967 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d2aa37-aace-4669-83c6-87b48d18e2c1 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:59:27.206557 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d2aa37-aace-4669-83c6-87b48d18e2c1 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:59:27.206557 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d2aa37-aace-4669-83c6-87b48d18e2c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:59:27.227600 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-a3d2aa37-aace-4669-83c6-87b48d18e2c1 None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:59:27.228810 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-a3d2aa37-aace-4669-83c6-87b48d18e2c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:59:27.237414 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1097/2225] 10.222.0.48 () {58 vars in 1016 bytes} [Sun Oct 9 00:59:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:59:27.264453 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75b19ad-828a-422b-a7ea-80eee5a8990e service nova] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:59:27.278792 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75b19ad-828a-422b-a7ea-80eee5a8990e service nova] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:59:27.288561 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8311f661-4342-48ad-8742-67f9dff38d97 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ac83d57fba841e0a666710732249c49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f148d39ced534860abfbe8fc3f98ace4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:59:27.289241 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8311f661-4342-48ad-8742-67f9dff38d97 service nova] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:59:27.289516 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8311f661-4342-48ad-8742-67f9dff38d97 service nova] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:59:27.289873 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8311f661-4342-48ad-8742-67f9dff38d97 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:59:27.303366 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8311f661-4342-48ad-8742-67f9dff38d97 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:59:27.304970 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8311f661-4342-48ad-8742-67f9dff38d97 service nova] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:59:27.315324 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1129/2226] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Oct 9 00:59:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 09 00:59:30.289099 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e932e3c-f76a-48c9-8767-cd5ccf5d0839 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:59:30.289696 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e932e3c-f76a-48c9-8767-cd5ccf5d0839 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:59:30.289696 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e932e3c-f76a-48c9-8767-cd5ccf5d0839 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:59:30.314255 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-8e932e3c-f76a-48c9-8767-cd5ccf5d0839 None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:59:30.315530 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-8e932e3c-f76a-48c9-8767-cd5ccf5d0839 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:59:30.325165 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1098/2227] 10.222.0.48 () {58 vars in 1016 bytes} [Sun Oct 9 00:59:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:59:30.356624 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8311f661-4342-48ad-8742-67f9dff38d97 service nova] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:59:30.368161 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8311f661-4342-48ad-8742-67f9dff38d97 service nova] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:59:30.374820 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52878bf-35ba-44a7-848d-b5a719418c8d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ac83d57fba841e0a666710732249c49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f148d39ced534860abfbe8fc3f98ace4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:59:30.375371 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52878bf-35ba-44a7-848d-b5a719418c8d service nova] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:59:30.375672 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52878bf-35ba-44a7-848d-b5a719418c8d service nova] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:59:30.375929 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52878bf-35ba-44a7-848d-b5a719418c8d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:59:30.384690 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52878bf-35ba-44a7-848d-b5a719418c8d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:59:30.386274 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52878bf-35ba-44a7-848d-b5a719418c8d service nova] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:59:30.395909 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1130/2228] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Oct 9 00:59:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 09 00:59:33.463095 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcf8497-f1e3-4371-aaa0-b98c4467cf10 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:59:33.463616 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcf8497-f1e3-4371-aaa0-b98c4467cf10 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:59:33.463726 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcf8497-f1e3-4371-aaa0-b98c4467cf10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:59:33.485436 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-adcf8497-f1e3-4371-aaa0-b98c4467cf10 None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:59:33.486685 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-adcf8497-f1e3-4371-aaa0-b98c4467cf10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:59:33.496610 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1099/2229] 10.222.0.48 () {58 vars in 1016 bytes} [Sun Oct 9 00:59:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:59:33.520588 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52878bf-35ba-44a7-848d-b5a719418c8d service nova] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:59:33.532406 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52878bf-35ba-44a7-848d-b5a719418c8d service nova] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:59:33.539145 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d28f57-ee77-4a2d-9f8c-6c53c65c47f3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ac83d57fba841e0a666710732249c49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f148d39ced534860abfbe8fc3f98ace4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:59:33.539853 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d28f57-ee77-4a2d-9f8c-6c53c65c47f3 service nova] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:59:33.540121 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d28f57-ee77-4a2d-9f8c-6c53c65c47f3 service nova] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:59:33.540391 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d28f57-ee77-4a2d-9f8c-6c53c65c47f3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:59:33.549561 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d28f57-ee77-4a2d-9f8c-6c53c65c47f3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:59:33.551150 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d28f57-ee77-4a2d-9f8c-6c53c65c47f3 service nova] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:59:33.560943 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1131/2230] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Oct 9 00:59:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 09 00:59:36.637178 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427804f2-08f1-4b05-98be-73eb2a3d86bc None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:59:36.637814 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427804f2-08f1-4b05-98be-73eb2a3d86bc None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:59:36.637814 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427804f2-08f1-4b05-98be-73eb2a3d86bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:59:36.658684 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-427804f2-08f1-4b05-98be-73eb2a3d86bc None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:59:36.660418 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-427804f2-08f1-4b05-98be-73eb2a3d86bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:59:36.670946 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1100/2231] 10.222.0.48 () {58 vars in 1016 bytes} [Sun Oct 9 00:59:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 00:59:36.697770 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d28f57-ee77-4a2d-9f8c-6c53c65c47f3 service nova] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 00:59:36.709937 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d28f57-ee77-4a2d-9f8c-6c53c65c47f3 service nova] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 00:59:36.716363 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520a9594-9638-4b1f-adc0-6dbb4cb85117 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ac83d57fba841e0a666710732249c49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f148d39ced534860abfbe8fc3f98ace4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 00:59:36.716974 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520a9594-9638-4b1f-adc0-6dbb4cb85117 service nova] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:59:36.717413 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520a9594-9638-4b1f-adc0-6dbb4cb85117 service nova] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:59:36.717682 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520a9594-9638-4b1f-adc0-6dbb4cb85117 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:59:36.727059 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520a9594-9638-4b1f-adc0-6dbb4cb85117 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 00:59:36.728926 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520a9594-9638-4b1f-adc0-6dbb4cb85117 service nova] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 00:59:36.739889 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1132/2232] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Oct 9 00:59:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 09 00:59:46.652973 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=47 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:59:46.735035 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=42 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 00:59:58.121146 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04861e8b-6bb2-4747-a255-135e3dcf7cf6 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 00:59:58.121687 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04861e8b-6bb2-4747-a255-135e3dcf7cf6 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 00:59:58.121687 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04861e8b-6bb2-4747-a255-135e3dcf7cf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 00:59:58.141374 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-04861e8b-6bb2-4747-a255-135e3dcf7cf6 None None] MFA Rules not processed for user `6a2d7675a1fe4301b2920c86a35312dd`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 00:59:58.142589 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-04861e8b-6bb2-4747-a255-135e3dcf7cf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 00:59:58.197904 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1101/2233] 10.222.0.15 () {58 vars in 958 bytes} [Sun Oct 9 00:59:58 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 01:00:03.195024 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4691e711-8c8a-4466-b1bf-a974839f58ae None None] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:00:03.195627 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4691e711-8c8a-4466-b1bf-a974839f58ae None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:00:03.195627 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4691e711-8c8a-4466-b1bf-a974839f58ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:00:03.214530 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.auth.core [None req-4691e711-8c8a-4466-b1bf-a974839f58ae None None] MFA Rules not processed for user `5eaab5e4f7f14847b5c2ca8eb490d21c`. Rule list: `[]` (Enabled: `True`). {{(pid=81525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 01:00:03.215734 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-4691e711-8c8a-4466-b1bf-a974839f58ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:00:03.273694 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1133/2234] 10.222.0.15 () {58 vars in 958 bytes} [Sun Oct 9 01:00:03 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 01:00:08.189913 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=25 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 01:00:10.302607 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f074dc2-0aac-4470-b3d8-3f073a9f6cb7 None None] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:00:10.303525 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f074dc2-0aac-4470-b3d8-3f073a9f6cb7 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:00:10.303978 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f074dc2-0aac-4470-b3d8-3f073a9f6cb7 None None] PATH_INFO: `/` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:00:10.305390 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1102/2235] 10.222.0.15 () {54 vars in 921 bytes} [Sun Oct 9 01:00:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 01:00:10.339749 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233c6691-5557-423c-86c9-94141aa7c368 None None] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:00:10.340364 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233c6691-5557-423c-86c9-94141aa7c368 None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:00:10.340364 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233c6691-5557-423c-86c9-94141aa7c368 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:00:10.374577 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.auth.core [None req-233c6691-5557-423c-86c9-94141aa7c368 None None] MFA Rules not processed for user `64be9d44437e4247a72334b9bab3cdd3`. Rule list: `[]` (Enabled: `True`). {{(pid=81525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 01:00:10.393645 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-233c6691-5557-423c-86c9-94141aa7c368 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:00:10.407639 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f074dc2-0aac-4470-b3d8-3f073a9f6cb7 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:00:10.409407 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-3f074dc2-0aac-4470-b3d8-3f073a9f6cb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:00:10.410355 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1134/2236] 10.222.0.15 () {58 vars in 1018 bytes} [Sun Oct 9 01:00:10 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 01:00:10.421426 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233c6691-5557-423c-86c9-94141aa7c368 None None] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:00:10.430068 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f074dc2-0aac-4470-b3d8-3f073a9f6cb7 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:00:10.431858 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233c6691-5557-423c-86c9-94141aa7c368 None None] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:00:10.435560 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1000dca6-932f-468e-a61b-fe3c665c8514 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:00:10.436203 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1000dca6-932f-468e-a61b-fe3c665c8514 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:00:10.436477 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1000dca6-932f-468e-a61b-fe3c665c8514 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:00:10.436777 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1000dca6-932f-468e-a61b-fe3c665c8514 admin admin] PATH_INFO: `/v3/users/db1857277e4f48a598b69b8ea4c15ac3` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:00:10.439291 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1000dca6-932f-468e-a61b-fe3c665c8514 admin admin] RBAC: Authorizing `identity:delete_user(user_id=db1857277e4f48a598b69b8ea4c15ac3)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:00:10.441269 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1000dca6-932f-468e-a61b-fe3c665c8514 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:00:10.454025 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3049a1-7bd9-4766-8dc3-168dc11997bc service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64be9d44437e4247a72334b9bab3cdd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f148d39ced534860abfbe8fc3f98ace4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:00:10.454827 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3049a1-7bd9-4766-8dc3-168dc11997bc service placement] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:00:10.456422 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3049a1-7bd9-4766-8dc3-168dc11997bc service placement] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:00:10.456842 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3049a1-7bd9-4766-8dc3-168dc11997bc service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:00:10.469937 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3049a1-7bd9-4766-8dc3-168dc11997bc service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:00:10.471987 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3049a1-7bd9-4766-8dc3-168dc11997bc service placement] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:00:10.483815 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1135/2237] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Oct 9 01:00:10 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 09 01:00:10.518873 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-1000dca6-932f-468e-a61b-fe3c665c8514 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'db1857277e4f48a598b69b8ea4c15ac3'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:00:10.536698 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-1000dca6-932f-468e-a61b-fe3c665c8514 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'db1857277e4f48a598b69b8ea4c15ac3'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:00:10.537479 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-1000dca6-932f-468e-a61b-fe3c665c8514 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'db1857277e4f48a598b69b8ea4c15ac3'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:00:10.538110 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-1000dca6-932f-468e-a61b-fe3c665c8514 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'db1857277e4f48a598b69b8ea4c15ac3'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:00:10.548917 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-1000dca6-932f-468e-a61b-fe3c665c8514 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'db1857277e4f48a598b69b8ea4c15ac3'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:00:10.568811 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1103/2238] 10.222.0.15 () {58 vars in 1224 bytes} [Sun Oct 9 01:00:10 2022] DELETE /identity/v3/users/db1857277e4f48a598b69b8ea4c15ac3 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 09 01:00:10.750834 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3049a1-7bd9-4766-8dc3-168dc11997bc service placement] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:00:10.768577 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3049a1-7bd9-4766-8dc3-168dc11997bc service placement] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:00:10.836714 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485d4ba4-deac-4e43-af15-00944f31c9ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:00:10.837388 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485d4ba4-deac-4e43-af15-00944f31c9ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:00:10.837660 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485d4ba4-deac-4e43-af15-00944f31c9ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:00:10.837924 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485d4ba4-deac-4e43-af15-00944f31c9ce admin admin] PATH_INFO: `/v3/projects/e0ba27e2890246dabe6086698d4787ef` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:00:10.839060 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485d4ba4-deac-4e43-af15-00944f31c9ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=e0ba27e2890246dabe6086698d4787ef)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:00:10.841073 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485d4ba4-deac-4e43-af15-00944f31c9ce admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:00:10.891400 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-485d4ba4-deac-4e43-af15-00944f31c9ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e0ba27e2890246dabe6086698d4787ef', 'request_id': 'req-485d4ba4-deac-4e43-af15-00944f31c9ce'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:00:10.901872 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-485d4ba4-deac-4e43-af15-00944f31c9ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e0ba27e2890246dabe6086698d4787ef', 'request_id': 'req-485d4ba4-deac-4e43-af15-00944f31c9ce'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:00:10.909058 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-485d4ba4-deac-4e43-af15-00944f31c9ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e0ba27e2890246dabe6086698d4787ef', 'request_id': 'req-485d4ba4-deac-4e43-af15-00944f31c9ce'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:00:10.919629 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-485d4ba4-deac-4e43-af15-00944f31c9ce admin admin] The token cache is being invalidate because project e0ba27e2890246dabe6086698d4787ef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81525) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 09 01:00:10.919913 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-485d4ba4-deac-4e43-af15-00944f31c9ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:00:10.920562 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-485d4ba4-deac-4e43-af15-00944f31c9ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:00:10.922167 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1136/2239] 10.222.0.15 () {58 vars in 1233 bytes} [Sun Oct 9 01:00:10 2022] DELETE /identity/v3/projects/e0ba27e2890246dabe6086698d4787ef => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 01:00:10.927352 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390478c0-34c6-44f4-85cb-8fd204ce96af None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:00:10.927638 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390478c0-34c6-44f4-85cb-8fd204ce96af None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:00:10.927906 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390478c0-34c6-44f4-85cb-8fd204ce96af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:00:10.948078 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-390478c0-34c6-44f4-85cb-8fd204ce96af None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 01:00:10.949212 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-390478c0-34c6-44f4-85cb-8fd204ce96af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:00:11.010808 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1104/2240] 10.222.0.15 () {58 vars in 958 bytes} [Sun Oct 9 01:00:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 01:00:11.018806 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53128df-5463-457e-b03b-5086c8214f8c None None] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:00:11.019093 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53128df-5463-457e-b03b-5086c8214f8c None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:00:11.019409 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53128df-5463-457e-b03b-5086c8214f8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:00:11.039352 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.auth.core [None req-d53128df-5463-457e-b03b-5086c8214f8c None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 01:00:11.040565 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-d53128df-5463-457e-b03b-5086c8214f8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:00:11.049359 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1137/2241] 10.222.0.15 () {58 vars in 958 bytes} [Sun Oct 9 01:00:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 01:00:11.053874 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390478c0-34c6-44f4-85cb-8fd204ce96af None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:00:11.064249 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390478c0-34c6-44f4-85cb-8fd204ce96af None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:00:11.070241 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2dafe26-9819-4398-91e7-553991a0fd11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:00:11.070879 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dafe26-9819-4398-91e7-553991a0fd11 admin admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:00:11.071148 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dafe26-9819-4398-91e7-553991a0fd11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:00:11.071444 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dafe26-9819-4398-91e7-553991a0fd11 admin admin] PATH_INFO: `/v3/domains` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:00:11.072113 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2dafe26-9819-4398-91e7-553991a0fd11 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 01:00:11.072411 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2dafe26-9819-4398-91e7-553991a0fd11 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:00:11.074008 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2dafe26-9819-4398-91e7-553991a0fd11 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:00:11.086110 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1105/2242] 10.222.0.15 () {58 vars in 1153 bytes} [Sun Oct 9 01:00:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 01:00:11.090951 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53128df-5463-457e-b03b-5086c8214f8c None None] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:00:11.100915 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53128df-5463-457e-b03b-5086c8214f8c None None] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:00:11.106690 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ff394f-0838-4d9d-8b9a-b407dcc7937f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:00:11.107322 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ff394f-0838-4d9d-8b9a-b407dcc7937f admin admin] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:00:11.107598 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ff394f-0838-4d9d-8b9a-b407dcc7937f admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:00:11.107862 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ff394f-0838-4d9d-8b9a-b407dcc7937f admin admin] PATH_INFO: `/v3/projects` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:00:11.108492 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ff394f-0838-4d9d-8b9a-b407dcc7937f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:00:11.110495 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ff394f-0838-4d9d-8b9a-b407dcc7937f admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:00:11.115976 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 01:00:11.140125 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1138/2243] 10.222.0.15 () {60 vars in 1153 bytes} [Sun Oct 9 01:00:11 2022] POST /identity/v3/projects => generated 385 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 09 01:00:11.144477 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2dafe26-9819-4398-91e7-553991a0fd11 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:00:11.154585 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2dafe26-9819-4398-91e7-553991a0fd11 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:00:11.211015 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a092fdf8-ec8e-4895-9aa2-ff486302dbee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:00:11.211568 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a092fdf8-ec8e-4895-9aa2-ff486302dbee admin admin] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:00:11.211842 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a092fdf8-ec8e-4895-9aa2-ff486302dbee admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:00:11.212108 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a092fdf8-ec8e-4895-9aa2-ff486302dbee admin admin] PATH_INFO: `/v3/users` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:00:11.212744 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a092fdf8-ec8e-4895-9aa2-ff486302dbee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:00:11.214649 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a092fdf8-ec8e-4895-9aa2-ff486302dbee admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:00:11.222740 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 01:00:11.239077 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1106/2244] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Oct 9 01:00:11 2022] POST /identity/v3/users => generated 293 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 09 01:00:11.243801 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ff394f-0838-4d9d-8b9a-b407dcc7937f admin admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:00:11.254199 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ff394f-0838-4d9d-8b9a-b407dcc7937f admin admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:00:11.260147 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461f3fe5-b03c-444d-858c-709afdca63a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:00:11.260765 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461f3fe5-b03c-444d-858c-709afdca63a0 admin admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:00:11.261035 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461f3fe5-b03c-444d-858c-709afdca63a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:00:11.261296 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461f3fe5-b03c-444d-858c-709afdca63a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:00:11.261945 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461f3fe5-b03c-444d-858c-709afdca63a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:00:11.263628 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461f3fe5-b03c-444d-858c-709afdca63a0 admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:00:11.274348 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1139/2245] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Oct 9 01:00:11 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 09 01:00:11.278593 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a092fdf8-ec8e-4895-9aa2-ff486302dbee admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:00:11.289522 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a092fdf8-ec8e-4895-9aa2-ff486302dbee admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:00:11.294538 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce62a51-f40c-425e-a56f-a8866c4fc01c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:00:11.295144 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce62a51-f40c-425e-a56f-a8866c4fc01c admin admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:00:11.295455 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce62a51-f40c-425e-a56f-a8866c4fc01c admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:00:11.295731 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce62a51-f40c-425e-a56f-a8866c4fc01c admin admin] PATH_INFO: `/v3/roles` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:00:11.296375 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce62a51-f40c-425e-a56f-a8866c4fc01c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:00:11.298406 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce62a51-f40c-425e-a56f-a8866c4fc01c admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:00:11.309697 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1107/2246] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Oct 9 01:00:11 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 09 01:00:11.315228 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461f3fe5-b03c-444d-858c-709afdca63a0 admin admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:00:11.325730 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461f3fe5-b03c-444d-858c-709afdca63a0 admin admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:00:11.331501 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5589d3eb-67e6-41ed-97e0-5056276c7ede admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:00:11.332163 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5589d3eb-67e6-41ed-97e0-5056276c7ede admin admin] REQUEST_METHOD: `PUT` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:00:11.332435 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5589d3eb-67e6-41ed-97e0-5056276c7ede admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:00:11.332705 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5589d3eb-67e6-41ed-97e0-5056276c7ede admin admin] PATH_INFO: `/v3/projects/9227a48214a24854b4f3365ce7d9c04c/users/751dff59acee4f188dd1edbfff46713c/roles/afb0a01183d9497795eaa4fa1a4046ae` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:00:11.347855 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5589d3eb-67e6-41ed-97e0-5056276c7ede admin admin] RBAC: Authorizing `identity:create_grant(project_id=9227a48214a24854b4f3365ce7d9c04c, user_id=751dff59acee4f188dd1edbfff46713c, role_id=afb0a01183d9497795eaa4fa1a4046ae)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:00:11.350533 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5589d3eb-67e6-41ed-97e0-5056276c7ede admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:00:11.365870 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1140/2247] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Oct 9 01:00:11 2022] PUT /identity/v3/projects/9227a48214a24854b4f3365ce7d9c04c/users/751dff59acee4f188dd1edbfff46713c/roles/afb0a01183d9497795eaa4fa1a4046ae => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 01:00:11.371289 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d857a4e4-9b71-4248-a0da-35375fa63ce0 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:00:11.371582 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d857a4e4-9b71-4248-a0da-35375fa63ce0 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:00:11.371871 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d857a4e4-9b71-4248-a0da-35375fa63ce0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:00:11.390916 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-d857a4e4-9b71-4248-a0da-35375fa63ce0 None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 01:00:11.392218 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-d857a4e4-9b71-4248-a0da-35375fa63ce0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:00:11.459467 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1108/2248] 10.222.0.15 () {58 vars in 958 bytes} [Sun Oct 9 01:00:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 01:00:11.469644 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5589d3eb-67e6-41ed-97e0-5056276c7ede admin admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:00:11.471737 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-5589d3eb-67e6-41ed-97e0-5056276c7ede admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:00:11.535328 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5589d3eb-67e6-41ed-97e0-5056276c7ede admin admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:00:11.539632 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195a1efa-9927-4948-afc0-8909103b6814 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4ef90d456d2483e8ddafbe2d4d4fb5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f148d39ced534860abfbe8fc3f98ace4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:00:11.540347 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195a1efa-9927-4948-afc0-8909103b6814 service neutron] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:00:11.540726 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195a1efa-9927-4948-afc0-8909103b6814 service neutron] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:00:11.541034 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195a1efa-9927-4948-afc0-8909103b6814 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:00:11.553212 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195a1efa-9927-4948-afc0-8909103b6814 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:00:11.554704 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195a1efa-9927-4948-afc0-8909103b6814 service neutron] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:00:11.565101 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1141/2249] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Oct 9 01:00:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 09 01:00:18.679625 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f718bd-cc0f-47d7-a9d6-655e15acd55d None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:00:18.680931 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f718bd-cc0f-47d7-a9d6-655e15acd55d None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:00:18.681531 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f718bd-cc0f-47d7-a9d6-655e15acd55d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:00:18.718778 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-71f718bd-cc0f-47d7-a9d6-655e15acd55d None None] MFA Rules not processed for user `751dff59acee4f188dd1edbfff46713c`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 01:00:18.720477 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-71f718bd-cc0f-47d7-a9d6-655e15acd55d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:00:18.816979 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1109/2250] 10.222.0.15 () {58 vars in 958 bytes} [Sun Oct 9 01:00:18 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 01:00:18.821409 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195a1efa-9927-4948-afc0-8909103b6814 service neutron] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:00:18.833347 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195a1efa-9927-4948-afc0-8909103b6814 service neutron] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:00:18.838691 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1522bdb2-fecf-48b9-9b69-e9c8c44ba8be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:00:18.839408 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1522bdb2-fecf-48b9-9b69-e9c8c44ba8be admin admin] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:00:18.839674 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1522bdb2-fecf-48b9-9b69-e9c8c44ba8be admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:00:18.840024 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1522bdb2-fecf-48b9-9b69-e9c8c44ba8be admin admin] PATH_INFO: `/v3/projects` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:00:18.840825 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1522bdb2-fecf-48b9-9b69-e9c8c44ba8be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:00:18.842965 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1522bdb2-fecf-48b9-9b69-e9c8c44ba8be admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:00:18.876956 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1142/2251] 10.222.0.15 () {60 vars in 1153 bytes} [Sun Oct 9 01:00:18 2022] POST /identity/v3/projects => generated 383 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 09 01:00:18.881920 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f718bd-cc0f-47d7-a9d6-655e15acd55d None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:00:18.900438 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f718bd-cc0f-47d7-a9d6-655e15acd55d None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:00:18.991123 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d92a97-ba0f-40a3-ac90-c8329d0a79ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:00:18.991921 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d92a97-ba0f-40a3-ac90-c8329d0a79ab admin admin] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:00:18.992236 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d92a97-ba0f-40a3-ac90-c8329d0a79ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:00:18.993077 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d92a97-ba0f-40a3-ac90-c8329d0a79ab admin admin] PATH_INFO: `/v3/users` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:00:18.994136 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d92a97-ba0f-40a3-ac90-c8329d0a79ab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:00:18.996840 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d92a97-ba0f-40a3-ac90-c8329d0a79ab admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:00:19.020168 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 01:00:19.037071 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1110/2252] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Oct 9 01:00:18 2022] POST /identity/v3/users => generated 298 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 09 01:00:19.040826 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1522bdb2-fecf-48b9-9b69-e9c8c44ba8be admin admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:00:19.054056 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1522bdb2-fecf-48b9-9b69-e9c8c44ba8be admin admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:00:19.059135 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424588ff-32ba-4343-8b96-8415d18e3d38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:00:19.059801 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424588ff-32ba-4343-8b96-8415d18e3d38 admin admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:00:19.060069 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424588ff-32ba-4343-8b96-8415d18e3d38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:00:19.060335 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424588ff-32ba-4343-8b96-8415d18e3d38 admin admin] PATH_INFO: `/v3/roles` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:00:19.061006 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424588ff-32ba-4343-8b96-8415d18e3d38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:00:19.062633 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424588ff-32ba-4343-8b96-8415d18e3d38 admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:00:19.079736 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1143/2253] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Oct 9 01:00:19 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 09 01:00:19.081599 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d92a97-ba0f-40a3-ac90-c8329d0a79ab admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:00:19.101152 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d92a97-ba0f-40a3-ac90-c8329d0a79ab admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:00:19.107164 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d947297f-d78f-4ae1-a3a7-25e427d11137 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:00:19.108914 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d947297f-d78f-4ae1-a3a7-25e427d11137 admin admin] REQUEST_METHOD: `PUT` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:00:19.109356 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d947297f-d78f-4ae1-a3a7-25e427d11137 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:00:19.109709 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d947297f-d78f-4ae1-a3a7-25e427d11137 admin admin] PATH_INFO: `/v3/projects/a7986203bd9f47039d130daa94a34cfe/users/366b3ff4b8114d8dbd2d7ab9d8b962e5/roles/f69dddf26daf4dd79d4c962beb877af5` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:00:19.126560 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d947297f-d78f-4ae1-a3a7-25e427d11137 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7986203bd9f47039d130daa94a34cfe, user_id=366b3ff4b8114d8dbd2d7ab9d8b962e5, role_id=f69dddf26daf4dd79d4c962beb877af5)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:00:19.129285 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d947297f-d78f-4ae1-a3a7-25e427d11137 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:00:19.153799 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1111/2254] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Oct 9 01:00:19 2022] PUT /identity/v3/projects/a7986203bd9f47039d130daa94a34cfe/users/366b3ff4b8114d8dbd2d7ab9d8b962e5/roles/f69dddf26daf4dd79d4c962beb877af5 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 09 01:00:19.157650 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424588ff-32ba-4343-8b96-8415d18e3d38 admin admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:00:19.168842 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424588ff-32ba-4343-8b96-8415d18e3d38 admin admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:00:19.249854 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7888b740-b949-40ac-9077-68ffbe89a60c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:00:19.250269 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7888b740-b949-40ac-9077-68ffbe89a60c admin admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:00:19.250849 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7888b740-b949-40ac-9077-68ffbe89a60c admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:00:19.251171 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7888b740-b949-40ac-9077-68ffbe89a60c admin admin] PATH_INFO: `/v3/roles` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:00:19.254436 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7888b740-b949-40ac-9077-68ffbe89a60c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:00:19.254436 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7888b740-b949-40ac-9077-68ffbe89a60c admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:00:19.276507 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1144/2255] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Oct 9 01:00:19 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 09 01:00:19.283432 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d947297f-d78f-4ae1-a3a7-25e427d11137 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:00:19.293692 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d947297f-d78f-4ae1-a3a7-25e427d11137 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:00:19.301013 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be97e578-ca64-4a5a-aace-3f893532ded9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:00:19.302523 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be97e578-ca64-4a5a-aace-3f893532ded9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:00:19.303888 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be97e578-ca64-4a5a-aace-3f893532ded9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:00:19.304413 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be97e578-ca64-4a5a-aace-3f893532ded9 admin admin] PATH_INFO: `/v3/projects/a7986203bd9f47039d130daa94a34cfe/users/366b3ff4b8114d8dbd2d7ab9d8b962e5/roles/f69dddf26daf4dd79d4c962beb877af5` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:00:19.306987 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be97e578-ca64-4a5a-aace-3f893532ded9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7986203bd9f47039d130daa94a34cfe, user_id=366b3ff4b8114d8dbd2d7ab9d8b962e5, role_id=f69dddf26daf4dd79d4c962beb877af5)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:00:19.309719 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be97e578-ca64-4a5a-aace-3f893532ded9 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:00:19.322606 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1112/2256] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Oct 9 01:00:19 2022] PUT /identity/v3/projects/a7986203bd9f47039d130daa94a34cfe/users/366b3ff4b8114d8dbd2d7ab9d8b962e5/roles/f69dddf26daf4dd79d4c962beb877af5 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 01:00:20.080841 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f706af05-8094-4905-889c-fa8482e6f89d None None] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:00:20.081510 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f706af05-8094-4905-889c-fa8482e6f89d None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:00:20.081510 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f706af05-8094-4905-889c-fa8482e6f89d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:00:20.102221 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.auth.core [None req-f706af05-8094-4905-889c-fa8482e6f89d None None] MFA Rules not processed for user `6e66ef13ab7f4fc99966752b351e845c`. Rule list: `[]` (Enabled: `True`). {{(pid=81525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 01:00:20.103592 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-f706af05-8094-4905-889c-fa8482e6f89d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:00:20.120816 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 01:00:20.177098 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1145/2257] 10.222.0.15 () {58 vars in 958 bytes} [Sun Oct 9 01:00:20 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 09 01:00:24.976643 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc0e4af-e526-4d2b-8dba-3c844c54c8d3 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:00:24.977166 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc0e4af-e526-4d2b-8dba-3c844c54c8d3 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:00:24.977166 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc0e4af-e526-4d2b-8dba-3c844c54c8d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:00:25.011147 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-ecc0e4af-e526-4d2b-8dba-3c844c54c8d3 None None] MFA Rules not processed for user `366b3ff4b8114d8dbd2d7ab9d8b962e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 01:00:25.012345 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-ecc0e4af-e526-4d2b-8dba-3c844c54c8d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:00:25.105662 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1113/2258] 10.222.0.15 () {58 vars in 958 bytes} [Sun Oct 9 01:00:24 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 01:00:25.119102 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f706af05-8094-4905-889c-fa8482e6f89d None None] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:00:25.120571 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-f706af05-8094-4905-889c-fa8482e6f89d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:00:25.204282 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f706af05-8094-4905-889c-fa8482e6f89d None None] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:00:25.208658 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6825464e-579b-45d2-81b6-a0270d675205 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd88a9f3d154c4cf98369972a0561b2b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f148d39ced534860abfbe8fc3f98ace4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:00:25.209446 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6825464e-579b-45d2-81b6-a0270d675205 service glance] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:00:25.209790 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6825464e-579b-45d2-81b6-a0270d675205 service glance] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:00:25.210130 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6825464e-579b-45d2-81b6-a0270d675205 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:00:25.285308 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6825464e-579b-45d2-81b6-a0270d675205 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:00:25.287466 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6825464e-579b-45d2-81b6-a0270d675205 service glance] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:00:25.302747 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1146/2259] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Oct 9 01:00:25 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 09 01:00:25.500439 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d1b104-c3af-457c-9e91-35b0ffebb1f0 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:00:25.500714 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d1b104-c3af-457c-9e91-35b0ffebb1f0 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:00:25.500984 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d1b104-c3af-457c-9e91-35b0ffebb1f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:00:25.525161 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-24d1b104-c3af-457c-9e91-35b0ffebb1f0 None None] MFA Rules not processed for user `3a6cfef106c84f759ce0874be77f7380`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 01:00:25.526422 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-24d1b104-c3af-457c-9e91-35b0ffebb1f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:00:25.621640 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1114/2260] 10.222.0.15 () {58 vars in 1009 bytes} [Sun Oct 9 01:00:25 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 01:00:25.794156 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6825464e-579b-45d2-81b6-a0270d675205 service glance] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:00:25.795963 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-6825464e-579b-45d2-81b6-a0270d675205 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:00:25.884847 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6825464e-579b-45d2-81b6-a0270d675205 service glance] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:00:25.890204 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd07fc0-b8b0-4a7c-8cda-68e239bbc035 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4c467943b8f4d31a2f067ca6ed3b25c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f148d39ced534860abfbe8fc3f98ace4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:00:25.890829 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd07fc0-b8b0-4a7c-8cda-68e239bbc035 service swift] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:00:25.891100 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd07fc0-b8b0-4a7c-8cda-68e239bbc035 service swift] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:00:25.891402 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd07fc0-b8b0-4a7c-8cda-68e239bbc035 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:00:25.901130 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd07fc0-b8b0-4a7c-8cda-68e239bbc035 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:00:25.902751 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd07fc0-b8b0-4a7c-8cda-68e239bbc035 service swift] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:00:25.911847 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1147/2261] 10.222.0.15 () {60 vars in 1384 bytes} [Sun Oct 9 01:00:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 09 01:00:35.219643 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfeee42-ac09-4777-88c8-4ec97276f920 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:00:35.220559 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfeee42-ac09-4777-88c8-4ec97276f920 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:00:35.221051 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfeee42-ac09-4777-88c8-4ec97276f920 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:00:35.253349 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-dbfeee42-ac09-4777-88c8-4ec97276f920 None None] MFA Rules not processed for user `751dff59acee4f188dd1edbfff46713c`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 01:00:35.255477 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-dbfeee42-ac09-4777-88c8-4ec97276f920 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:00:35.267335 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1115/2262] 10.222.0.15 () {58 vars in 958 bytes} [Sun Oct 9 01:00:35 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 09 01:00:35.908156 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=97 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 01:00:38.433511 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77c2dc8-a383-4974-b5c4-afb1d9fc84b1 None None] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:00:38.434126 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77c2dc8-a383-4974-b5c4-afb1d9fc84b1 None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:00:38.434126 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77c2dc8-a383-4974-b5c4-afb1d9fc84b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:00:38.456091 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.auth.core [None req-b77c2dc8-a383-4974-b5c4-afb1d9fc84b1 None None] MFA Rules not processed for user `3a6cfef106c84f759ce0874be77f7380`. Rule list: `[]` (Enabled: `True`). {{(pid=81525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 01:00:38.457457 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-b77c2dc8-a383-4974-b5c4-afb1d9fc84b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:00:38.466186 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1148/2263] 10.222.0.15 () {58 vars in 1009 bytes} [Sun Oct 9 01:00:38 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 01:00:38.478941 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfeee42-ac09-4777-88c8-4ec97276f920 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:00:38.491653 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfeee42-ac09-4777-88c8-4ec97276f920 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:00:38.497257 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adb8155-bb1f-4c2b-b68b-79b65fd321fa service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4c467943b8f4d31a2f067ca6ed3b25c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f148d39ced534860abfbe8fc3f98ace4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:00:38.497878 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adb8155-bb1f-4c2b-b68b-79b65fd321fa service swift] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:00:38.498150 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adb8155-bb1f-4c2b-b68b-79b65fd321fa service swift] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:00:38.498416 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adb8155-bb1f-4c2b-b68b-79b65fd321fa service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:00:38.507378 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8adb8155-bb1f-4c2b-b68b-79b65fd321fa service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:00:38.509010 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8adb8155-bb1f-4c2b-b68b-79b65fd321fa service swift] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:00:38.517806 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1116/2264] 10.222.0.15 () {60 vars in 1384 bytes} [Sun Oct 9 01:00:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 09 01:00:48.449535 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=3 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 01:00:48.514297 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=84,keystone:INSERT=2 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 01:00:56.713851 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2fc0d1-73ed-4a09-8bed-bf452dbecaf6 None None] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:00:56.714450 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2fc0d1-73ed-4a09-8bed-bf452dbecaf6 None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:00:56.714450 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2fc0d1-73ed-4a09-8bed-bf452dbecaf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:00:56.735898 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.auth.core [None req-bf2fc0d1-73ed-4a09-8bed-bf452dbecaf6 None None] MFA Rules not processed for user `c4df6b9e42314edcbee1710279d0aa5a`. Rule list: `[]` (Enabled: `True`). {{(pid=81525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 01:00:56.737143 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-bf2fc0d1-73ed-4a09-8bed-bf452dbecaf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:00:56.796985 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1149/2265] 10.222.0.15 () {58 vars in 958 bytes} [Sun Oct 9 01:00:56 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 01:01:06.789365 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=25 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 01:01:11.184016 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adb8155-bb1f-4c2b-b68b-79b65fd321fa service swift] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:01:11.186357 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-8adb8155-bb1f-4c2b-b68b-79b65fd321fa service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:01:11.254863 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adb8155-bb1f-4c2b-b68b-79b65fd321fa service swift] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:01:11.258622 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16315601-d95e-4489-a9bf-b485d335ed8f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff7cb78bcd91467abe5c2e2b48aedd1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f148d39ced534860abfbe8fc3f98ace4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:01:11.259233 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16315601-d95e-4489-a9bf-b485d335ed8f service cinder] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:01:11.259574 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16315601-d95e-4489-a9bf-b485d335ed8f service cinder] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:01:11.259845 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16315601-d95e-4489-a9bf-b485d335ed8f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:01:11.261621 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-16315601-d95e-4489-a9bf-b485d335ed8f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:01:11.321662 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16315601-d95e-4489-a9bf-b485d335ed8f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:01:11.323103 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16315601-d95e-4489-a9bf-b485d335ed8f service cinder] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:01:11.332876 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1117/2266] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Oct 9 01:01:11 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 09 01:01:11.952531 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2fc0d1-73ed-4a09-8bed-bf452dbecaf6 None None] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:01:11.954380 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-bf2fc0d1-73ed-4a09-8bed-bf452dbecaf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:01:12.061151 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2fc0d1-73ed-4a09-8bed-bf452dbecaf6 None None] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:01:12.071231 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a864af7-d510-4c7f-bd79-327039024c77 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4ef90d456d2483e8ddafbe2d4d4fb5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f148d39ced534860abfbe8fc3f98ace4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:01:12.072299 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a864af7-d510-4c7f-bd79-327039024c77 service neutron] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:01:12.072929 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a864af7-d510-4c7f-bd79-327039024c77 service neutron] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:01:12.073404 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a864af7-d510-4c7f-bd79-327039024c77 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:01:12.078203 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-9a864af7-d510-4c7f-bd79-327039024c77 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:01:12.252855 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a864af7-d510-4c7f-bd79-327039024c77 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:01:12.255834 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a864af7-d510-4c7f-bd79-327039024c77 service neutron] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:01:12.275654 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1150/2267] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Oct 9 01:01:11 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 09 01:01:12.492565 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16315601-d95e-4489-a9bf-b485d335ed8f service cinder] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:01:12.510450 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16315601-d95e-4489-a9bf-b485d335ed8f service cinder] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:01:12.520495 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2091dc-3788-4b2d-9e42-ba5cc07de391 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4ef90d456d2483e8ddafbe2d4d4fb5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f148d39ced534860abfbe8fc3f98ace4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:01:12.522712 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2091dc-3788-4b2d-9e42-ba5cc07de391 service neutron] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:01:12.523820 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2091dc-3788-4b2d-9e42-ba5cc07de391 service neutron] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:01:12.524573 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2091dc-3788-4b2d-9e42-ba5cc07de391 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:01:12.554014 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2091dc-3788-4b2d-9e42-ba5cc07de391 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:01:12.557115 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2091dc-3788-4b2d-9e42-ba5cc07de391 service neutron] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:01:12.586190 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1118/2268] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Oct 9 01:01:12 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 09 01:01:16.984271 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a864af7-d510-4c7f-bd79-327039024c77 service neutron] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:01:16.998012 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a864af7-d510-4c7f-bd79-327039024c77 service neutron] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:01:17.004270 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28886c76-1dc7-484e-b6f9-8ce7881bd539 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4ef90d456d2483e8ddafbe2d4d4fb5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f148d39ced534860abfbe8fc3f98ace4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:01:17.005683 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28886c76-1dc7-484e-b6f9-8ce7881bd539 service neutron] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:01:17.006219 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28886c76-1dc7-484e-b6f9-8ce7881bd539 service neutron] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:01:17.006672 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28886c76-1dc7-484e-b6f9-8ce7881bd539 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:01:17.009357 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-28886c76-1dc7-484e-b6f9-8ce7881bd539 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:01:17.023985 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28886c76-1dc7-484e-b6f9-8ce7881bd539 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:01:17.025455 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28886c76-1dc7-484e-b6f9-8ce7881bd539 service neutron] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:01:17.045176 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1151/2269] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Oct 9 01:01:16 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 09 01:01:19.949746 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2091dc-3788-4b2d-9e42-ba5cc07de391 service neutron] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:01:19.959187 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2091dc-3788-4b2d-9e42-ba5cc07de391 service neutron] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:01:19.963092 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6071cc11-11c0-493a-a394-bf4837dd1ad9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4ef90d456d2483e8ddafbe2d4d4fb5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f148d39ced534860abfbe8fc3f98ace4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:01:19.963750 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6071cc11-11c0-493a-a394-bf4837dd1ad9 service neutron] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:01:19.964023 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6071cc11-11c0-493a-a394-bf4837dd1ad9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:01:19.964294 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6071cc11-11c0-493a-a394-bf4837dd1ad9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:01:19.966246 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-6071cc11-11c0-493a-a394-bf4837dd1ad9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:01:20.036506 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6071cc11-11c0-493a-a394-bf4837dd1ad9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:01:20.038157 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6071cc11-11c0-493a-a394-bf4837dd1ad9 service neutron] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:01:20.048482 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1119/2270] 10.222.0.15 () {60 vars in 1396 bytes} [Sun Oct 9 01:01:19 2022] GET /identity/v3/auth/tokens?allow_expired=1 => generated 3270 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 09 01:01:20.576993 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28886c76-1dc7-484e-b6f9-8ce7881bd539 service neutron] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:01:20.580326 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-28886c76-1dc7-484e-b6f9-8ce7881bd539 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:01:20.598853 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28886c76-1dc7-484e-b6f9-8ce7881bd539 service neutron] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:01:20.605410 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7f685c-b149-4323-9339-0db63bc82714 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ac83d57fba841e0a666710732249c49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f148d39ced534860abfbe8fc3f98ace4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:01:20.606117 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7f685c-b149-4323-9339-0db63bc82714 service nova] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:01:20.606321 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7f685c-b149-4323-9339-0db63bc82714 service nova] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:01:20.606579 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7f685c-b149-4323-9339-0db63bc82714 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:01:20.609064 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-3d7f685c-b149-4323-9339-0db63bc82714 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:01:20.622959 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7f685c-b149-4323-9339-0db63bc82714 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:01:20.625077 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7f685c-b149-4323-9339-0db63bc82714 service nova] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:01:20.637411 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1152/2271] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Oct 9 01:01:20 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 09 01:01:23.834166 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6071cc11-11c0-493a-a394-bf4837dd1ad9 service neutron] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:01:23.844334 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6071cc11-11c0-493a-a394-bf4837dd1ad9 service neutron] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:01:23.849105 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5d32a1-0ce1-493c-8f7c-3fc58660b6aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4ef90d456d2483e8ddafbe2d4d4fb5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f148d39ced534860abfbe8fc3f98ace4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:01:23.849741 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5d32a1-0ce1-493c-8f7c-3fc58660b6aa service neutron] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:01:23.850271 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5d32a1-0ce1-493c-8f7c-3fc58660b6aa service neutron] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:01:23.850719 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5d32a1-0ce1-493c-8f7c-3fc58660b6aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:01:23.852955 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-bc5d32a1-0ce1-493c-8f7c-3fc58660b6aa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:01:23.906619 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 01:01:23.947444 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5d32a1-0ce1-493c-8f7c-3fc58660b6aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:01:23.949910 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5d32a1-0ce1-493c-8f7c-3fc58660b6aa service neutron] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:01:23.970984 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1120/2272] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Oct 9 01:01:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 09 01:01:27.546666 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea715895-e9da-453f-8c7f-5b3615747367 None None] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:01:27.548273 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea715895-e9da-453f-8c7f-5b3615747367 None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:01:27.548930 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea715895-e9da-453f-8c7f-5b3615747367 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:01:27.587342 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.auth.core [None req-ea715895-e9da-453f-8c7f-5b3615747367 None None] MFA Rules not processed for user `6a2d7675a1fe4301b2920c86a35312dd`. Rule list: `[]` (Enabled: `True`). {{(pid=81525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 01:01:27.588848 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-ea715895-e9da-453f-8c7f-5b3615747367 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:01:27.605908 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1153/2273] 10.222.0.15 () {58 vars in 958 bytes} [Sun Oct 9 01:01:27 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 01:01:28.072187 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5d32a1-0ce1-493c-8f7c-3fc58660b6aa service neutron] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:01:28.083066 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5d32a1-0ce1-493c-8f7c-3fc58660b6aa service neutron] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:01:28.088410 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1283df84-655f-43bc-a91a-1cf38c876087 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4ef90d456d2483e8ddafbe2d4d4fb5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f148d39ced534860abfbe8fc3f98ace4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:01:28.089747 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1283df84-655f-43bc-a91a-1cf38c876087 service neutron] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:01:28.090134 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1283df84-655f-43bc-a91a-1cf38c876087 service neutron] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:01:28.090497 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1283df84-655f-43bc-a91a-1cf38c876087 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:01:28.092931 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-1283df84-655f-43bc-a91a-1cf38c876087 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:01:28.105687 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1283df84-655f-43bc-a91a-1cf38c876087 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:01:28.108137 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1283df84-655f-43bc-a91a-1cf38c876087 service neutron] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:01:28.124304 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1121/2274] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Oct 9 01:01:28 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 09 01:01:29.171475 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea715895-e9da-453f-8c7f-5b3615747367 None None] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:01:29.173532 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-ea715895-e9da-453f-8c7f-5b3615747367 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:01:29.344185 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea715895-e9da-453f-8c7f-5b3615747367 None None] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:01:29.352948 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fbfeac-bf25-4d4f-bc7b-e2c8b7b48f84 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64be9d44437e4247a72334b9bab3cdd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f148d39ced534860abfbe8fc3f98ace4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:01:29.354242 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fbfeac-bf25-4d4f-bc7b-e2c8b7b48f84 service placement] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:01:29.354731 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fbfeac-bf25-4d4f-bc7b-e2c8b7b48f84 service placement] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:01:29.355006 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fbfeac-bf25-4d4f-bc7b-e2c8b7b48f84 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:01:29.360256 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-10fbfeac-bf25-4d4f-bc7b-e2c8b7b48f84 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:01:29.380383 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fbfeac-bf25-4d4f-bc7b-e2c8b7b48f84 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:01:29.382142 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fbfeac-bf25-4d4f-bc7b-e2c8b7b48f84 service placement] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:01:29.387550 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 01:01:29.393437 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1283df84-655f-43bc-a91a-1cf38c876087 service neutron] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:01:29.396038 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-1283df84-655f-43bc-a91a-1cf38c876087 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:01:29.397644 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1154/2275] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Oct 9 01:01:29 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 09 01:01:29.415110 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1283df84-655f-43bc-a91a-1cf38c876087 service neutron] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:01:29.433654 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d3f9e3-fffd-4deb-9f22-a4b8312a4241 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:01:29.434819 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d3f9e3-fffd-4deb-9f22-a4b8312a4241 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:01:29.440251 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d3f9e3-fffd-4deb-9f22-a4b8312a4241 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:01:29.440251 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d3f9e3-fffd-4deb-9f22-a4b8312a4241 admin admin] PATH_INFO: `/v3/users/5eaab5e4f7f14847b5c2ca8eb490d21c` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:01:29.441843 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d3f9e3-fffd-4deb-9f22-a4b8312a4241 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5eaab5e4f7f14847b5c2ca8eb490d21c)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:01:29.446147 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d3f9e3-fffd-4deb-9f22-a4b8312a4241 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:01:29.510702 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-32d3f9e3-fffd-4deb-9f22-a4b8312a4241 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5eaab5e4f7f14847b5c2ca8eb490d21c'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:01:29.521949 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-32d3f9e3-fffd-4deb-9f22-a4b8312a4241 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5eaab5e4f7f14847b5c2ca8eb490d21c'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:01:29.522816 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-32d3f9e3-fffd-4deb-9f22-a4b8312a4241 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5eaab5e4f7f14847b5c2ca8eb490d21c'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:01:29.523561 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-32d3f9e3-fffd-4deb-9f22-a4b8312a4241 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5eaab5e4f7f14847b5c2ca8eb490d21c'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:01:29.536112 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-32d3f9e3-fffd-4deb-9f22-a4b8312a4241 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5eaab5e4f7f14847b5c2ca8eb490d21c'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:01:29.567513 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1122/2276] 10.222.0.15 () {58 vars in 1224 bytes} [Sun Oct 9 01:01:29 2022] DELETE /identity/v3/users/5eaab5e4f7f14847b5c2ca8eb490d21c => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 01:01:29.805717 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fbfeac-bf25-4d4f-bc7b-e2c8b7b48f84 service placement] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:01:29.818673 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fbfeac-bf25-4d4f-bc7b-e2c8b7b48f84 service placement] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:01:29.892219 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc33137e-9ee1-427c-9d42-2373a43aca12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:01:29.893056 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc33137e-9ee1-427c-9d42-2373a43aca12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:01:29.893427 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc33137e-9ee1-427c-9d42-2373a43aca12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:01:29.894069 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc33137e-9ee1-427c-9d42-2373a43aca12 admin admin] PATH_INFO: `/v3/projects/62258785aeb54f10a4d57cc9642d6186` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:01:29.895788 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc33137e-9ee1-427c-9d42-2373a43aca12 admin admin] RBAC: Authorizing `identity:delete_project(project_id=62258785aeb54f10a4d57cc9642d6186)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:01:29.898274 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc33137e-9ee1-427c-9d42-2373a43aca12 admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:01:29.955062 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-fc33137e-9ee1-427c-9d42-2373a43aca12 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '62258785aeb54f10a4d57cc9642d6186', 'request_id': 'req-fc33137e-9ee1-427c-9d42-2373a43aca12'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:01:29.966867 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-fc33137e-9ee1-427c-9d42-2373a43aca12 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '62258785aeb54f10a4d57cc9642d6186', 'request_id': 'req-fc33137e-9ee1-427c-9d42-2373a43aca12'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:01:29.974926 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-fc33137e-9ee1-427c-9d42-2373a43aca12 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '62258785aeb54f10a4d57cc9642d6186', 'request_id': 'req-fc33137e-9ee1-427c-9d42-2373a43aca12'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:01:29.987623 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-fc33137e-9ee1-427c-9d42-2373a43aca12 admin admin] The token cache is being invalidate because project 62258785aeb54f10a4d57cc9642d6186 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81525) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 09 01:01:29.987944 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-fc33137e-9ee1-427c-9d42-2373a43aca12 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:01:29.988594 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-fc33137e-9ee1-427c-9d42-2373a43aca12 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:01:29.990483 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1155/2277] 10.222.0.15 () {58 vars in 1233 bytes} [Sun Oct 9 01:01:29 2022] DELETE /identity/v3/projects/62258785aeb54f10a4d57cc9642d6186 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 09 01:01:30.001780 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1318e365-3529-4836-af85-6e087f9d1931 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:01:30.002175 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1318e365-3529-4836-af85-6e087f9d1931 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:01:30.002366 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1318e365-3529-4836-af85-6e087f9d1931 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:01:30.027646 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-1318e365-3529-4836-af85-6e087f9d1931 None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 01:01:30.028974 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-1318e365-3529-4836-af85-6e087f9d1931 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:01:30.117134 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1123/2278] 10.222.0.15 () {58 vars in 958 bytes} [Sun Oct 9 01:01:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 09 01:01:30.127012 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaa7255-7480-4877-ab08-442573b84ed4 None None] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:01:30.127650 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaa7255-7480-4877-ab08-442573b84ed4 None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:01:30.128142 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaa7255-7480-4877-ab08-442573b84ed4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:01:30.156585 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.auth.core [None req-bdaa7255-7480-4877-ab08-442573b84ed4 None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 01:01:30.158234 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-bdaa7255-7480-4877-ab08-442573b84ed4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:01:30.167283 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1156/2279] 10.222.0.15 () {58 vars in 958 bytes} [Sun Oct 9 01:01:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 01:01:30.172515 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1318e365-3529-4836-af85-6e087f9d1931 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:01:30.184379 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1318e365-3529-4836-af85-6e087f9d1931 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:01:30.189697 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff66553d-3f7e-483f-b20d-db0641146228 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:01:30.190651 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff66553d-3f7e-483f-b20d-db0641146228 admin admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:01:30.190933 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff66553d-3f7e-483f-b20d-db0641146228 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:01:30.191198 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff66553d-3f7e-483f-b20d-db0641146228 admin admin] PATH_INFO: `/v3/domains` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:01:30.192030 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff66553d-3f7e-483f-b20d-db0641146228 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 01:01:30.192345 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff66553d-3f7e-483f-b20d-db0641146228 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:01:30.194081 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff66553d-3f7e-483f-b20d-db0641146228 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:01:30.211316 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1124/2280] 10.222.0.15 () {58 vars in 1153 bytes} [Sun Oct 9 01:01:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 01:01:30.213643 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdaa7255-7480-4877-ab08-442573b84ed4 None None] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:01:30.226205 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdaa7255-7480-4877-ab08-442573b84ed4 None None] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:01:30.231919 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd9b268-1076-480c-bea0-88464127a475 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:01:30.233410 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd9b268-1076-480c-bea0-88464127a475 admin admin] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:01:30.234114 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd9b268-1076-480c-bea0-88464127a475 admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:01:30.234777 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd9b268-1076-480c-bea0-88464127a475 admin admin] PATH_INFO: `/v3/projects` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:01:30.235850 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd9b268-1076-480c-bea0-88464127a475 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:01:30.239104 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd9b268-1076-480c-bea0-88464127a475 admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:01:30.289864 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1157/2281] 10.222.0.15 () {60 vars in 1153 bytes} [Sun Oct 9 01:01:30 2022] POST /identity/v3/projects => generated 405 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 09 01:01:30.291231 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff66553d-3f7e-483f-b20d-db0641146228 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:01:30.318142 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff66553d-3f7e-483f-b20d-db0641146228 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:01:30.348887 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 01:01:30.411231 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c9e8aa-bb7f-4000-a8d8-85f757396664 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:01:30.413682 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c9e8aa-bb7f-4000-a8d8-85f757396664 admin admin] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:01:30.414485 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c9e8aa-bb7f-4000-a8d8-85f757396664 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:01:30.415149 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c9e8aa-bb7f-4000-a8d8-85f757396664 admin admin] PATH_INFO: `/v3/users` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:01:30.416443 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c9e8aa-bb7f-4000-a8d8-85f757396664 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:01:30.420693 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c9e8aa-bb7f-4000-a8d8-85f757396664 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:01:30.470617 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1125/2282] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Oct 9 01:01:30 2022] POST /identity/v3/users => generated 303 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 09 01:01:30.478137 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd9b268-1076-480c-bea0-88464127a475 admin admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:01:30.494686 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd9b268-1076-480c-bea0-88464127a475 admin admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:01:30.503680 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cbdef6-875d-418e-92df-9f756f4c1ef9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:01:30.505079 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cbdef6-875d-418e-92df-9f756f4c1ef9 admin admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:01:30.505812 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cbdef6-875d-418e-92df-9f756f4c1ef9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:01:30.506339 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cbdef6-875d-418e-92df-9f756f4c1ef9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:01:30.507666 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cbdef6-875d-418e-92df-9f756f4c1ef9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:01:30.510671 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cbdef6-875d-418e-92df-9f756f4c1ef9 admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:01:30.532098 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1158/2283] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Oct 9 01:01:30 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 09 01:01:30.538153 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c9e8aa-bb7f-4000-a8d8-85f757396664 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:01:30.550377 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c9e8aa-bb7f-4000-a8d8-85f757396664 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:01:30.558183 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75d8e28-2b63-4012-aca2-c4256baeed11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:01:30.559302 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75d8e28-2b63-4012-aca2-c4256baeed11 admin admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:01:30.559678 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75d8e28-2b63-4012-aca2-c4256baeed11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:01:30.560035 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75d8e28-2b63-4012-aca2-c4256baeed11 admin admin] PATH_INFO: `/v3/roles` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:01:30.561040 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75d8e28-2b63-4012-aca2-c4256baeed11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:01:30.563026 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75d8e28-2b63-4012-aca2-c4256baeed11 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:01:30.575768 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1126/2284] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Oct 9 01:01:30 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 09 01:01:30.581957 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cbdef6-875d-418e-92df-9f756f4c1ef9 admin admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:01:30.600547 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cbdef6-875d-418e-92df-9f756f4c1ef9 admin admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:01:30.609320 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a79263-6f8b-4eff-b7e9-c4a9d0e58555 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:01:30.610353 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a79263-6f8b-4eff-b7e9-c4a9d0e58555 admin admin] REQUEST_METHOD: `PUT` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:01:30.610634 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a79263-6f8b-4eff-b7e9-c4a9d0e58555 admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:01:30.610912 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a79263-6f8b-4eff-b7e9-c4a9d0e58555 admin admin] PATH_INFO: `/v3/projects/c9a0ea7a026d430a88c0db41d5133299/users/6bbcda98563348e7af7a08362ac3b88a/roles/afb0a01183d9497795eaa4fa1a4046ae` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:01:30.629714 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a79263-6f8b-4eff-b7e9-c4a9d0e58555 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9a0ea7a026d430a88c0db41d5133299, user_id=6bbcda98563348e7af7a08362ac3b88a, role_id=afb0a01183d9497795eaa4fa1a4046ae)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:01:30.632927 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a79263-6f8b-4eff-b7e9-c4a9d0e58555 admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:01:30.650763 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1159/2285] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Oct 9 01:01:30 2022] PUT /identity/v3/projects/c9a0ea7a026d430a88c0db41d5133299/users/6bbcda98563348e7af7a08362ac3b88a/roles/afb0a01183d9497795eaa4fa1a4046ae => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 01:01:30.669276 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f17ed9-ed14-4b9a-8702-bb0dd7a3b2d1 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:01:30.669636 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f17ed9-ed14-4b9a-8702-bb0dd7a3b2d1 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:01:30.670089 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f17ed9-ed14-4b9a-8702-bb0dd7a3b2d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:01:30.710550 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-e7f17ed9-ed14-4b9a-8702-bb0dd7a3b2d1 None None] MFA Rules not processed for user `6bbcda98563348e7af7a08362ac3b88a`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 01:01:30.712064 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-e7f17ed9-ed14-4b9a-8702-bb0dd7a3b2d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:01:30.788427 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1127/2286] 10.222.0.15 () {58 vars in 958 bytes} [Sun Oct 9 01:01:30 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 09 01:01:30.793683 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a79263-6f8b-4eff-b7e9-c4a9d0e58555 admin admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:01:30.826047 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 01:01:30.875621 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a79263-6f8b-4eff-b7e9-c4a9d0e58555 admin admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:01:30.880578 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d92ab81-fee7-446f-a833-abbbc8f621bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:01:30.881218 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d92ab81-fee7-446f-a833-abbbc8f621bd admin admin] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:01:30.881481 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d92ab81-fee7-446f-a833-abbbc8f621bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:01:30.881750 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d92ab81-fee7-446f-a833-abbbc8f621bd admin admin] PATH_INFO: `/v3/projects` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:01:30.882409 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d92ab81-fee7-446f-a833-abbbc8f621bd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:01:30.884393 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d92ab81-fee7-446f-a833-abbbc8f621bd admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:01:30.918402 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1160/2287] 10.222.0.15 () {60 vars in 1153 bytes} [Sun Oct 9 01:01:30 2022] POST /identity/v3/projects => generated 405 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 09 01:01:30.922729 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f17ed9-ed14-4b9a-8702-bb0dd7a3b2d1 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:01:30.935512 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f17ed9-ed14-4b9a-8702-bb0dd7a3b2d1 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:01:31.031722 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75ac877-aa67-40c1-a2ba-311d9266db8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:01:31.032761 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75ac877-aa67-40c1-a2ba-311d9266db8d admin admin] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:01:31.033252 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75ac877-aa67-40c1-a2ba-311d9266db8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:01:31.033829 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75ac877-aa67-40c1-a2ba-311d9266db8d admin admin] PATH_INFO: `/v3/users` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:01:31.034879 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75ac877-aa67-40c1-a2ba-311d9266db8d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:01:31.038405 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75ac877-aa67-40c1-a2ba-311d9266db8d admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:01:31.082485 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1128/2288] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Oct 9 01:01:30 2022] POST /identity/v3/users => generated 309 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 09 01:01:31.084636 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d92ab81-fee7-446f-a833-abbbc8f621bd admin admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:01:31.105255 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d92ab81-fee7-446f-a833-abbbc8f621bd admin admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:01:31.114125 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b76c44-bba3-4ed6-8ec5-c090b5f050cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:01:31.114985 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b76c44-bba3-4ed6-8ec5-c090b5f050cc admin admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:01:31.115477 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b76c44-bba3-4ed6-8ec5-c090b5f050cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:01:31.115949 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b76c44-bba3-4ed6-8ec5-c090b5f050cc admin admin] PATH_INFO: `/v3/roles` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:01:31.117104 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b76c44-bba3-4ed6-8ec5-c090b5f050cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:01:31.120484 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b76c44-bba3-4ed6-8ec5-c090b5f050cc admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:01:31.141182 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1161/2289] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Oct 9 01:01:31 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 09 01:01:31.147524 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75ac877-aa67-40c1-a2ba-311d9266db8d admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:01:31.166426 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75ac877-aa67-40c1-a2ba-311d9266db8d admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:01:31.175249 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47b28ce-ef35-43bb-b2cb-aec860217d6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:01:31.176314 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47b28ce-ef35-43bb-b2cb-aec860217d6f admin admin] REQUEST_METHOD: `PUT` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:01:31.177169 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47b28ce-ef35-43bb-b2cb-aec860217d6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:01:31.177641 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47b28ce-ef35-43bb-b2cb-aec860217d6f admin admin] PATH_INFO: `/v3/projects/d7e382186b12428a880d4b1abd70d29b/users/bcd567d50afb40799b96c803ead0ec3b/roles/f69dddf26daf4dd79d4c962beb877af5` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:01:31.201880 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47b28ce-ef35-43bb-b2cb-aec860217d6f admin admin] RBAC: Authorizing `identity:create_grant(project_id=d7e382186b12428a880d4b1abd70d29b, user_id=bcd567d50afb40799b96c803ead0ec3b, role_id=f69dddf26daf4dd79d4c962beb877af5)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:01:31.205162 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47b28ce-ef35-43bb-b2cb-aec860217d6f admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:01:31.208155 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 01:01:31.225975 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1129/2290] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Oct 9 01:01:31 2022] PUT /identity/v3/projects/d7e382186b12428a880d4b1abd70d29b/users/bcd567d50afb40799b96c803ead0ec3b/roles/f69dddf26daf4dd79d4c962beb877af5 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 01:01:31.231640 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b76c44-bba3-4ed6-8ec5-c090b5f050cc admin admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:01:31.252375 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b76c44-bba3-4ed6-8ec5-c090b5f050cc admin admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:01:31.336389 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36b8eb3-e459-4a1c-95a6-f5456132131a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:01:31.337045 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36b8eb3-e459-4a1c-95a6-f5456132131a admin admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:01:31.337316 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36b8eb3-e459-4a1c-95a6-f5456132131a admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:01:31.337580 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36b8eb3-e459-4a1c-95a6-f5456132131a admin admin] PATH_INFO: `/v3/roles` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:01:31.338230 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36b8eb3-e459-4a1c-95a6-f5456132131a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:01:31.339920 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36b8eb3-e459-4a1c-95a6-f5456132131a admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:01:31.351913 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1162/2291] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Oct 9 01:01:31 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 09 01:01:31.356876 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47b28ce-ef35-43bb-b2cb-aec860217d6f admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:01:31.368234 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47b28ce-ef35-43bb-b2cb-aec860217d6f admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:01:31.373334 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5520d908-1b47-46a2-a9f0-0731be5dbbd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:01:31.374238 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5520d908-1b47-46a2-a9f0-0731be5dbbd4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:01:31.374597 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5520d908-1b47-46a2-a9f0-0731be5dbbd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:01:31.374967 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5520d908-1b47-46a2-a9f0-0731be5dbbd4 admin admin] PATH_INFO: `/v3/projects/d7e382186b12428a880d4b1abd70d29b/users/bcd567d50afb40799b96c803ead0ec3b/roles/f69dddf26daf4dd79d4c962beb877af5` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:01:31.377396 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5520d908-1b47-46a2-a9f0-0731be5dbbd4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d7e382186b12428a880d4b1abd70d29b, user_id=bcd567d50afb40799b96c803ead0ec3b, role_id=f69dddf26daf4dd79d4c962beb877af5)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:01:31.380670 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5520d908-1b47-46a2-a9f0-0731be5dbbd4 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:01:31.393327 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1130/2292] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Oct 9 01:01:31 2022] PUT /identity/v3/projects/d7e382186b12428a880d4b1abd70d29b/users/bcd567d50afb40799b96c803ead0ec3b/roles/f69dddf26daf4dd79d4c962beb877af5 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 01:01:31.407133 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be919f35-c36b-48e5-a32a-f3c7f7d06fd6 None None] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:01:31.407627 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be919f35-c36b-48e5-a32a-f3c7f7d06fd6 None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:01:31.408087 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be919f35-c36b-48e5-a32a-f3c7f7d06fd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:01:31.464955 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.auth.core [None req-be919f35-c36b-48e5-a32a-f3c7f7d06fd6 None None] MFA Rules not processed for user `bcd567d50afb40799b96c803ead0ec3b`. Rule list: `[]` (Enabled: `True`). {{(pid=81525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 01:01:31.466670 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-be919f35-c36b-48e5-a32a-f3c7f7d06fd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:01:31.628539 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1163/2293] 10.222.0.15 () {58 vars in 958 bytes} [Sun Oct 9 01:01:31 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 01:01:31.657412 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5520d908-1b47-46a2-a9f0-0731be5dbbd4 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:01:31.659745 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-5520d908-1b47-46a2-a9f0-0731be5dbbd4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:01:31.787241 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5520d908-1b47-46a2-a9f0-0731be5dbbd4 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:01:31.795075 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e20e233-43ba-4bb7-ae6b-eb34da79b0ba service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff7cb78bcd91467abe5c2e2b48aedd1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f148d39ced534860abfbe8fc3f98ace4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:01:31.796195 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e20e233-43ba-4bb7-ae6b-eb34da79b0ba service cinder] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:01:31.796687 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e20e233-43ba-4bb7-ae6b-eb34da79b0ba service cinder] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:01:31.797175 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e20e233-43ba-4bb7-ae6b-eb34da79b0ba service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:01:31.813884 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e20e233-43ba-4bb7-ae6b-eb34da79b0ba service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:01:31.815503 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e20e233-43ba-4bb7-ae6b-eb34da79b0ba service cinder] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:01:31.826676 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1131/2294] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Oct 9 01:01:31 2022] GET /identity/v3/auth/tokens => generated 3349 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 09 01:01:32.027599 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be919f35-c36b-48e5-a32a-f3c7f7d06fd6 None None] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:01:32.058839 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 01:01:32.114146 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be919f35-c36b-48e5-a32a-f3c7f7d06fd6 None None] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:01:32.120065 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809f5ed5-ccb3-4510-865a-ccb41d135e2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:01:32.120731 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809f5ed5-ccb3-4510-865a-ccb41d135e2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:01:32.121000 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809f5ed5-ccb3-4510-865a-ccb41d135e2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:01:32.121267 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809f5ed5-ccb3-4510-865a-ccb41d135e2d admin admin] PATH_INFO: `/v3/users/6bbcda98563348e7af7a08362ac3b88a` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:01:32.122503 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809f5ed5-ccb3-4510-865a-ccb41d135e2d admin admin] RBAC: Authorizing `identity:delete_user(user_id=6bbcda98563348e7af7a08362ac3b88a)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:01:32.124670 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809f5ed5-ccb3-4510-865a-ccb41d135e2d admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:01:32.201258 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-809f5ed5-ccb3-4510-865a-ccb41d135e2d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6bbcda98563348e7af7a08362ac3b88a'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:01:32.218619 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-809f5ed5-ccb3-4510-865a-ccb41d135e2d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6bbcda98563348e7af7a08362ac3b88a'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:01:32.220040 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-809f5ed5-ccb3-4510-865a-ccb41d135e2d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6bbcda98563348e7af7a08362ac3b88a'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:01:32.221389 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-809f5ed5-ccb3-4510-865a-ccb41d135e2d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6bbcda98563348e7af7a08362ac3b88a'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:01:32.239238 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-809f5ed5-ccb3-4510-865a-ccb41d135e2d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6bbcda98563348e7af7a08362ac3b88a'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:01:32.286543 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1164/2295] 10.222.0.15 () {58 vars in 1224 bytes} [Sun Oct 9 01:01:32 2022] DELETE /identity/v3/users/6bbcda98563348e7af7a08362ac3b88a => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 01:01:32.288958 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175fe7a5-3db1-493f-b963-aab751b4f613 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:01:32.289237 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175fe7a5-3db1-493f-b963-aab751b4f613 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:01:32.289515 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175fe7a5-3db1-493f-b963-aab751b4f613 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:01:32.314927 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-175fe7a5-3db1-493f-b963-aab751b4f613 None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 01:01:32.316267 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-175fe7a5-3db1-493f-b963-aab751b4f613 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:01:32.331720 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809f5ed5-ccb3-4510-865a-ccb41d135e2d admin admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:01:32.334630 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-809f5ed5-ccb3-4510-865a-ccb41d135e2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:01:32.402724 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1132/2296] 10.222.0.15 () {58 vars in 958 bytes} [Sun Oct 9 01:01:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 09 01:01:32.410765 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175fe7a5-3db1-493f-b963-aab751b4f613 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:01:32.413049 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-175fe7a5-3db1-493f-b963-aab751b4f613 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:01:32.464767 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809f5ed5-ccb3-4510-865a-ccb41d135e2d admin admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:01:32.473536 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38a76d6-f495-47ff-9016-159ad1e47dfd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4ef90d456d2483e8ddafbe2d4d4fb5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f148d39ced534860abfbe8fc3f98ace4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:01:32.474681 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38a76d6-f495-47ff-9016-159ad1e47dfd service neutron] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:01:32.475323 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38a76d6-f495-47ff-9016-159ad1e47dfd service neutron] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:01:32.475706 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38a76d6-f495-47ff-9016-159ad1e47dfd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:01:32.478837 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-d38a76d6-f495-47ff-9016-159ad1e47dfd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:01:32.500912 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38a76d6-f495-47ff-9016-159ad1e47dfd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:01:32.502915 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38a76d6-f495-47ff-9016-159ad1e47dfd service neutron] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:01:32.511056 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175fe7a5-3db1-493f-b963-aab751b4f613 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:01:32.516184 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1165/2297] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Oct 9 01:01:32 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 09 01:01:32.520001 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d1f92b-8a82-4319-98a4-1871f5b443e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4ef90d456d2483e8ddafbe2d4d4fb5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f148d39ced534860abfbe8fc3f98ace4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:01:32.520937 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d1f92b-8a82-4319-98a4-1871f5b443e7 service neutron] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:01:32.521301 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d1f92b-8a82-4319-98a4-1871f5b443e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:01:32.521750 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d1f92b-8a82-4319-98a4-1871f5b443e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:01:32.536958 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d1f92b-8a82-4319-98a4-1871f5b443e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:01:32.538454 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d1f92b-8a82-4319-98a4-1871f5b443e7 service neutron] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:01:32.551073 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1133/2298] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Oct 9 01:01:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 09 01:01:33.238855 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38a76d6-f495-47ff-9016-159ad1e47dfd service neutron] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:01:33.242107 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-d38a76d6-f495-47ff-9016-159ad1e47dfd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:01:33.265868 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38a76d6-f495-47ff-9016-159ad1e47dfd service neutron] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:01:33.285988 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0115e80-fad1-407e-bea5-2ea7728326a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:01:33.286635 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0115e80-fad1-407e-bea5-2ea7728326a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:01:33.287048 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0115e80-fad1-407e-bea5-2ea7728326a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:01:33.287445 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0115e80-fad1-407e-bea5-2ea7728326a3 admin admin] PATH_INFO: `/v3/projects/c9a0ea7a026d430a88c0db41d5133299` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:01:33.289591 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0115e80-fad1-407e-bea5-2ea7728326a3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c9a0ea7a026d430a88c0db41d5133299)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:01:33.291992 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0115e80-fad1-407e-bea5-2ea7728326a3 admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:01:33.352823 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 01:01:33.370796 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-d0115e80-fad1-407e-bea5-2ea7728326a3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c9a0ea7a026d430a88c0db41d5133299', 'request_id': 'req-d0115e80-fad1-407e-bea5-2ea7728326a3'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:01:33.385750 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-d0115e80-fad1-407e-bea5-2ea7728326a3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c9a0ea7a026d430a88c0db41d5133299', 'request_id': 'req-d0115e80-fad1-407e-bea5-2ea7728326a3'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:01:33.395694 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-d0115e80-fad1-407e-bea5-2ea7728326a3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c9a0ea7a026d430a88c0db41d5133299', 'request_id': 'req-d0115e80-fad1-407e-bea5-2ea7728326a3'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:01:33.412546 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-d0115e80-fad1-407e-bea5-2ea7728326a3 admin admin] The token cache is being invalidate because project c9a0ea7a026d430a88c0db41d5133299 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81525) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 09 01:01:33.413074 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-d0115e80-fad1-407e-bea5-2ea7728326a3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:01:33.414185 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-d0115e80-fad1-407e-bea5-2ea7728326a3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:01:33.416384 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1166/2299] 10.222.0.15 () {58 vars in 1233 bytes} [Sun Oct 9 01:01:33 2022] DELETE /identity/v3/projects/c9a0ea7a026d430a88c0db41d5133299 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 01:01:33.420804 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d1f92b-8a82-4319-98a4-1871f5b443e7 service neutron] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:01:33.431748 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d1f92b-8a82-4319-98a4-1871f5b443e7 service neutron] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:01:33.481330 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 01:01:33.525724 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7b4821-3001-423b-9da8-e7e157fbca1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:01:33.526381 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7b4821-3001-423b-9da8-e7e157fbca1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:01:33.526654 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7b4821-3001-423b-9da8-e7e157fbca1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:01:33.526926 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7b4821-3001-423b-9da8-e7e157fbca1d admin admin] PATH_INFO: `/v3/users/bcd567d50afb40799b96c803ead0ec3b` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:01:33.528187 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7b4821-3001-423b-9da8-e7e157fbca1d admin admin] RBAC: Authorizing `identity:delete_user(user_id=bcd567d50afb40799b96c803ead0ec3b)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:01:33.530199 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7b4821-3001-423b-9da8-e7e157fbca1d admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:01:33.613953 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-fe7b4821-3001-423b-9da8-e7e157fbca1d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bcd567d50afb40799b96c803ead0ec3b'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:01:33.626595 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-fe7b4821-3001-423b-9da8-e7e157fbca1d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bcd567d50afb40799b96c803ead0ec3b'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:01:33.627515 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-fe7b4821-3001-423b-9da8-e7e157fbca1d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bcd567d50afb40799b96c803ead0ec3b'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:01:33.628512 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-fe7b4821-3001-423b-9da8-e7e157fbca1d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bcd567d50afb40799b96c803ead0ec3b'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:01:33.642067 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-fe7b4821-3001-423b-9da8-e7e157fbca1d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bcd567d50afb40799b96c803ead0ec3b'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:01:33.668523 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1134/2300] 10.222.0.15 () {58 vars in 1224 bytes} [Sun Oct 9 01:01:33 2022] DELETE /identity/v3/users/bcd567d50afb40799b96c803ead0ec3b => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 09 01:01:34.142118 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0115e80-fad1-407e-bea5-2ea7728326a3 admin admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:01:34.144327 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-d0115e80-fad1-407e-bea5-2ea7728326a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:01:34.176940 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0115e80-fad1-407e-bea5-2ea7728326a3 admin admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:01:34.336076 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e404fa-58df-4938-8cb6-5d406b2bdd32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:01:34.337147 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e404fa-58df-4938-8cb6-5d406b2bdd32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:01:34.337147 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e404fa-58df-4938-8cb6-5d406b2bdd32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:01:34.337147 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e404fa-58df-4938-8cb6-5d406b2bdd32 admin admin] PATH_INFO: `/v3/projects/d7e382186b12428a880d4b1abd70d29b` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:01:34.338425 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e404fa-58df-4938-8cb6-5d406b2bdd32 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d7e382186b12428a880d4b1abd70d29b)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:01:34.340439 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e404fa-58df-4938-8cb6-5d406b2bdd32 admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:01:34.464218 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-b9e404fa-58df-4938-8cb6-5d406b2bdd32 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd7e382186b12428a880d4b1abd70d29b', 'request_id': 'req-b9e404fa-58df-4938-8cb6-5d406b2bdd32'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:01:34.474555 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-b9e404fa-58df-4938-8cb6-5d406b2bdd32 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd7e382186b12428a880d4b1abd70d29b', 'request_id': 'req-b9e404fa-58df-4938-8cb6-5d406b2bdd32'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:01:34.482729 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-b9e404fa-58df-4938-8cb6-5d406b2bdd32 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd7e382186b12428a880d4b1abd70d29b', 'request_id': 'req-b9e404fa-58df-4938-8cb6-5d406b2bdd32'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:01:34.495215 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-b9e404fa-58df-4938-8cb6-5d406b2bdd32 admin admin] The token cache is being invalidate because project d7e382186b12428a880d4b1abd70d29b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81525) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 09 01:01:34.495527 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-b9e404fa-58df-4938-8cb6-5d406b2bdd32 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:01:34.496194 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-b9e404fa-58df-4938-8cb6-5d406b2bdd32 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:01:34.497782 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1167/2301] 10.222.0.15 () {58 vars in 1233 bytes} [Sun Oct 9 01:01:34 2022] DELETE /identity/v3/projects/d7e382186b12428a880d4b1abd70d29b => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 01:01:34.503281 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222f3c93-1225-4e80-846e-22454d067f45 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:01:34.503892 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222f3c93-1225-4e80-846e-22454d067f45 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:01:34.503892 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222f3c93-1225-4e80-846e-22454d067f45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:01:34.525693 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-222f3c93-1225-4e80-846e-22454d067f45 None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 01:01:34.526953 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-222f3c93-1225-4e80-846e-22454d067f45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:01:34.598909 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1135/2302] 10.222.0.15 () {58 vars in 958 bytes} [Sun Oct 9 01:01:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 09 01:01:34.607581 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a437c8-bae9-4ff3-82a2-752938b195e2 None None] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:01:34.607949 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a437c8-bae9-4ff3-82a2-752938b195e2 None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:01:34.608297 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a437c8-bae9-4ff3-82a2-752938b195e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:01:34.633390 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.auth.core [None req-c9a437c8-bae9-4ff3-82a2-752938b195e2 None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 01:01:34.635003 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-c9a437c8-bae9-4ff3-82a2-752938b195e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:01:34.645611 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1168/2303] 10.222.0.15 () {58 vars in 958 bytes} [Sun Oct 9 01:01:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 09 01:01:34.650428 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222f3c93-1225-4e80-846e-22454d067f45 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:01:34.662070 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222f3c93-1225-4e80-846e-22454d067f45 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:01:34.667609 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bb3b42-ce37-4924-93c7-8d551e86fc12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:01:34.668380 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bb3b42-ce37-4924-93c7-8d551e86fc12 admin admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:01:34.668750 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bb3b42-ce37-4924-93c7-8d551e86fc12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:01:34.669113 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bb3b42-ce37-4924-93c7-8d551e86fc12 admin admin] PATH_INFO: `/v3/domains` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:01:34.669923 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bb3b42-ce37-4924-93c7-8d551e86fc12 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 01:01:34.670333 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bb3b42-ce37-4924-93c7-8d551e86fc12 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:01:34.672258 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bb3b42-ce37-4924-93c7-8d551e86fc12 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:01:34.687640 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1136/2304] 10.222.0.15 () {58 vars in 1153 bytes} [Sun Oct 9 01:01:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 09 01:01:34.692267 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a437c8-bae9-4ff3-82a2-752938b195e2 None None] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:01:34.704537 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a437c8-bae9-4ff3-82a2-752938b195e2 None None] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:01:34.711571 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f86945-22f9-4ee3-9a09-9bfdd54c93a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:01:34.712434 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f86945-22f9-4ee3-9a09-9bfdd54c93a9 admin admin] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:01:34.712824 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f86945-22f9-4ee3-9a09-9bfdd54c93a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:01:34.713227 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f86945-22f9-4ee3-9a09-9bfdd54c93a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:01:34.714084 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f86945-22f9-4ee3-9a09-9bfdd54c93a9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:01:34.716600 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f86945-22f9-4ee3-9a09-9bfdd54c93a9 admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:01:34.755709 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1169/2305] 10.222.0.15 () {60 vars in 1153 bytes} [Sun Oct 9 01:01:34 2022] POST /identity/v3/projects => generated 373 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 09 01:01:34.761999 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bb3b42-ce37-4924-93c7-8d551e86fc12 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:01:34.775503 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bb3b42-ce37-4924-93c7-8d551e86fc12 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:01:34.814187 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 01:01:34.861125 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf19253-d045-4cb8-aa37-f17534db52e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:01:34.861782 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf19253-d045-4cb8-aa37-f17534db52e0 admin admin] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:01:34.862079 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf19253-d045-4cb8-aa37-f17534db52e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:01:34.862524 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf19253-d045-4cb8-aa37-f17534db52e0 admin admin] PATH_INFO: `/v3/users` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:01:34.863522 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf19253-d045-4cb8-aa37-f17534db52e0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:01:34.865973 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf19253-d045-4cb8-aa37-f17534db52e0 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:01:34.898844 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1137/2306] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Oct 9 01:01:34 2022] POST /identity/v3/users => generated 287 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 09 01:01:34.905429 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f86945-22f9-4ee3-9a09-9bfdd54c93a9 admin admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:01:34.921000 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f86945-22f9-4ee3-9a09-9bfdd54c93a9 admin admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:01:34.927021 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f8bed0-74eb-4fd9-914b-cc17e8f51734 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:01:34.927875 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f8bed0-74eb-4fd9-914b-cc17e8f51734 admin admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:01:34.928228 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f8bed0-74eb-4fd9-914b-cc17e8f51734 admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:01:34.928561 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f8bed0-74eb-4fd9-914b-cc17e8f51734 admin admin] PATH_INFO: `/v3/roles` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:01:34.929297 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f8bed0-74eb-4fd9-914b-cc17e8f51734 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:01:34.931205 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f8bed0-74eb-4fd9-914b-cc17e8f51734 admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:01:34.950389 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1170/2307] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Oct 9 01:01:34 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 09 01:01:34.955565 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf19253-d045-4cb8-aa37-f17534db52e0 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:01:34.973878 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf19253-d045-4cb8-aa37-f17534db52e0 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:01:34.981664 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdab2fc0-bbbc-4c8a-befb-ad9222534d75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:01:34.982679 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdab2fc0-bbbc-4c8a-befb-ad9222534d75 admin admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:01:34.983115 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdab2fc0-bbbc-4c8a-befb-ad9222534d75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:01:34.983607 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdab2fc0-bbbc-4c8a-befb-ad9222534d75 admin admin] PATH_INFO: `/v3/roles` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:01:34.984739 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdab2fc0-bbbc-4c8a-befb-ad9222534d75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:01:34.987778 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdab2fc0-bbbc-4c8a-befb-ad9222534d75 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:01:35.008294 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1138/2308] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Oct 9 01:01:34 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 09 01:01:35.013441 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f8bed0-74eb-4fd9-914b-cc17e8f51734 admin admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:01:35.028216 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f8bed0-74eb-4fd9-914b-cc17e8f51734 admin admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:01:35.033707 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a76679b-bd8c-4936-af04-3f9c332a70fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:01:35.034464 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a76679b-bd8c-4936-af04-3f9c332a70fb admin admin] REQUEST_METHOD: `PUT` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:01:35.034816 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a76679b-bd8c-4936-af04-3f9c332a70fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:01:35.035157 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a76679b-bd8c-4936-af04-3f9c332a70fb admin admin] PATH_INFO: `/v3/projects/614912affcd64552995cd5cf24923bb7/users/fc6a8f22b4b24cb38a1be1383cbe8b4c/roles/afb0a01183d9497795eaa4fa1a4046ae` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:01:35.050324 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 01:01:35.054851 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a76679b-bd8c-4936-af04-3f9c332a70fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=614912affcd64552995cd5cf24923bb7, user_id=fc6a8f22b4b24cb38a1be1383cbe8b4c, role_id=afb0a01183d9497795eaa4fa1a4046ae)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:01:35.058011 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a76679b-bd8c-4936-af04-3f9c332a70fb admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:01:35.079180 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1171/2309] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Oct 9 01:01:35 2022] PUT /identity/v3/projects/614912affcd64552995cd5cf24923bb7/users/fc6a8f22b4b24cb38a1be1383cbe8b4c/roles/afb0a01183d9497795eaa4fa1a4046ae => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 01:01:35.092058 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bef6476-1e3d-4a59-b4cb-a625a3fb63d6 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:01:35.092370 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bef6476-1e3d-4a59-b4cb-a625a3fb63d6 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:01:35.092683 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bef6476-1e3d-4a59-b4cb-a625a3fb63d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:01:35.128839 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-9bef6476-1e3d-4a59-b4cb-a625a3fb63d6 None None] MFA Rules not processed for user `fc6a8f22b4b24cb38a1be1383cbe8b4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 01:01:35.130333 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-9bef6476-1e3d-4a59-b4cb-a625a3fb63d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:01:35.216554 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1139/2310] 10.222.0.15 () {58 vars in 958 bytes} [Sun Oct 9 01:01:35 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 01:01:35.221387 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a76679b-bd8c-4936-af04-3f9c332a70fb admin admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:01:35.318911 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a76679b-bd8c-4936-af04-3f9c332a70fb admin admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:01:35.327631 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f72f086-d0b5-440e-9215-1554357201cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:01:35.328697 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f72f086-d0b5-440e-9215-1554357201cd admin admin] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:01:35.329380 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f72f086-d0b5-440e-9215-1554357201cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:01:35.329858 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f72f086-d0b5-440e-9215-1554357201cd admin admin] PATH_INFO: `/v3/projects` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:01:35.331202 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f72f086-d0b5-440e-9215-1554357201cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:01:35.335106 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f72f086-d0b5-440e-9215-1554357201cd admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:01:35.383953 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1172/2311] 10.222.0.15 () {60 vars in 1153 bytes} [Sun Oct 9 01:01:35 2022] POST /identity/v3/projects => generated 371 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 09 01:01:35.390243 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bef6476-1e3d-4a59-b4cb-a625a3fb63d6 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:01:35.408468 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bef6476-1e3d-4a59-b4cb-a625a3fb63d6 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:01:35.542472 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2125cd23-b6ab-469a-a3b1-b1a33e170ac8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:01:35.544235 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2125cd23-b6ab-469a-a3b1-b1a33e170ac8 admin admin] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:01:35.547611 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2125cd23-b6ab-469a-a3b1-b1a33e170ac8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:01:35.547972 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2125cd23-b6ab-469a-a3b1-b1a33e170ac8 admin admin] PATH_INFO: `/v3/users` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:01:35.548703 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2125cd23-b6ab-469a-a3b1-b1a33e170ac8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:01:35.550959 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2125cd23-b6ab-469a-a3b1-b1a33e170ac8 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:01:35.597125 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1140/2312] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Oct 9 01:01:35 2022] POST /identity/v3/users => generated 292 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 09 01:01:35.602593 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f72f086-d0b5-440e-9215-1554357201cd admin admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:01:35.621848 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f72f086-d0b5-440e-9215-1554357201cd admin admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:01:35.630876 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6d10b3-956c-4e4a-8f9c-e499cea4c8d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:01:35.631932 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6d10b3-956c-4e4a-8f9c-e499cea4c8d4 admin admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:01:35.632349 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6d10b3-956c-4e4a-8f9c-e499cea4c8d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:01:35.632818 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6d10b3-956c-4e4a-8f9c-e499cea4c8d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:01:35.633895 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6d10b3-956c-4e4a-8f9c-e499cea4c8d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:01:35.636236 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6d10b3-956c-4e4a-8f9c-e499cea4c8d4 admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:01:35.657256 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1173/2313] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Oct 9 01:01:35 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 09 01:01:35.664254 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2125cd23-b6ab-469a-a3b1-b1a33e170ac8 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:01:35.686695 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2125cd23-b6ab-469a-a3b1-b1a33e170ac8 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:01:35.695519 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e3edd7-764e-4da4-aa9d-1efb8fa1c6c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:01:35.696692 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e3edd7-764e-4da4-aa9d-1efb8fa1c6c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:01:35.697159 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e3edd7-764e-4da4-aa9d-1efb8fa1c6c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:01:35.697625 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e3edd7-764e-4da4-aa9d-1efb8fa1c6c5 admin admin] PATH_INFO: `/v3/projects/43f119ecb45f4d528086c8ff9c5870fc/users/180c872422734e2ea4eef68840e94ce9/roles/f69dddf26daf4dd79d4c962beb877af5` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:01:35.734463 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e3edd7-764e-4da4-aa9d-1efb8fa1c6c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=43f119ecb45f4d528086c8ff9c5870fc, user_id=180c872422734e2ea4eef68840e94ce9, role_id=f69dddf26daf4dd79d4c962beb877af5)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:01:35.740479 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e3edd7-764e-4da4-aa9d-1efb8fa1c6c5 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:01:35.767318 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1141/2314] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Oct 9 01:01:35 2022] PUT /identity/v3/projects/43f119ecb45f4d528086c8ff9c5870fc/users/180c872422734e2ea4eef68840e94ce9/roles/f69dddf26daf4dd79d4c962beb877af5 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 09 01:01:35.772932 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6d10b3-956c-4e4a-8f9c-e499cea4c8d4 admin admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:01:35.792061 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6d10b3-956c-4e4a-8f9c-e499cea4c8d4 admin admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:01:35.872012 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c53cca-3074-48f2-89af-6b43a80153e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:01:35.872917 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c53cca-3074-48f2-89af-6b43a80153e1 admin admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:01:35.873352 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c53cca-3074-48f2-89af-6b43a80153e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:01:35.873810 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c53cca-3074-48f2-89af-6b43a80153e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:01:35.874677 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c53cca-3074-48f2-89af-6b43a80153e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:01:35.876910 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c53cca-3074-48f2-89af-6b43a80153e1 admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:01:35.894329 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1174/2315] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Oct 9 01:01:35 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 09 01:01:35.896920 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e3edd7-764e-4da4-aa9d-1efb8fa1c6c5 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:01:35.911325 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e3edd7-764e-4da4-aa9d-1efb8fa1c6c5 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:01:35.917796 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420f4ecc-5a6a-448f-b5c3-1534e8dddaa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:01:35.918716 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420f4ecc-5a6a-448f-b5c3-1534e8dddaa3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:01:35.919175 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420f4ecc-5a6a-448f-b5c3-1534e8dddaa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:01:35.919729 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420f4ecc-5a6a-448f-b5c3-1534e8dddaa3 admin admin] PATH_INFO: `/v3/projects/43f119ecb45f4d528086c8ff9c5870fc/users/180c872422734e2ea4eef68840e94ce9/roles/f69dddf26daf4dd79d4c962beb877af5` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:01:35.922686 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420f4ecc-5a6a-448f-b5c3-1534e8dddaa3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=43f119ecb45f4d528086c8ff9c5870fc, user_id=180c872422734e2ea4eef68840e94ce9, role_id=f69dddf26daf4dd79d4c962beb877af5)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:01:35.925801 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420f4ecc-5a6a-448f-b5c3-1534e8dddaa3 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:01:35.929303 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 01:01:35.950894 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1142/2316] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Oct 9 01:01:35 2022] PUT /identity/v3/projects/43f119ecb45f4d528086c8ff9c5870fc/users/180c872422734e2ea4eef68840e94ce9/roles/f69dddf26daf4dd79d4c962beb877af5 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 09 01:01:35.957557 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f556334-d387-4281-b446-aacd176845ae None None] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:01:35.958050 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f556334-d387-4281-b446-aacd176845ae None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:01:35.958529 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f556334-d387-4281-b446-aacd176845ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:01:36.016052 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.auth.core [None req-7f556334-d387-4281-b446-aacd176845ae None None] MFA Rules not processed for user `180c872422734e2ea4eef68840e94ce9`. Rule list: `[]` (Enabled: `True`). {{(pid=81525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 01:01:36.018570 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-7f556334-d387-4281-b446-aacd176845ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:01:36.085139 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 01:01:36.117072 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1175/2317] 10.222.0.15 () {58 vars in 958 bytes} [Sun Oct 9 01:01:35 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 01:01:36.137605 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420f4ecc-5a6a-448f-b5c3-1534e8dddaa3 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:01:36.140564 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-420f4ecc-5a6a-448f-b5c3-1534e8dddaa3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:01:36.229146 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420f4ecc-5a6a-448f-b5c3-1534e8dddaa3 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:01:36.234749 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4752c8e4-c58f-4c48-8f70-a85a02c1cbd4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff7cb78bcd91467abe5c2e2b48aedd1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f148d39ced534860abfbe8fc3f98ace4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:01:36.235948 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4752c8e4-c58f-4c48-8f70-a85a02c1cbd4 service cinder] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:01:36.236347 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4752c8e4-c58f-4c48-8f70-a85a02c1cbd4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:01:36.236694 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4752c8e4-c58f-4c48-8f70-a85a02c1cbd4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:01:36.250021 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4752c8e4-c58f-4c48-8f70-a85a02c1cbd4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:01:36.251869 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4752c8e4-c58f-4c48-8f70-a85a02c1cbd4 service cinder] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:01:36.265406 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1143/2318] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Oct 9 01:01:36 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 09 01:01:36.364862 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f556334-d387-4281-b446-aacd176845ae None None] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:01:36.382883 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f556334-d387-4281-b446-aacd176845ae None None] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:01:36.389937 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c8d3ed-91b6-46ba-8806-9caac2f5a500 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff7cb78bcd91467abe5c2e2b48aedd1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f148d39ced534860abfbe8fc3f98ace4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:01:36.390955 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c8d3ed-91b6-46ba-8806-9caac2f5a500 service cinder] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:01:36.391480 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c8d3ed-91b6-46ba-8806-9caac2f5a500 service cinder] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:01:36.391943 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c8d3ed-91b6-46ba-8806-9caac2f5a500 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:01:36.486562 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c8d3ed-91b6-46ba-8806-9caac2f5a500 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:01:36.489763 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c8d3ed-91b6-46ba-8806-9caac2f5a500 service cinder] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:01:36.509147 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1176/2319] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Oct 9 01:01:36 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 09 01:01:42.816012 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4752c8e4-c58f-4c48-8f70-a85a02c1cbd4 service cinder] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:01:42.817616 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-4752c8e4-c58f-4c48-8f70-a85a02c1cbd4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:01:42.950436 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4752c8e4-c58f-4c48-8f70-a85a02c1cbd4 service cinder] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:01:42.961817 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d949d13a-c825-4982-a116-54194fa4a9fa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ac83d57fba841e0a666710732249c49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f148d39ced534860abfbe8fc3f98ace4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:01:42.974648 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d949d13a-c825-4982-a116-54194fa4a9fa service nova] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:01:42.975169 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d949d13a-c825-4982-a116-54194fa4a9fa service nova] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:01:42.975671 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d949d13a-c825-4982-a116-54194fa4a9fa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:01:42.979201 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-d949d13a-c825-4982-a116-54194fa4a9fa service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:01:43.003408 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d949d13a-c825-4982-a116-54194fa4a9fa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:01:43.011435 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d949d13a-c825-4982-a116-54194fa4a9fa service nova] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:01:43.034229 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1144/2320] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Oct 9 01:01:42 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 09 01:01:43.070563 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571f0581-436e-42ce-b4a7-569147a04a07 None None] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:01:43.071181 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571f0581-436e-42ce-b4a7-569147a04a07 None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:01:43.071580 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571f0581-436e-42ce-b4a7-569147a04a07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:01:43.096328 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.auth.core [None req-571f0581-436e-42ce-b4a7-569147a04a07 None None] MFA Rules not processed for user `3a6cfef106c84f759ce0874be77f7380`. Rule list: `[]` (Enabled: `True`). {{(pid=81525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 01:01:43.097935 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-571f0581-436e-42ce-b4a7-569147a04a07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:01:43.205744 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1177/2321] 10.222.0.15 () {58 vars in 1009 bytes} [Sun Oct 9 01:01:43 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 01:01:43.300410 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d949d13a-c825-4982-a116-54194fa4a9fa service nova] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:01:43.303842 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-d949d13a-c825-4982-a116-54194fa4a9fa service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:01:43.437986 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d949d13a-c825-4982-a116-54194fa4a9fa service nova] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:01:43.448662 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2fc099-ec7d-4abe-b076-343301ac9ee1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4c467943b8f4d31a2f067ca6ed3b25c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f148d39ced534860abfbe8fc3f98ace4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:01:43.449443 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2fc099-ec7d-4abe-b076-343301ac9ee1 service swift] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:01:43.449879 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2fc099-ec7d-4abe-b076-343301ac9ee1 service swift] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:01:43.450447 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2fc099-ec7d-4abe-b076-343301ac9ee1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:01:43.492413 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2fc099-ec7d-4abe-b076-343301ac9ee1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:01:43.502727 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2fc099-ec7d-4abe-b076-343301ac9ee1 service swift] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:01:43.542657 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1145/2322] 10.222.0.15 () {60 vars in 1384 bytes} [Sun Oct 9 01:01:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 09 01:01:53.189086 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=59 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 01:01:53.529818 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:INSERT=1,keystone:SELECT=94 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 01:02:00.406036 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571f0581-436e-42ce-b4a7-569147a04a07 None None] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:02:00.436188 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571f0581-436e-42ce-b4a7-569147a04a07 None None] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:02:00.449843 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f7aee5-8986-41d3-886a-b0403b96c6ae service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ac83d57fba841e0a666710732249c49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f148d39ced534860abfbe8fc3f98ace4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:02:00.451020 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f7aee5-8986-41d3-886a-b0403b96c6ae service nova] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:02:00.451529 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f7aee5-8986-41d3-886a-b0403b96c6ae service nova] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:02:00.452060 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f7aee5-8986-41d3-886a-b0403b96c6ae service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:02:00.457642 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-64f7aee5-8986-41d3-886a-b0403b96c6ae service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:02:00.478556 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f7aee5-8986-41d3-886a-b0403b96c6ae service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:02:00.482927 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f7aee5-8986-41d3-886a-b0403b96c6ae service nova] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:02:00.500904 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1178/2323] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Oct 9 01:02:00 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 09 01:02:00.895436 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2fc099-ec7d-4abe-b076-343301ac9ee1 service swift] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:02:00.899726 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2fc099-ec7d-4abe-b076-343301ac9ee1 service swift] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:02:00.908053 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135be341-d58b-4cb8-beec-9c37666a1189 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ac83d57fba841e0a666710732249c49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f148d39ced534860abfbe8fc3f98ace4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:02:00.909106 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135be341-d58b-4cb8-beec-9c37666a1189 service nova] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:02:00.909540 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135be341-d58b-4cb8-beec-9c37666a1189 service nova] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:02:00.909947 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135be341-d58b-4cb8-beec-9c37666a1189 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:02:00.912942 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-135be341-d58b-4cb8-beec-9c37666a1189 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:02:01.011555 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135be341-d58b-4cb8-beec-9c37666a1189 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:02:01.014024 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135be341-d58b-4cb8-beec-9c37666a1189 service nova] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:02:01.025850 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1146/2324] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Oct 9 01:02:00 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 09 01:02:01.407346 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f7aee5-8986-41d3-886a-b0403b96c6ae service nova] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:02:01.409053 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-64f7aee5-8986-41d3-886a-b0403b96c6ae service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:02:01.521239 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f7aee5-8986-41d3-886a-b0403b96c6ae service nova] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:02:01.528901 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3913f3d-ddfc-46d3-9154-931ca19ed2fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4ef90d456d2483e8ddafbe2d4d4fb5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f148d39ced534860abfbe8fc3f98ace4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:02:01.530074 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3913f3d-ddfc-46d3-9154-931ca19ed2fd service neutron] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:02:01.530630 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3913f3d-ddfc-46d3-9154-931ca19ed2fd service neutron] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:02:01.531181 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3913f3d-ddfc-46d3-9154-931ca19ed2fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:02:01.534433 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-a3913f3d-ddfc-46d3-9154-931ca19ed2fd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:02:01.551109 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3913f3d-ddfc-46d3-9154-931ca19ed2fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:02:01.553952 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3913f3d-ddfc-46d3-9154-931ca19ed2fd service neutron] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:02:01.566476 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1179/2325] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Oct 9 01:02:01 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 09 01:02:01.777052 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d48d04-012f-4964-84ac-0a80bf10249e None None] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:02:01.777942 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d48d04-012f-4964-84ac-0a80bf10249e None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:02:01.778400 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d48d04-012f-4964-84ac-0a80bf10249e None None] PATH_INFO: `/` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:02:01.783230 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1147/2326] 10.222.0.15 () {54 vars in 921 bytes} [Sun Oct 9 01:02:01 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 01:02:01.794354 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e120d00-1158-43ab-8650-82317d8f0b4d None None] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:02:01.794354 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e120d00-1158-43ab-8650-82317d8f0b4d None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:02:01.794354 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e120d00-1158-43ab-8650-82317d8f0b4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:02:01.821780 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.auth.core [None req-3e120d00-1158-43ab-8650-82317d8f0b4d None None] MFA Rules not processed for user `4ac83d57fba841e0a666710732249c49`. Rule list: `[]` (Enabled: `True`). {{(pid=81525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 01:02:01.823994 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-3e120d00-1158-43ab-8650-82317d8f0b4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:02:01.841169 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1180/2327] 10.222.0.15 () {58 vars in 1018 bytes} [Sun Oct 9 01:02:01 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 09 01:02:01.860233 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d48d04-012f-4964-84ac-0a80bf10249e None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:02:01.862534 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-51d48d04-012f-4964-84ac-0a80bf10249e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:02:01.978974 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d48d04-012f-4964-84ac-0a80bf10249e None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:02:01.985925 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84753b10-8648-4501-97e5-001f4c503da7 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd88a9f3d154c4cf98369972a0561b2b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f148d39ced534860abfbe8fc3f98ace4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:02:01.987006 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84753b10-8648-4501-97e5-001f4c503da7 service glance] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:02:01.987584 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84753b10-8648-4501-97e5-001f4c503da7 service glance] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:02:01.988131 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84753b10-8648-4501-97e5-001f4c503da7 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:02:02.021372 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84753b10-8648-4501-97e5-001f4c503da7 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:02:02.025318 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84753b10-8648-4501-97e5-001f4c503da7 service glance] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:02:02.048537 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1148/2328] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Oct 9 01:02:01 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 09 01:02:02.145744 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14e0716-f117-4398-9ec7-8899eff34445 None None] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:02:02.146066 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14e0716-f117-4398-9ec7-8899eff34445 None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:02:02.146377 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14e0716-f117-4398-9ec7-8899eff34445 None None] PATH_INFO: `/` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:02:02.147933 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1181/2329] 10.222.0.15 () {54 vars in 921 bytes} [Sun Oct 9 01:02:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 01:02:02.153636 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2c3dbf-e10c-4c83-b340-20ac1efe0876 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:02:02.153959 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2c3dbf-e10c-4c83-b340-20ac1efe0876 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:02:02.154318 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2c3dbf-e10c-4c83-b340-20ac1efe0876 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:02:02.177188 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-fc2c3dbf-e10c-4c83-b340-20ac1efe0876 None None] MFA Rules not processed for user `f4ef90d456d2483e8ddafbe2d4d4fb5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 01:02:02.178535 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-fc2c3dbf-e10c-4c83-b340-20ac1efe0876 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:02:02.185555 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1149/2330] 10.222.0.15 () {58 vars in 1018 bytes} [Sun Oct 9 01:02:02 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 01:02:02.198211 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14e0716-f117-4398-9ec7-8899eff34445 None None] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:02:02.211551 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14e0716-f117-4398-9ec7-8899eff34445 None None] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:02:02.216511 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19121b41-6857-4784-9a9d-e58a0364d1dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4ef90d456d2483e8ddafbe2d4d4fb5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f148d39ced534860abfbe8fc3f98ace4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:02:02.217217 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19121b41-6857-4784-9a9d-e58a0364d1dd service neutron] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:02:02.217417 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19121b41-6857-4784-9a9d-e58a0364d1dd service neutron] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:02:02.217672 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19121b41-6857-4784-9a9d-e58a0364d1dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:02:02.226665 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19121b41-6857-4784-9a9d-e58a0364d1dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:02:02.228192 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19121b41-6857-4784-9a9d-e58a0364d1dd service neutron] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:02:02.238101 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1182/2331] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Oct 9 01:02:02 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 09 01:02:02.356377 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235e3224-984d-4fe8-ac05-32de9ff2d5e8 None None] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:02:02.357230 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235e3224-984d-4fe8-ac05-32de9ff2d5e8 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:02:02.357765 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235e3224-984d-4fe8-ac05-32de9ff2d5e8 None None] PATH_INFO: `/` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:02:02.360411 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1150/2332] 10.222.0.15 () {54 vars in 921 bytes} [Sun Oct 9 01:02:02 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 09 01:02:02.368517 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b3f54e-0ddd-46ea-a142-88684eae7e66 None None] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:02:02.368885 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b3f54e-0ddd-46ea-a142-88684eae7e66 None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:02:02.369200 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b3f54e-0ddd-46ea-a142-88684eae7e66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:02:02.392883 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.auth.core [None req-68b3f54e-0ddd-46ea-a142-88684eae7e66 None None] MFA Rules not processed for user `4ac83d57fba841e0a666710732249c49`. Rule list: `[]` (Enabled: `True`). {{(pid=81525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 01:02:02.394191 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-68b3f54e-0ddd-46ea-a142-88684eae7e66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:02:02.404934 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1183/2333] 10.222.0.15 () {58 vars in 1018 bytes} [Sun Oct 9 01:02:02 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 01:02:02.416752 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235e3224-984d-4fe8-ac05-32de9ff2d5e8 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:02:02.430209 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235e3224-984d-4fe8-ac05-32de9ff2d5e8 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:02:02.435341 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ecbec3-7571-400a-8f4c-87a34e11910a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4ef90d456d2483e8ddafbe2d4d4fb5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f148d39ced534860abfbe8fc3f98ace4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:02:02.436197 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ecbec3-7571-400a-8f4c-87a34e11910a service neutron] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:02:02.436568 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ecbec3-7571-400a-8f4c-87a34e11910a service neutron] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:02:02.436955 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ecbec3-7571-400a-8f4c-87a34e11910a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:02:02.453051 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ecbec3-7571-400a-8f4c-87a34e11910a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:02:02.454556 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ecbec3-7571-400a-8f4c-87a34e11910a service neutron] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:02:02.466995 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1151/2334] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Oct 9 01:02:02 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 09 01:02:05.893786 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe31307-6721-4248-beac-ac8a693b4938 None None] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:02:05.894599 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe31307-6721-4248-beac-ac8a693b4938 None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:02:05.894937 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe31307-6721-4248-beac-ac8a693b4938 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:02:05.924398 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.auth.core [None req-2fe31307-6721-4248-beac-ac8a693b4938 None None] MFA Rules not processed for user `3a6cfef106c84f759ce0874be77f7380`. Rule list: `[]` (Enabled: `True`). {{(pid=81525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 01:02:05.926509 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-2fe31307-6721-4248-beac-ac8a693b4938 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:02:05.944286 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1184/2335] 10.222.0.15 () {58 vars in 1009 bytes} [Sun Oct 9 01:02:05 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 01:02:05.956768 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ecbec3-7571-400a-8f4c-87a34e11910a service neutron] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:02:05.998906 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ecbec3-7571-400a-8f4c-87a34e11910a service neutron] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:02:06.009068 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7252c3b-89eb-4aca-8900-301883b0700c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4c467943b8f4d31a2f067ca6ed3b25c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f148d39ced534860abfbe8fc3f98ace4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:02:06.009993 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7252c3b-89eb-4aca-8900-301883b0700c service swift] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:02:06.010723 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7252c3b-89eb-4aca-8900-301883b0700c service swift] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:02:06.010836 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7252c3b-89eb-4aca-8900-301883b0700c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:02:06.028299 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7252c3b-89eb-4aca-8900-301883b0700c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:02:06.031478 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7252c3b-89eb-4aca-8900-301883b0700c service swift] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:02:06.051376 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1152/2336] 10.222.0.15 () {60 vars in 1384 bytes} [Sun Oct 9 01:02:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 09 01:02:10.233804 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe31307-6721-4248-beac-ac8a693b4938 None None] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:02:10.378736 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe31307-6721-4248-beac-ac8a693b4938 None None] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:02:10.387414 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab9d3d9-79fd-427c-b03d-12f5c6f632c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:02:10.388519 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab9d3d9-79fd-427c-b03d-12f5c6f632c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:02:10.388990 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab9d3d9-79fd-427c-b03d-12f5c6f632c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:02:10.389562 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab9d3d9-79fd-427c-b03d-12f5c6f632c0 admin admin] PATH_INFO: `/v3/users/fc6a8f22b4b24cb38a1be1383cbe8b4c` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:02:10.392244 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab9d3d9-79fd-427c-b03d-12f5c6f632c0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fc6a8f22b4b24cb38a1be1383cbe8b4c)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:02:10.396201 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab9d3d9-79fd-427c-b03d-12f5c6f632c0 admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:02:10.512007 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-cab9d3d9-79fd-427c-b03d-12f5c6f632c0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fc6a8f22b4b24cb38a1be1383cbe8b4c'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:02:10.528513 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-cab9d3d9-79fd-427c-b03d-12f5c6f632c0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fc6a8f22b4b24cb38a1be1383cbe8b4c'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:02:10.529804 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-cab9d3d9-79fd-427c-b03d-12f5c6f632c0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fc6a8f22b4b24cb38a1be1383cbe8b4c'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:02:10.530799 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-cab9d3d9-79fd-427c-b03d-12f5c6f632c0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fc6a8f22b4b24cb38a1be1383cbe8b4c'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:02:10.535076 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 01:02:10.545997 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-cab9d3d9-79fd-427c-b03d-12f5c6f632c0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fc6a8f22b4b24cb38a1be1383cbe8b4c'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:02:10.584990 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1185/2337] 10.222.0.15 () {58 vars in 1224 bytes} [Sun Oct 9 01:02:10 2022] DELETE /identity/v3/users/fc6a8f22b4b24cb38a1be1383cbe8b4c => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 01:02:10.586530 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccdef04-e7d8-4b82-98e7-c44f9b163643 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:02:10.587188 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccdef04-e7d8-4b82-98e7-c44f9b163643 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:02:10.587188 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccdef04-e7d8-4b82-98e7-c44f9b163643 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:02:10.627887 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-bccdef04-e7d8-4b82-98e7-c44f9b163643 None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 01:02:10.629733 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-bccdef04-e7d8-4b82-98e7-c44f9b163643 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:02:10.792897 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1153/2338] 10.222.0.15 () {58 vars in 958 bytes} [Sun Oct 9 01:02:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 01:02:10.806286 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab9d3d9-79fd-427c-b03d-12f5c6f632c0 admin admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:02:10.808807 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-cab9d3d9-79fd-427c-b03d-12f5c6f632c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:02:10.920018 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab9d3d9-79fd-427c-b03d-12f5c6f632c0 admin admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:02:10.924942 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0747799d-2393-4360-8d51-2c28aff416b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4ef90d456d2483e8ddafbe2d4d4fb5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f148d39ced534860abfbe8fc3f98ace4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:02:10.925945 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0747799d-2393-4360-8d51-2c28aff416b8 service neutron] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:02:10.926384 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0747799d-2393-4360-8d51-2c28aff416b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:02:10.927027 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0747799d-2393-4360-8d51-2c28aff416b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:02:10.944519 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0747799d-2393-4360-8d51-2c28aff416b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:02:10.947208 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0747799d-2393-4360-8d51-2c28aff416b8 service neutron] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:02:10.964299 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1186/2339] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Oct 9 01:02:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 09 01:02:11.637616 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccdef04-e7d8-4b82-98e7-c44f9b163643 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:02:11.640057 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-bccdef04-e7d8-4b82-98e7-c44f9b163643 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:02:11.670779 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccdef04-e7d8-4b82-98e7-c44f9b163643 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:02:11.684013 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbba3138-ff14-4009-90c1-c11f00eaba3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:02:11.684968 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbba3138-ff14-4009-90c1-c11f00eaba3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:02:11.685393 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbba3138-ff14-4009-90c1-c11f00eaba3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:02:11.686599 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbba3138-ff14-4009-90c1-c11f00eaba3f admin admin] PATH_INFO: `/v3/projects/614912affcd64552995cd5cf24923bb7` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:02:11.689261 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbba3138-ff14-4009-90c1-c11f00eaba3f admin admin] RBAC: Authorizing `identity:delete_project(project_id=614912affcd64552995cd5cf24923bb7)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:02:11.693211 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbba3138-ff14-4009-90c1-c11f00eaba3f admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:02:11.699662 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 01:02:11.793196 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-fbba3138-ff14-4009-90c1-c11f00eaba3f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '614912affcd64552995cd5cf24923bb7', 'request_id': 'req-fbba3138-ff14-4009-90c1-c11f00eaba3f'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:02:11.803592 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-fbba3138-ff14-4009-90c1-c11f00eaba3f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '614912affcd64552995cd5cf24923bb7', 'request_id': 'req-fbba3138-ff14-4009-90c1-c11f00eaba3f'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:02:11.812018 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-fbba3138-ff14-4009-90c1-c11f00eaba3f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '614912affcd64552995cd5cf24923bb7', 'request_id': 'req-fbba3138-ff14-4009-90c1-c11f00eaba3f'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:02:11.825837 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-fbba3138-ff14-4009-90c1-c11f00eaba3f admin admin] The token cache is being invalidate because project 614912affcd64552995cd5cf24923bb7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81524) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 09 01:02:11.826213 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-fbba3138-ff14-4009-90c1-c11f00eaba3f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:02:11.826923 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-fbba3138-ff14-4009-90c1-c11f00eaba3f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:02:11.828902 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1154/2340] 10.222.0.15 () {58 vars in 1233 bytes} [Sun Oct 9 01:02:11 2022] DELETE /identity/v3/projects/614912affcd64552995cd5cf24923bb7 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 01:02:11.835945 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0747799d-2393-4360-8d51-2c28aff416b8 service neutron] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:02:11.855592 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0747799d-2393-4360-8d51-2c28aff416b8 service neutron] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:02:11.962323 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da3ef89-404b-4f61-b975-42640af1f772 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:02:11.963326 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da3ef89-404b-4f61-b975-42640af1f772 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:02:11.963792 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da3ef89-404b-4f61-b975-42640af1f772 admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:02:11.964244 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da3ef89-404b-4f61-b975-42640af1f772 admin admin] PATH_INFO: `/v3/users/180c872422734e2ea4eef68840e94ce9` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:02:11.965686 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da3ef89-404b-4f61-b975-42640af1f772 admin admin] RBAC: Authorizing `identity:delete_user(user_id=180c872422734e2ea4eef68840e94ce9)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:02:11.967930 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da3ef89-404b-4f61-b975-42640af1f772 admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:02:12.053127 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-7da3ef89-404b-4f61-b975-42640af1f772 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '180c872422734e2ea4eef68840e94ce9'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:02:12.075217 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-7da3ef89-404b-4f61-b975-42640af1f772 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '180c872422734e2ea4eef68840e94ce9'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:02:12.076429 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-7da3ef89-404b-4f61-b975-42640af1f772 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '180c872422734e2ea4eef68840e94ce9'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:02:12.077468 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-7da3ef89-404b-4f61-b975-42640af1f772 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '180c872422734e2ea4eef68840e94ce9'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:02:12.097138 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-7da3ef89-404b-4f61-b975-42640af1f772 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '180c872422734e2ea4eef68840e94ce9'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:02:12.126049 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 01:02:12.132442 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1187/2341] 10.222.0.15 () {58 vars in 1224 bytes} [Sun Oct 9 01:02:11 2022] DELETE /identity/v3/users/180c872422734e2ea4eef68840e94ce9 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 01:02:12.866230 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbba3138-ff14-4009-90c1-c11f00eaba3f admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:02:12.868040 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-fbba3138-ff14-4009-90c1-c11f00eaba3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:02:12.886859 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbba3138-ff14-4009-90c1-c11f00eaba3f admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:02:12.985709 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc46c094-7e78-444d-8b50-237c1d80c68f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:02:12.986630 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc46c094-7e78-444d-8b50-237c1d80c68f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:02:12.987016 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc46c094-7e78-444d-8b50-237c1d80c68f admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:02:12.987650 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc46c094-7e78-444d-8b50-237c1d80c68f admin admin] PATH_INFO: `/v3/projects/43f119ecb45f4d528086c8ff9c5870fc` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:02:12.989187 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc46c094-7e78-444d-8b50-237c1d80c68f admin admin] RBAC: Authorizing `identity:delete_project(project_id=43f119ecb45f4d528086c8ff9c5870fc)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:02:12.991876 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc46c094-7e78-444d-8b50-237c1d80c68f admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:02:13.068662 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-dc46c094-7e78-444d-8b50-237c1d80c68f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '43f119ecb45f4d528086c8ff9c5870fc', 'request_id': 'req-dc46c094-7e78-444d-8b50-237c1d80c68f'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:02:13.079573 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-dc46c094-7e78-444d-8b50-237c1d80c68f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '43f119ecb45f4d528086c8ff9c5870fc', 'request_id': 'req-dc46c094-7e78-444d-8b50-237c1d80c68f'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:02:13.089011 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-dc46c094-7e78-444d-8b50-237c1d80c68f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '43f119ecb45f4d528086c8ff9c5870fc', 'request_id': 'req-dc46c094-7e78-444d-8b50-237c1d80c68f'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:02:13.105305 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-dc46c094-7e78-444d-8b50-237c1d80c68f admin admin] The token cache is being invalidate because project 43f119ecb45f4d528086c8ff9c5870fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81524) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 09 01:02:13.105957 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-dc46c094-7e78-444d-8b50-237c1d80c68f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:02:13.120098 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-dc46c094-7e78-444d-8b50-237c1d80c68f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:02:13.122991 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1155/2342] 10.222.0.15 () {58 vars in 1233 bytes} [Sun Oct 9 01:02:12 2022] DELETE /identity/v3/projects/43f119ecb45f4d528086c8ff9c5870fc => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 09 01:02:13.128752 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95f9040-0268-46b5-8b99-0f707de31f31 None None] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:02:13.129394 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95f9040-0268-46b5-8b99-0f707de31f31 None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:02:13.129824 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95f9040-0268-46b5-8b99-0f707de31f31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:02:13.152068 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.auth.core [None req-b95f9040-0268-46b5-8b99-0f707de31f31 None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 01:02:13.153563 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-b95f9040-0268-46b5-8b99-0f707de31f31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:02:13.236579 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1188/2343] 10.222.0.15 () {58 vars in 958 bytes} [Sun Oct 9 01:02:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 01:02:13.246884 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa00fe6-5c44-4137-91a4-ee249be712a8 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:02:13.247158 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa00fe6-5c44-4137-91a4-ee249be712a8 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:02:13.247471 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa00fe6-5c44-4137-91a4-ee249be712a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:02:13.281200 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-9aa00fe6-5c44-4137-91a4-ee249be712a8 None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 01:02:13.282487 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-9aa00fe6-5c44-4137-91a4-ee249be712a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:02:13.294899 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1156/2344] 10.222.0.15 () {58 vars in 958 bytes} [Sun Oct 9 01:02:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 09 01:02:13.295725 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95f9040-0268-46b5-8b99-0f707de31f31 None None] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:02:13.306515 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95f9040-0268-46b5-8b99-0f707de31f31 None None] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:02:13.312370 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2527c390-0a44-4c7a-ac93-3ece98ffd3dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:02:13.313014 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2527c390-0a44-4c7a-ac93-3ece98ffd3dc admin admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:02:13.313287 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2527c390-0a44-4c7a-ac93-3ece98ffd3dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:02:13.313625 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2527c390-0a44-4c7a-ac93-3ece98ffd3dc admin admin] PATH_INFO: `/v3/domains` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:02:13.314300 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2527c390-0a44-4c7a-ac93-3ece98ffd3dc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 01:02:13.314678 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2527c390-0a44-4c7a-ac93-3ece98ffd3dc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:02:13.316560 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2527c390-0a44-4c7a-ac93-3ece98ffd3dc admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:02:13.345739 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1189/2345] 10.222.0.15 () {58 vars in 1153 bytes} [Sun Oct 9 01:02:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 09 01:02:13.352227 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa00fe6-5c44-4137-91a4-ee249be712a8 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:02:13.362212 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa00fe6-5c44-4137-91a4-ee249be712a8 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:02:13.367579 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3a9ac6-4581-4993-aa39-faf4411d59f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:02:13.368155 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3a9ac6-4581-4993-aa39-faf4411d59f3 admin admin] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:02:13.368434 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3a9ac6-4581-4993-aa39-faf4411d59f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:02:13.368705 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3a9ac6-4581-4993-aa39-faf4411d59f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:02:13.369368 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3a9ac6-4581-4993-aa39-faf4411d59f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:02:13.371431 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3a9ac6-4581-4993-aa39-faf4411d59f3 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:02:13.388072 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 01:02:13.413828 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1157/2346] 10.222.0.15 () {60 vars in 1153 bytes} [Sun Oct 9 01:02:13 2022] POST /identity/v3/projects => generated 381 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 09 01:02:13.417899 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2527c390-0a44-4c7a-ac93-3ece98ffd3dc admin admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:02:13.429458 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2527c390-0a44-4c7a-ac93-3ece98ffd3dc admin admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:02:13.524279 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e658fb-7fe2-40e3-bac4-0f64240be6f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:02:13.525154 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e658fb-7fe2-40e3-bac4-0f64240be6f6 admin admin] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:02:13.525428 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e658fb-7fe2-40e3-bac4-0f64240be6f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:02:13.525876 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e658fb-7fe2-40e3-bac4-0f64240be6f6 admin admin] PATH_INFO: `/v3/users` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:02:13.526351 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e658fb-7fe2-40e3-bac4-0f64240be6f6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:02:13.528504 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e658fb-7fe2-40e3-bac4-0f64240be6f6 admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:02:13.579207 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1190/2347] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Oct 9 01:02:13 2022] POST /identity/v3/users => generated 291 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 09 01:02:13.580459 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3a9ac6-4581-4993-aa39-faf4411d59f3 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:02:13.595864 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3a9ac6-4581-4993-aa39-faf4411d59f3 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:02:13.604847 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2b8227-d351-4fe6-9f65-480621680799 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:02:13.605534 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2b8227-d351-4fe6-9f65-480621680799 admin admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:02:13.605817 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2b8227-d351-4fe6-9f65-480621680799 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:02:13.606091 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2b8227-d351-4fe6-9f65-480621680799 admin admin] PATH_INFO: `/v3/roles` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:02:13.606766 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2b8227-d351-4fe6-9f65-480621680799 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:02:13.608515 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2b8227-d351-4fe6-9f65-480621680799 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:02:13.628215 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1158/2348] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Oct 9 01:02:13 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 09 01:02:13.632207 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e658fb-7fe2-40e3-bac4-0f64240be6f6 admin admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:02:13.650860 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e658fb-7fe2-40e3-bac4-0f64240be6f6 admin admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:02:13.655823 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2f2f2f-2c89-401f-8bfa-164d2f536687 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:02:13.656451 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2f2f2f-2c89-401f-8bfa-164d2f536687 admin admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:02:13.656724 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2f2f2f-2c89-401f-8bfa-164d2f536687 admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:02:13.656990 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2f2f2f-2c89-401f-8bfa-164d2f536687 admin admin] PATH_INFO: `/v3/roles` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:02:13.657644 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2f2f2f-2c89-401f-8bfa-164d2f536687 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:02:13.659294 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2f2f2f-2c89-401f-8bfa-164d2f536687 admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:02:13.671561 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1191/2349] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Oct 9 01:02:13 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 09 01:02:13.676025 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2b8227-d351-4fe6-9f65-480621680799 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:02:13.686975 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2b8227-d351-4fe6-9f65-480621680799 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:02:13.692139 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931960a2-a109-4199-8ab4-ecb69468f865 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:02:13.692834 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931960a2-a109-4199-8ab4-ecb69468f865 admin admin] REQUEST_METHOD: `PUT` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:02:13.693108 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931960a2-a109-4199-8ab4-ecb69468f865 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:02:13.693378 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931960a2-a109-4199-8ab4-ecb69468f865 admin admin] PATH_INFO: `/v3/projects/6ed300b9c8a14f68b309a73695870a07/users/fdd2cc3ec7714b4085a17c68b567901c/roles/afb0a01183d9497795eaa4fa1a4046ae` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:02:13.710564 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931960a2-a109-4199-8ab4-ecb69468f865 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ed300b9c8a14f68b309a73695870a07, user_id=fdd2cc3ec7714b4085a17c68b567901c, role_id=afb0a01183d9497795eaa4fa1a4046ae)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:02:13.713383 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931960a2-a109-4199-8ab4-ecb69468f865 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:02:13.734573 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1159/2350] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Oct 9 01:02:13 2022] PUT /identity/v3/projects/6ed300b9c8a14f68b309a73695870a07/users/fdd2cc3ec7714b4085a17c68b567901c/roles/afb0a01183d9497795eaa4fa1a4046ae => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 01:02:13.756525 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e75143d-b77a-4fb5-9b2d-5702bc122653 None None] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:02:13.757017 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e75143d-b77a-4fb5-9b2d-5702bc122653 None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:02:13.757319 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e75143d-b77a-4fb5-9b2d-5702bc122653 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:02:13.808900 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.auth.core [None req-4e75143d-b77a-4fb5-9b2d-5702bc122653 None None] MFA Rules not processed for user `fdd2cc3ec7714b4085a17c68b567901c`. Rule list: `[]` (Enabled: `True`). {{(pid=81525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 01:02:13.810866 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-4e75143d-b77a-4fb5-9b2d-5702bc122653 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:02:13.894233 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 01:02:13.918104 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1192/2351] 10.222.0.15 () {58 vars in 958 bytes} [Sun Oct 9 01:02:13 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 01:02:13.922964 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931960a2-a109-4199-8ab4-ecb69468f865 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:02:14.050946 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931960a2-a109-4199-8ab4-ecb69468f865 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:02:14.066438 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16beb4da-a042-4d9c-bc20-695c000958fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:02:14.067009 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16beb4da-a042-4d9c-bc20-695c000958fa admin admin] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:02:14.067324 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16beb4da-a042-4d9c-bc20-695c000958fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:02:14.067571 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16beb4da-a042-4d9c-bc20-695c000958fa admin admin] PATH_INFO: `/v3/projects` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:02:14.068309 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16beb4da-a042-4d9c-bc20-695c000958fa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:02:14.070718 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16beb4da-a042-4d9c-bc20-695c000958fa admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:02:14.136773 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1160/2352] 10.222.0.15 () {60 vars in 1153 bytes} [Sun Oct 9 01:02:13 2022] POST /identity/v3/projects => generated 379 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 09 01:02:14.141864 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e75143d-b77a-4fb5-9b2d-5702bc122653 None None] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:02:14.163407 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e75143d-b77a-4fb5-9b2d-5702bc122653 None None] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:02:14.308908 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9b1c3f-992b-449b-b517-d86725adde08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:02:14.310140 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9b1c3f-992b-449b-b517-d86725adde08 admin admin] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:02:14.310735 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9b1c3f-992b-449b-b517-d86725adde08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:02:14.311572 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9b1c3f-992b-449b-b517-d86725adde08 admin admin] PATH_INFO: `/v3/users` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:02:14.312668 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9b1c3f-992b-449b-b517-d86725adde08 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:02:14.316544 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9b1c3f-992b-449b-b517-d86725adde08 admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:02:14.364121 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1193/2353] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Oct 9 01:02:14 2022] POST /identity/v3/users => generated 296 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 09 01:02:14.370648 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16beb4da-a042-4d9c-bc20-695c000958fa admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:02:14.414103 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16beb4da-a042-4d9c-bc20-695c000958fa admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:02:14.422161 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20218d6-9a81-431d-93b8-93d1efbec439 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:02:14.423344 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20218d6-9a81-431d-93b8-93d1efbec439 admin admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:02:14.435921 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20218d6-9a81-431d-93b8-93d1efbec439 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:02:14.436650 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20218d6-9a81-431d-93b8-93d1efbec439 admin admin] PATH_INFO: `/v3/roles` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:02:14.437791 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20218d6-9a81-431d-93b8-93d1efbec439 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:02:14.441405 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20218d6-9a81-431d-93b8-93d1efbec439 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:02:14.493319 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1161/2354] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Oct 9 01:02:14 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 09 01:02:14.500611 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9b1c3f-992b-449b-b517-d86725adde08 admin admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:02:14.517909 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9b1c3f-992b-449b-b517-d86725adde08 admin admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:02:14.537197 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c3dfe7-4ecb-429b-b884-dab6c196ced0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:02:14.538899 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c3dfe7-4ecb-429b-b884-dab6c196ced0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:02:14.539858 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c3dfe7-4ecb-429b-b884-dab6c196ced0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:02:14.541208 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c3dfe7-4ecb-429b-b884-dab6c196ced0 admin admin] PATH_INFO: `/v3/projects/0617e880ef384b9bbebdfaccefb98812/users/7c710598ac33471fa403eec36aaa3510/roles/f69dddf26daf4dd79d4c962beb877af5` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:02:14.576035 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c3dfe7-4ecb-429b-b884-dab6c196ced0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0617e880ef384b9bbebdfaccefb98812, user_id=7c710598ac33471fa403eec36aaa3510, role_id=f69dddf26daf4dd79d4c962beb877af5)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:02:14.578851 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c3dfe7-4ecb-429b-b884-dab6c196ced0 admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:02:14.603793 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1194/2355] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Oct 9 01:02:14 2022] PUT /identity/v3/projects/0617e880ef384b9bbebdfaccefb98812/users/7c710598ac33471fa403eec36aaa3510/roles/f69dddf26daf4dd79d4c962beb877af5 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 01:02:14.605391 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20218d6-9a81-431d-93b8-93d1efbec439 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:02:14.627906 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20218d6-9a81-431d-93b8-93d1efbec439 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:02:14.704347 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea13e80-3300-4e08-a569-45d64efa61da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:02:14.704968 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea13e80-3300-4e08-a569-45d64efa61da admin admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:02:14.705238 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea13e80-3300-4e08-a569-45d64efa61da admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:02:14.705504 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea13e80-3300-4e08-a569-45d64efa61da admin admin] PATH_INFO: `/v3/roles` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:02:14.706152 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea13e80-3300-4e08-a569-45d64efa61da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:02:14.707824 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea13e80-3300-4e08-a569-45d64efa61da admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:02:14.718826 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1162/2356] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Oct 9 01:02:14 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 09 01:02:14.723551 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c3dfe7-4ecb-429b-b884-dab6c196ced0 admin admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:02:14.738549 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c3dfe7-4ecb-429b-b884-dab6c196ced0 admin admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:02:14.748350 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c930b0-c753-45c3-b503-d51d2fd60eef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:02:14.749494 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c930b0-c753-45c3-b503-d51d2fd60eef admin admin] REQUEST_METHOD: `PUT` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:02:14.749970 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c930b0-c753-45c3-b503-d51d2fd60eef admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:02:14.750512 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c930b0-c753-45c3-b503-d51d2fd60eef admin admin] PATH_INFO: `/v3/projects/0617e880ef384b9bbebdfaccefb98812/users/7c710598ac33471fa403eec36aaa3510/roles/f69dddf26daf4dd79d4c962beb877af5` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:02:14.753217 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c930b0-c753-45c3-b503-d51d2fd60eef admin admin] RBAC: Authorizing `identity:create_grant(project_id=0617e880ef384b9bbebdfaccefb98812, user_id=7c710598ac33471fa403eec36aaa3510, role_id=f69dddf26daf4dd79d4c962beb877af5)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:02:14.756786 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c930b0-c753-45c3-b503-d51d2fd60eef admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:02:14.771658 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1195/2357] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Oct 9 01:02:14 2022] PUT /identity/v3/projects/0617e880ef384b9bbebdfaccefb98812/users/7c710598ac33471fa403eec36aaa3510/roles/f69dddf26daf4dd79d4c962beb877af5 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 01:02:14.782736 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e451883-fb94-4128-84c9-7750a0c713fe None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:02:14.783045 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e451883-fb94-4128-84c9-7750a0c713fe None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:02:14.783409 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e451883-fb94-4128-84c9-7750a0c713fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:02:14.819213 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-8e451883-fb94-4128-84c9-7750a0c713fe None None] MFA Rules not processed for user `7c710598ac33471fa403eec36aaa3510`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 01:02:14.820882 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-8e451883-fb94-4128-84c9-7750a0c713fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:02:14.844749 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 01:02:14.919642 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1163/2358] 10.222.0.15 () {58 vars in 958 bytes} [Sun Oct 9 01:02:14 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 09 01:02:14.931920 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c930b0-c753-45c3-b503-d51d2fd60eef admin admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:02:14.934120 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-b5c930b0-c753-45c3-b503-d51d2fd60eef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:02:15.005875 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c930b0-c753-45c3-b503-d51d2fd60eef admin admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:02:15.010860 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1622d38d-d7c8-4e0f-80a4-cae43f82ecbe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff7cb78bcd91467abe5c2e2b48aedd1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f148d39ced534860abfbe8fc3f98ace4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:02:15.011578 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1622d38d-d7c8-4e0f-80a4-cae43f82ecbe service cinder] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:02:15.011849 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1622d38d-d7c8-4e0f-80a4-cae43f82ecbe service cinder] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:02:15.012112 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1622d38d-d7c8-4e0f-80a4-cae43f82ecbe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:02:15.022929 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1622d38d-d7c8-4e0f-80a4-cae43f82ecbe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:02:15.024450 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1622d38d-d7c8-4e0f-80a4-cae43f82ecbe service cinder] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:02:15.036026 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1196/2359] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Oct 9 01:02:14 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 09 01:02:15.127517 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e451883-fb94-4128-84c9-7750a0c713fe None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:02:15.138603 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e451883-fb94-4128-84c9-7750a0c713fe None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:02:15.143190 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63861a31-fbd0-43e6-91e9-b0b8e3a9a428 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff7cb78bcd91467abe5c2e2b48aedd1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f148d39ced534860abfbe8fc3f98ace4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:02:15.144001 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63861a31-fbd0-43e6-91e9-b0b8e3a9a428 service cinder] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:02:15.144320 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63861a31-fbd0-43e6-91e9-b0b8e3a9a428 service cinder] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:02:15.144633 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63861a31-fbd0-43e6-91e9-b0b8e3a9a428 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:02:15.221483 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63861a31-fbd0-43e6-91e9-b0b8e3a9a428 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:02:15.223307 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63861a31-fbd0-43e6-91e9-b0b8e3a9a428 service cinder] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:02:15.234560 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1164/2360] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Oct 9 01:02:15 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 09 01:02:22.454657 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41beb14c-6949-4861-aa95-5544e25152f5 None None] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:02:22.455392 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41beb14c-6949-4861-aa95-5544e25152f5 None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:02:22.455392 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41beb14c-6949-4861-aa95-5544e25152f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:02:22.477632 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.auth.core [None req-41beb14c-6949-4861-aa95-5544e25152f5 None None] MFA Rules not processed for user `3a6cfef106c84f759ce0874be77f7380`. Rule list: `[]` (Enabled: `True`). {{(pid=81525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 01:02:22.478905 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-41beb14c-6949-4861-aa95-5544e25152f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:02:22.534573 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 01:02:22.554096 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1197/2361] 10.222.0.15 () {58 vars in 967 bytes} [Sun Oct 9 01:02:22 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 01:02:22.574178 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63861a31-fbd0-43e6-91e9-b0b8e3a9a428 service cinder] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:02:22.576613 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-63861a31-fbd0-43e6-91e9-b0b8e3a9a428 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:02:22.704809 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63861a31-fbd0-43e6-91e9-b0b8e3a9a428 service cinder] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:02:22.712100 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c50dac2-5633-40bd-a78f-357ea45b49ec service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4c467943b8f4d31a2f067ca6ed3b25c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f148d39ced534860abfbe8fc3f98ace4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:02:22.713039 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c50dac2-5633-40bd-a78f-357ea45b49ec service swift] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:02:22.713473 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c50dac2-5633-40bd-a78f-357ea45b49ec service swift] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:02:22.713910 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c50dac2-5633-40bd-a78f-357ea45b49ec service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:02:22.728517 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c50dac2-5633-40bd-a78f-357ea45b49ec service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:02:22.731007 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c50dac2-5633-40bd-a78f-357ea45b49ec service swift] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:02:22.745347 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1165/2362] 10.222.0.15 () {60 vars in 1384 bytes} [Sun Oct 9 01:02:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 09 01:02:22.822266 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41beb14c-6949-4861-aa95-5544e25152f5 None None] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:02:22.932536 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41beb14c-6949-4861-aa95-5544e25152f5 None None] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:02:22.939426 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1fff2e-b18b-40c1-9e67-fc6d277db8f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:02:22.940195 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1fff2e-b18b-40c1-9e67-fc6d277db8f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:02:22.940473 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1fff2e-b18b-40c1-9e67-fc6d277db8f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:02:22.940945 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1fff2e-b18b-40c1-9e67-fc6d277db8f2 admin admin] PATH_INFO: `/v3/users/fdd2cc3ec7714b4085a17c68b567901c` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:02:22.942913 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1fff2e-b18b-40c1-9e67-fc6d277db8f2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fdd2cc3ec7714b4085a17c68b567901c)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:02:22.946816 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1fff2e-b18b-40c1-9e67-fc6d277db8f2 admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:02:23.054310 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-de1fff2e-b18b-40c1-9e67-fc6d277db8f2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fdd2cc3ec7714b4085a17c68b567901c'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:02:23.074410 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-de1fff2e-b18b-40c1-9e67-fc6d277db8f2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fdd2cc3ec7714b4085a17c68b567901c'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:02:23.075643 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-de1fff2e-b18b-40c1-9e67-fc6d277db8f2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fdd2cc3ec7714b4085a17c68b567901c'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:02:23.076940 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-de1fff2e-b18b-40c1-9e67-fc6d277db8f2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fdd2cc3ec7714b4085a17c68b567901c'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:02:23.100364 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-de1fff2e-b18b-40c1-9e67-fc6d277db8f2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fdd2cc3ec7714b4085a17c68b567901c'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:02:23.138987 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1198/2363] 10.222.0.15 () {58 vars in 1224 bytes} [Sun Oct 9 01:02:22 2022] DELETE /identity/v3/users/fdd2cc3ec7714b4085a17c68b567901c => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 09 01:02:23.143907 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278dd2e0-fd19-411d-b99a-aa68b5a1d694 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:02:23.144230 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278dd2e0-fd19-411d-b99a-aa68b5a1d694 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:02:23.144420 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278dd2e0-fd19-411d-b99a-aa68b5a1d694 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:02:23.179630 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-278dd2e0-fd19-411d-b99a-aa68b5a1d694 None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 01:02:23.181251 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-278dd2e0-fd19-411d-b99a-aa68b5a1d694 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:02:23.266955 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 01:02:23.304138 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1166/2364] 10.222.0.15 () {58 vars in 958 bytes} [Sun Oct 9 01:02:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 01:02:23.311808 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1fff2e-b18b-40c1-9e67-fc6d277db8f2 admin admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:02:23.314592 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-de1fff2e-b18b-40c1-9e67-fc6d277db8f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:02:23.406064 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1fff2e-b18b-40c1-9e67-fc6d277db8f2 admin admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:02:23.410232 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242b557c-4a32-4dfb-aec7-a8b574b15795 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4ef90d456d2483e8ddafbe2d4d4fb5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f148d39ced534860abfbe8fc3f98ace4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:02:23.410984 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242b557c-4a32-4dfb-aec7-a8b574b15795 service neutron] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:02:23.411364 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242b557c-4a32-4dfb-aec7-a8b574b15795 service neutron] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:02:23.411700 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242b557c-4a32-4dfb-aec7-a8b574b15795 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:02:23.422594 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242b557c-4a32-4dfb-aec7-a8b574b15795 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:02:23.424242 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242b557c-4a32-4dfb-aec7-a8b574b15795 service neutron] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:02:23.436230 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1199/2365] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Oct 9 01:02:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 09 01:02:23.825900 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278dd2e0-fd19-411d-b99a-aa68b5a1d694 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:02:23.828245 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-278dd2e0-fd19-411d-b99a-aa68b5a1d694 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:02:23.846087 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278dd2e0-fd19-411d-b99a-aa68b5a1d694 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:02:23.853291 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3393edbc-e23a-4d5e-885e-77eda8498fc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:02:23.854136 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3393edbc-e23a-4d5e-885e-77eda8498fc9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:02:23.854541 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3393edbc-e23a-4d5e-885e-77eda8498fc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:02:23.855196 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3393edbc-e23a-4d5e-885e-77eda8498fc9 admin admin] PATH_INFO: `/v3/projects/6ed300b9c8a14f68b309a73695870a07` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:02:23.857663 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3393edbc-e23a-4d5e-885e-77eda8498fc9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6ed300b9c8a14f68b309a73695870a07)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:02:23.860034 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3393edbc-e23a-4d5e-885e-77eda8498fc9 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:02:23.925830 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-3393edbc-e23a-4d5e-885e-77eda8498fc9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6ed300b9c8a14f68b309a73695870a07', 'request_id': 'req-3393edbc-e23a-4d5e-885e-77eda8498fc9'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:02:23.936225 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-3393edbc-e23a-4d5e-885e-77eda8498fc9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6ed300b9c8a14f68b309a73695870a07', 'request_id': 'req-3393edbc-e23a-4d5e-885e-77eda8498fc9'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:02:23.948230 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-3393edbc-e23a-4d5e-885e-77eda8498fc9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6ed300b9c8a14f68b309a73695870a07', 'request_id': 'req-3393edbc-e23a-4d5e-885e-77eda8498fc9'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:02:23.969557 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-3393edbc-e23a-4d5e-885e-77eda8498fc9 admin admin] The token cache is being invalidate because project 6ed300b9c8a14f68b309a73695870a07 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81524) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 09 01:02:23.970060 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-3393edbc-e23a-4d5e-885e-77eda8498fc9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:02:23.971161 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-3393edbc-e23a-4d5e-885e-77eda8498fc9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:02:23.973866 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1167/2366] 10.222.0.15 () {58 vars in 1233 bytes} [Sun Oct 9 01:02:23 2022] DELETE /identity/v3/projects/6ed300b9c8a14f68b309a73695870a07 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 01:02:23.980269 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242b557c-4a32-4dfb-aec7-a8b574b15795 service neutron] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:02:23.994253 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242b557c-4a32-4dfb-aec7-a8b574b15795 service neutron] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:02:24.010541 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 01:02:24.070593 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6af820-0782-4af2-b7e5-1cf314f2e22d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:02:24.071286 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6af820-0782-4af2-b7e5-1cf314f2e22d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:02:24.071560 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6af820-0782-4af2-b7e5-1cf314f2e22d admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:02:24.071975 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6af820-0782-4af2-b7e5-1cf314f2e22d admin admin] PATH_INFO: `/v3/users/7c710598ac33471fa403eec36aaa3510` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:02:24.073346 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6af820-0782-4af2-b7e5-1cf314f2e22d admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c710598ac33471fa403eec36aaa3510)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:02:24.075251 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6af820-0782-4af2-b7e5-1cf314f2e22d admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:02:24.157733 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-ba6af820-0782-4af2-b7e5-1cf314f2e22d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c710598ac33471fa403eec36aaa3510'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:02:24.167963 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-ba6af820-0782-4af2-b7e5-1cf314f2e22d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c710598ac33471fa403eec36aaa3510'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:02:24.168840 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-ba6af820-0782-4af2-b7e5-1cf314f2e22d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c710598ac33471fa403eec36aaa3510'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:02:24.169542 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-ba6af820-0782-4af2-b7e5-1cf314f2e22d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c710598ac33471fa403eec36aaa3510'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:02:24.182088 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-ba6af820-0782-4af2-b7e5-1cf314f2e22d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c710598ac33471fa403eec36aaa3510'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:02:24.204819 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1200/2367] 10.222.0.15 () {58 vars in 1224 bytes} [Sun Oct 9 01:02:23 2022] DELETE /identity/v3/users/7c710598ac33471fa403eec36aaa3510 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 01:02:24.562694 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3393edbc-e23a-4d5e-885e-77eda8498fc9 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:02:24.565516 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-3393edbc-e23a-4d5e-885e-77eda8498fc9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:02:24.606122 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3393edbc-e23a-4d5e-885e-77eda8498fc9 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:02:24.692593 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a143876d-d48a-4135-a47b-65f9a44c80bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:02:24.693475 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a143876d-d48a-4135-a47b-65f9a44c80bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:02:24.693961 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a143876d-d48a-4135-a47b-65f9a44c80bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:02:24.694449 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a143876d-d48a-4135-a47b-65f9a44c80bd admin admin] PATH_INFO: `/v3/projects/0617e880ef384b9bbebdfaccefb98812` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:02:24.696546 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a143876d-d48a-4135-a47b-65f9a44c80bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=0617e880ef384b9bbebdfaccefb98812)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:02:24.700225 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a143876d-d48a-4135-a47b-65f9a44c80bd admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:02:24.785468 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-a143876d-d48a-4135-a47b-65f9a44c80bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0617e880ef384b9bbebdfaccefb98812', 'request_id': 'req-a143876d-d48a-4135-a47b-65f9a44c80bd'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:02:24.798342 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-a143876d-d48a-4135-a47b-65f9a44c80bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0617e880ef384b9bbebdfaccefb98812', 'request_id': 'req-a143876d-d48a-4135-a47b-65f9a44c80bd'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:02:24.811168 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-a143876d-d48a-4135-a47b-65f9a44c80bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0617e880ef384b9bbebdfaccefb98812', 'request_id': 'req-a143876d-d48a-4135-a47b-65f9a44c80bd'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:02:24.819852 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 01:02:24.834850 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-a143876d-d48a-4135-a47b-65f9a44c80bd admin admin] The token cache is being invalidate because project 0617e880ef384b9bbebdfaccefb98812 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81524) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 09 01:02:24.835809 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-a143876d-d48a-4135-a47b-65f9a44c80bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:02:24.837119 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-a143876d-d48a-4135-a47b-65f9a44c80bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:02:24.840086 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1168/2368] 10.222.0.15 () {58 vars in 1233 bytes} [Sun Oct 9 01:02:24 2022] DELETE /identity/v3/projects/0617e880ef384b9bbebdfaccefb98812 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 01:02:24.846239 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec7c78d-d942-47e5-bd24-b36644793a43 None None] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:02:24.847835 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec7c78d-d942-47e5-bd24-b36644793a43 None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:02:24.848324 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec7c78d-d942-47e5-bd24-b36644793a43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:02:24.884283 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.auth.core [None req-cec7c78d-d942-47e5-bd24-b36644793a43 None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 01:02:24.886449 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-cec7c78d-d942-47e5-bd24-b36644793a43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:02:24.984507 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1201/2369] 10.222.0.15 () {58 vars in 958 bytes} [Sun Oct 9 01:02:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 01:02:24.993295 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a632800-7d5a-4438-b6e5-f95d74b46e4c None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:02:24.993666 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a632800-7d5a-4438-b6e5-f95d74b46e4c None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:02:24.993886 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a632800-7d5a-4438-b6e5-f95d74b46e4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:02:25.017705 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-3a632800-7d5a-4438-b6e5-f95d74b46e4c None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 01:02:25.018949 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-3a632800-7d5a-4438-b6e5-f95d74b46e4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:02:25.027293 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1169/2370] 10.222.0.15 () {58 vars in 958 bytes} [Sun Oct 9 01:02:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 09 01:02:25.032384 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec7c78d-d942-47e5-bd24-b36644793a43 None None] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:02:25.049034 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec7c78d-d942-47e5-bd24-b36644793a43 None None] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:02:25.054612 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b658f38-8f29-4cd0-9c17-a91eaa8e8090 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:02:25.055388 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b658f38-8f29-4cd0-9c17-a91eaa8e8090 admin admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:02:25.055755 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b658f38-8f29-4cd0-9c17-a91eaa8e8090 admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:02:25.056080 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b658f38-8f29-4cd0-9c17-a91eaa8e8090 admin admin] PATH_INFO: `/v3/domains` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:02:25.056854 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b658f38-8f29-4cd0-9c17-a91eaa8e8090 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 01:02:25.057319 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b658f38-8f29-4cd0-9c17-a91eaa8e8090 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:02:25.059548 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b658f38-8f29-4cd0-9c17-a91eaa8e8090 admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:02:25.076148 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1202/2371] 10.222.0.15 () {58 vars in 1153 bytes} [Sun Oct 9 01:02:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 01:02:25.081738 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a632800-7d5a-4438-b6e5-f95d74b46e4c None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:02:25.093934 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a632800-7d5a-4438-b6e5-f95d74b46e4c None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:02:25.103086 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8035387-7d37-4b26-9e5f-c18855fd8701 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:02:25.104262 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8035387-7d37-4b26-9e5f-c18855fd8701 admin admin] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:02:25.106254 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8035387-7d37-4b26-9e5f-c18855fd8701 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:02:25.106726 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8035387-7d37-4b26-9e5f-c18855fd8701 admin admin] PATH_INFO: `/v3/projects` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:02:25.108183 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8035387-7d37-4b26-9e5f-c18855fd8701 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:02:25.111886 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8035387-7d37-4b26-9e5f-c18855fd8701 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:02:25.160305 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1170/2372] 10.222.0.15 () {60 vars in 1153 bytes} [Sun Oct 9 01:02:25 2022] POST /identity/v3/projects => generated 367 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 09 01:02:25.166107 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b658f38-8f29-4cd0-9c17-a91eaa8e8090 admin admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:02:25.179386 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b658f38-8f29-4cd0-9c17-a91eaa8e8090 admin admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:02:25.208703 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 01:02:25.272821 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c937ae-b879-473d-b9d5-f05832498440 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:02:25.274055 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c937ae-b879-473d-b9d5-f05832498440 admin admin] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:02:25.274530 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c937ae-b879-473d-b9d5-f05832498440 admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:02:25.274983 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c937ae-b879-473d-b9d5-f05832498440 admin admin] PATH_INFO: `/v3/users` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:02:25.276219 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c937ae-b879-473d-b9d5-f05832498440 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:02:25.280077 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c937ae-b879-473d-b9d5-f05832498440 admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:02:25.313630 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1203/2373] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Oct 9 01:02:25 2022] POST /identity/v3/users => generated 284 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 09 01:02:25.318522 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8035387-7d37-4b26-9e5f-c18855fd8701 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:02:25.331616 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8035387-7d37-4b26-9e5f-c18855fd8701 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:02:25.338381 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30a75d5-80e9-4539-887d-5c58dbcc20a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:02:25.339243 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30a75d5-80e9-4539-887d-5c58dbcc20a4 admin admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:02:25.339634 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30a75d5-80e9-4539-887d-5c58dbcc20a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:02:25.339991 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30a75d5-80e9-4539-887d-5c58dbcc20a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:02:25.340745 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30a75d5-80e9-4539-887d-5c58dbcc20a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:02:25.342941 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30a75d5-80e9-4539-887d-5c58dbcc20a4 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:02:25.361674 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1171/2374] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Oct 9 01:02:25 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 09 01:02:25.366546 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c937ae-b879-473d-b9d5-f05832498440 admin admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:02:25.382686 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c937ae-b879-473d-b9d5-f05832498440 admin admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:02:25.391617 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcbb9f2-c35e-40f0-abed-9732ab72d377 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:02:25.392610 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcbb9f2-c35e-40f0-abed-9732ab72d377 admin admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:02:25.393128 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcbb9f2-c35e-40f0-abed-9732ab72d377 admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:02:25.393499 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcbb9f2-c35e-40f0-abed-9732ab72d377 admin admin] PATH_INFO: `/v3/roles` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:02:25.396001 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcbb9f2-c35e-40f0-abed-9732ab72d377 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:02:25.398397 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcbb9f2-c35e-40f0-abed-9732ab72d377 admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:02:25.422439 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1204/2375] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Oct 9 01:02:25 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 09 01:02:25.428677 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30a75d5-80e9-4539-887d-5c58dbcc20a4 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:02:25.447752 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30a75d5-80e9-4539-887d-5c58dbcc20a4 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:02:25.453910 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fcfc39-49cc-46b7-9ea1-8ea770bcfea5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:02:25.454890 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fcfc39-49cc-46b7-9ea1-8ea770bcfea5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:02:25.455334 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fcfc39-49cc-46b7-9ea1-8ea770bcfea5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:02:25.455763 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fcfc39-49cc-46b7-9ea1-8ea770bcfea5 admin admin] PATH_INFO: `/v3/projects/6350ffde59be4457b947c5ec0d66f1e3/users/aaed25d924584fe594fb9e6473a486cd/roles/afb0a01183d9497795eaa4fa1a4046ae` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:02:25.477169 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fcfc39-49cc-46b7-9ea1-8ea770bcfea5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6350ffde59be4457b947c5ec0d66f1e3, user_id=aaed25d924584fe594fb9e6473a486cd, role_id=afb0a01183d9497795eaa4fa1a4046ae)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:02:25.480232 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fcfc39-49cc-46b7-9ea1-8ea770bcfea5 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:02:25.497634 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1172/2376] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Oct 9 01:02:25 2022] PUT /identity/v3/projects/6350ffde59be4457b947c5ec0d66f1e3/users/aaed25d924584fe594fb9e6473a486cd/roles/afb0a01183d9497795eaa4fa1a4046ae => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 01:02:25.509156 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8116ac-919f-4c20-9060-090d94cd65c5 None None] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:02:25.509457 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8116ac-919f-4c20-9060-090d94cd65c5 None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:02:25.509726 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8116ac-919f-4c20-9060-090d94cd65c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:02:25.550975 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.auth.core [None req-ff8116ac-919f-4c20-9060-090d94cd65c5 None None] MFA Rules not processed for user `aaed25d924584fe594fb9e6473a486cd`. Rule list: `[]` (Enabled: `True`). {{(pid=81525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 01:02:25.552817 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-ff8116ac-919f-4c20-9060-090d94cd65c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:02:25.641267 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1205/2377] 10.222.0.15 () {58 vars in 958 bytes} [Sun Oct 9 01:02:25 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 09 01:02:25.647480 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fcfc39-49cc-46b7-9ea1-8ea770bcfea5 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:02:25.734092 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fcfc39-49cc-46b7-9ea1-8ea770bcfea5 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:02:25.740840 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497d0ba1-93a1-42d9-ba7c-6f1f0ba96485 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:02:25.741705 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497d0ba1-93a1-42d9-ba7c-6f1f0ba96485 admin admin] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:02:25.742190 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497d0ba1-93a1-42d9-ba7c-6f1f0ba96485 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:02:25.742522 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497d0ba1-93a1-42d9-ba7c-6f1f0ba96485 admin admin] PATH_INFO: `/v3/projects` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:02:25.743336 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497d0ba1-93a1-42d9-ba7c-6f1f0ba96485 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:02:25.745664 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497d0ba1-93a1-42d9-ba7c-6f1f0ba96485 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:02:25.780381 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1173/2378] 10.222.0.15 () {60 vars in 1153 bytes} [Sun Oct 9 01:02:25 2022] POST /identity/v3/projects => generated 367 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 09 01:02:25.786627 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8116ac-919f-4c20-9060-090d94cd65c5 None None] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:02:25.799477 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8116ac-919f-4c20-9060-090d94cd65c5 None None] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:02:25.872270 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4028cd93-d213-4fe3-8cdf-091e3814e693 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:02:25.872988 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4028cd93-d213-4fe3-8cdf-091e3814e693 admin admin] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:02:25.873407 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4028cd93-d213-4fe3-8cdf-091e3814e693 admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:02:25.873687 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4028cd93-d213-4fe3-8cdf-091e3814e693 admin admin] PATH_INFO: `/v3/users` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:02:25.874451 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4028cd93-d213-4fe3-8cdf-091e3814e693 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:02:25.876740 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4028cd93-d213-4fe3-8cdf-091e3814e693 admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:02:25.902595 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1206/2379] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Oct 9 01:02:25 2022] POST /identity/v3/users => generated 290 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 09 01:02:25.908677 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497d0ba1-93a1-42d9-ba7c-6f1f0ba96485 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:02:25.921819 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497d0ba1-93a1-42d9-ba7c-6f1f0ba96485 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:02:25.929031 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edd333b-ce40-4d79-84a8-318746faf510 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:02:25.930104 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edd333b-ce40-4d79-84a8-318746faf510 admin admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:02:25.930659 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edd333b-ce40-4d79-84a8-318746faf510 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:02:25.931136 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edd333b-ce40-4d79-84a8-318746faf510 admin admin] PATH_INFO: `/v3/roles` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:02:25.932351 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edd333b-ce40-4d79-84a8-318746faf510 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:02:25.935426 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edd333b-ce40-4d79-84a8-318746faf510 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:02:25.956801 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1174/2380] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Oct 9 01:02:25 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 09 01:02:25.962262 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4028cd93-d213-4fe3-8cdf-091e3814e693 admin admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:02:25.981272 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4028cd93-d213-4fe3-8cdf-091e3814e693 admin admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:02:25.989668 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfd503a-4a78-4506-825b-34fdedd292df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:02:25.991039 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfd503a-4a78-4506-825b-34fdedd292df admin admin] REQUEST_METHOD: `PUT` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:02:25.991556 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfd503a-4a78-4506-825b-34fdedd292df admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:02:25.992019 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfd503a-4a78-4506-825b-34fdedd292df admin admin] PATH_INFO: `/v3/projects/190a82a7918948c69d8d2e093e1cd493/users/2cfbf2ff844941b68e3deb731b6e1139/roles/f69dddf26daf4dd79d4c962beb877af5` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:02:26.018577 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfd503a-4a78-4506-825b-34fdedd292df admin admin] RBAC: Authorizing `identity:create_grant(project_id=190a82a7918948c69d8d2e093e1cd493, user_id=2cfbf2ff844941b68e3deb731b6e1139, role_id=f69dddf26daf4dd79d4c962beb877af5)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:02:26.021504 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfd503a-4a78-4506-825b-34fdedd292df admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:02:26.025407 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 01:02:26.041584 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1207/2381] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Oct 9 01:02:25 2022] PUT /identity/v3/projects/190a82a7918948c69d8d2e093e1cd493/users/2cfbf2ff844941b68e3deb731b6e1139/roles/f69dddf26daf4dd79d4c962beb877af5 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 01:02:26.046178 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edd333b-ce40-4d79-84a8-318746faf510 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:02:26.058117 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edd333b-ce40-4d79-84a8-318746faf510 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:02:26.144789 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b7d6e7-b6e1-4244-a201-9f62878954e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:02:26.145887 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b7d6e7-b6e1-4244-a201-9f62878954e5 admin admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:02:26.146342 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b7d6e7-b6e1-4244-a201-9f62878954e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:02:26.146813 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b7d6e7-b6e1-4244-a201-9f62878954e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:02:26.147970 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b7d6e7-b6e1-4244-a201-9f62878954e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:02:26.150917 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b7d6e7-b6e1-4244-a201-9f62878954e5 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:02:26.167787 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1175/2382] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Oct 9 01:02:26 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 09 01:02:26.172706 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfd503a-4a78-4506-825b-34fdedd292df admin admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:02:26.183860 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfd503a-4a78-4506-825b-34fdedd292df admin admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:02:26.189403 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aabfe24-8610-45da-bc91-bbe5ab181708 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:02:26.190096 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aabfe24-8610-45da-bc91-bbe5ab181708 admin admin] REQUEST_METHOD: `PUT` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:02:26.190368 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aabfe24-8610-45da-bc91-bbe5ab181708 admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:02:26.190640 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aabfe24-8610-45da-bc91-bbe5ab181708 admin admin] PATH_INFO: `/v3/projects/190a82a7918948c69d8d2e093e1cd493/users/2cfbf2ff844941b68e3deb731b6e1139/roles/f69dddf26daf4dd79d4c962beb877af5` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:02:26.193069 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aabfe24-8610-45da-bc91-bbe5ab181708 admin admin] RBAC: Authorizing `identity:create_grant(project_id=190a82a7918948c69d8d2e093e1cd493, user_id=2cfbf2ff844941b68e3deb731b6e1139, role_id=f69dddf26daf4dd79d4c962beb877af5)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:02:26.196029 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aabfe24-8610-45da-bc91-bbe5ab181708 admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:02:26.212480 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1208/2383] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Oct 9 01:02:26 2022] PUT /identity/v3/projects/190a82a7918948c69d8d2e093e1cd493/users/2cfbf2ff844941b68e3deb731b6e1139/roles/f69dddf26daf4dd79d4c962beb877af5 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 09 01:02:26.233036 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f609b971-eccf-4553-a366-8b85bd222aef None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:02:26.233522 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f609b971-eccf-4553-a366-8b85bd222aef None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:02:26.234000 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f609b971-eccf-4553-a366-8b85bd222aef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:02:26.246885 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 01:02:26.282757 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-f609b971-eccf-4553-a366-8b85bd222aef None None] MFA Rules not processed for user `2cfbf2ff844941b68e3deb731b6e1139`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 01:02:26.284865 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-f609b971-eccf-4553-a366-8b85bd222aef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:02:26.413864 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1176/2384] 10.222.0.15 () {58 vars in 958 bytes} [Sun Oct 9 01:02:26 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 01:02:26.428243 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aabfe24-8610-45da-bc91-bbe5ab181708 admin admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:02:26.430887 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-3aabfe24-8610-45da-bc91-bbe5ab181708 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:02:26.517075 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aabfe24-8610-45da-bc91-bbe5ab181708 admin admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:02:26.522879 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4335e769-d05c-4e27-9e9d-a537f142d282 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff7cb78bcd91467abe5c2e2b48aedd1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f148d39ced534860abfbe8fc3f98ace4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:02:26.524071 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4335e769-d05c-4e27-9e9d-a537f142d282 service cinder] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:02:26.524562 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4335e769-d05c-4e27-9e9d-a537f142d282 service cinder] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:02:26.525054 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4335e769-d05c-4e27-9e9d-a537f142d282 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:02:26.541545 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4335e769-d05c-4e27-9e9d-a537f142d282 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:02:26.543672 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4335e769-d05c-4e27-9e9d-a537f142d282 service cinder] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:02:26.556366 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1209/2385] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Oct 9 01:02:26 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 09 01:02:28.535152 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f609b971-eccf-4553-a366-8b85bd222aef None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:02:28.626751 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f609b971-eccf-4553-a366-8b85bd222aef None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:02:28.631981 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85284bcc-8a77-4ec1-9907-6555d2bdeaa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:02:28.632542 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85284bcc-8a77-4ec1-9907-6555d2bdeaa3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:02:28.632822 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85284bcc-8a77-4ec1-9907-6555d2bdeaa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:02:28.633083 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85284bcc-8a77-4ec1-9907-6555d2bdeaa3 admin admin] PATH_INFO: `/v3/users/aaed25d924584fe594fb9e6473a486cd` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:02:28.634498 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85284bcc-8a77-4ec1-9907-6555d2bdeaa3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aaed25d924584fe594fb9e6473a486cd)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:02:28.636873 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85284bcc-8a77-4ec1-9907-6555d2bdeaa3 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:02:28.718164 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-85284bcc-8a77-4ec1-9907-6555d2bdeaa3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aaed25d924584fe594fb9e6473a486cd'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:02:28.731175 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-85284bcc-8a77-4ec1-9907-6555d2bdeaa3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aaed25d924584fe594fb9e6473a486cd'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:02:28.732032 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-85284bcc-8a77-4ec1-9907-6555d2bdeaa3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aaed25d924584fe594fb9e6473a486cd'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:02:28.732747 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-85284bcc-8a77-4ec1-9907-6555d2bdeaa3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aaed25d924584fe594fb9e6473a486cd'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:02:28.747937 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-85284bcc-8a77-4ec1-9907-6555d2bdeaa3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aaed25d924584fe594fb9e6473a486cd'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:02:28.776148 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1177/2386] 10.222.0.15 () {58 vars in 1224 bytes} [Sun Oct 9 01:02:28 2022] DELETE /identity/v3/users/aaed25d924584fe594fb9e6473a486cd => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 01:02:28.782808 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d6707e-ec62-4219-b69f-de60524a653e None None] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:02:28.783786 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d6707e-ec62-4219-b69f-de60524a653e None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:02:28.783786 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d6707e-ec62-4219-b69f-de60524a653e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:02:28.817341 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.auth.core [None req-50d6707e-ec62-4219-b69f-de60524a653e None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 01:02:28.819627 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-50d6707e-ec62-4219-b69f-de60524a653e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:02:28.894811 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1210/2387] 10.222.0.15 () {58 vars in 958 bytes} [Sun Oct 9 01:02:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 09 01:02:28.909766 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85284bcc-8a77-4ec1-9907-6555d2bdeaa3 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:02:28.911842 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-85284bcc-8a77-4ec1-9907-6555d2bdeaa3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:02:28.937363 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 01:02:28.985042 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d6707e-ec62-4219-b69f-de60524a653e None None] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:02:28.986804 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-50d6707e-ec62-4219-b69f-de60524a653e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:02:29.102382 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85284bcc-8a77-4ec1-9907-6555d2bdeaa3 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:02:29.111736 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab46587f-ba03-4636-b375-b017b65aebe1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4ef90d456d2483e8ddafbe2d4d4fb5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f148d39ced534860abfbe8fc3f98ace4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:02:29.114106 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab46587f-ba03-4636-b375-b017b65aebe1 service neutron] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:02:29.115459 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab46587f-ba03-4636-b375-b017b65aebe1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:02:29.116321 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab46587f-ba03-4636-b375-b017b65aebe1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:02:29.150010 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab46587f-ba03-4636-b375-b017b65aebe1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:02:29.153911 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab46587f-ba03-4636-b375-b017b65aebe1 service neutron] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:02:29.160776 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d6707e-ec62-4219-b69f-de60524a653e None None] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:02:29.172128 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb55025-07d5-4973-ab86-86b6d06f53a7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ac83d57fba841e0a666710732249c49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f148d39ced534860abfbe8fc3f98ace4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:02:29.173791 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb55025-07d5-4973-ab86-86b6d06f53a7 service nova] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:02:29.174168 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb55025-07d5-4973-ab86-86b6d06f53a7 service nova] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:02:29.174492 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb55025-07d5-4973-ab86-86b6d06f53a7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:02:29.177112 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-adb55025-07d5-4973-ab86-86b6d06f53a7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:02:29.180688 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1178/2388] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Oct 9 01:02:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 09 01:02:29.198090 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb55025-07d5-4973-ab86-86b6d06f53a7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:02:29.201263 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb55025-07d5-4973-ab86-86b6d06f53a7 service nova] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:02:29.227031 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1211/2389] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Oct 9 01:02:28 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 09 01:02:29.682537 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab46587f-ba03-4636-b375-b017b65aebe1 service neutron] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:02:29.684745 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-ab46587f-ba03-4636-b375-b017b65aebe1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:02:29.709688 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab46587f-ba03-4636-b375-b017b65aebe1 service neutron] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:02:29.729872 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560861b9-8c25-4e4c-9eda-3f1ffa6b8e9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:02:29.730792 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560861b9-8c25-4e4c-9eda-3f1ffa6b8e9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:02:29.731134 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560861b9-8c25-4e4c-9eda-3f1ffa6b8e9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:02:29.731503 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560861b9-8c25-4e4c-9eda-3f1ffa6b8e9c admin admin] PATH_INFO: `/v3/projects/6350ffde59be4457b947c5ec0d66f1e3` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:02:29.734157 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560861b9-8c25-4e4c-9eda-3f1ffa6b8e9c admin admin] RBAC: Authorizing `identity:delete_project(project_id=6350ffde59be4457b947c5ec0d66f1e3)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:02:29.736442 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560861b9-8c25-4e4c-9eda-3f1ffa6b8e9c admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:02:29.865888 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-560861b9-8c25-4e4c-9eda-3f1ffa6b8e9c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6350ffde59be4457b947c5ec0d66f1e3', 'request_id': 'req-560861b9-8c25-4e4c-9eda-3f1ffa6b8e9c'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:02:29.887160 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-560861b9-8c25-4e4c-9eda-3f1ffa6b8e9c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6350ffde59be4457b947c5ec0d66f1e3', 'request_id': 'req-560861b9-8c25-4e4c-9eda-3f1ffa6b8e9c'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:02:29.908072 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-560861b9-8c25-4e4c-9eda-3f1ffa6b8e9c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6350ffde59be4457b947c5ec0d66f1e3', 'request_id': 'req-560861b9-8c25-4e4c-9eda-3f1ffa6b8e9c'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:02:29.937971 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-560861b9-8c25-4e4c-9eda-3f1ffa6b8e9c admin admin] The token cache is being invalidate because project 6350ffde59be4457b947c5ec0d66f1e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81524) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 09 01:02:29.939360 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-560861b9-8c25-4e4c-9eda-3f1ffa6b8e9c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:02:29.940166 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-560861b9-8c25-4e4c-9eda-3f1ffa6b8e9c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:02:29.948906 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1179/2390] 10.222.0.15 () {58 vars in 1233 bytes} [Sun Oct 9 01:02:29 2022] DELETE /identity/v3/projects/6350ffde59be4457b947c5ec0d66f1e3 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 01:02:29.949190 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb55025-07d5-4973-ab86-86b6d06f53a7 service nova] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:02:29.963735 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb55025-07d5-4973-ab86-86b6d06f53a7 service nova] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:02:29.978990 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 01:02:30.061582 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfc7a05-99d1-4fd8-842d-b9ff362c4085 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:02:30.062250 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfc7a05-99d1-4fd8-842d-b9ff362c4085 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:02:30.062528 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfc7a05-99d1-4fd8-842d-b9ff362c4085 admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:02:30.062801 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfc7a05-99d1-4fd8-842d-b9ff362c4085 admin admin] PATH_INFO: `/v3/users/2cfbf2ff844941b68e3deb731b6e1139` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:02:30.064213 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfc7a05-99d1-4fd8-842d-b9ff362c4085 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2cfbf2ff844941b68e3deb731b6e1139)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:02:30.066227 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfc7a05-99d1-4fd8-842d-b9ff362c4085 admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:02:30.158218 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-4dfc7a05-99d1-4fd8-842d-b9ff362c4085 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2cfbf2ff844941b68e3deb731b6e1139'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:02:30.171139 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-4dfc7a05-99d1-4fd8-842d-b9ff362c4085 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2cfbf2ff844941b68e3deb731b6e1139'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:02:30.172492 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-4dfc7a05-99d1-4fd8-842d-b9ff362c4085 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2cfbf2ff844941b68e3deb731b6e1139'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:02:30.173522 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-4dfc7a05-99d1-4fd8-842d-b9ff362c4085 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2cfbf2ff844941b68e3deb731b6e1139'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:02:30.187570 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-4dfc7a05-99d1-4fd8-842d-b9ff362c4085 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2cfbf2ff844941b68e3deb731b6e1139'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:02:30.211770 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1212/2391] 10.222.0.15 () {58 vars in 1224 bytes} [Sun Oct 9 01:02:29 2022] DELETE /identity/v3/users/2cfbf2ff844941b68e3deb731b6e1139 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 09 01:02:30.803975 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560861b9-8c25-4e4c-9eda-3f1ffa6b8e9c admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:02:30.806625 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-560861b9-8c25-4e4c-9eda-3f1ffa6b8e9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:02:30.826841 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560861b9-8c25-4e4c-9eda-3f1ffa6b8e9c admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:02:30.909134 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63700aea-d3d2-4862-90d3-1a7ef9be0a34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:02:30.910010 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63700aea-d3d2-4862-90d3-1a7ef9be0a34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:02:30.910354 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63700aea-d3d2-4862-90d3-1a7ef9be0a34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:02:30.910664 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63700aea-d3d2-4862-90d3-1a7ef9be0a34 admin admin] PATH_INFO: `/v3/projects/190a82a7918948c69d8d2e093e1cd493` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:02:30.912017 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63700aea-d3d2-4862-90d3-1a7ef9be0a34 admin admin] RBAC: Authorizing `identity:delete_project(project_id=190a82a7918948c69d8d2e093e1cd493)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:02:30.914693 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63700aea-d3d2-4862-90d3-1a7ef9be0a34 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:02:30.976312 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 01:02:31.002350 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-63700aea-d3d2-4862-90d3-1a7ef9be0a34 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '190a82a7918948c69d8d2e093e1cd493', 'request_id': 'req-63700aea-d3d2-4862-90d3-1a7ef9be0a34'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:02:31.017504 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-63700aea-d3d2-4862-90d3-1a7ef9be0a34 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '190a82a7918948c69d8d2e093e1cd493', 'request_id': 'req-63700aea-d3d2-4862-90d3-1a7ef9be0a34'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:02:31.031474 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-63700aea-d3d2-4862-90d3-1a7ef9be0a34 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '190a82a7918948c69d8d2e093e1cd493', 'request_id': 'req-63700aea-d3d2-4862-90d3-1a7ef9be0a34'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:02:31.051630 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-63700aea-d3d2-4862-90d3-1a7ef9be0a34 admin admin] The token cache is being invalidate because project 190a82a7918948c69d8d2e093e1cd493 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81524) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 09 01:02:31.052174 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-63700aea-d3d2-4862-90d3-1a7ef9be0a34 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:02:31.053283 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-63700aea-d3d2-4862-90d3-1a7ef9be0a34 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:02:31.056015 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1180/2392] 10.222.0.15 () {58 vars in 1233 bytes} [Sun Oct 9 01:02:30 2022] DELETE /identity/v3/projects/190a82a7918948c69d8d2e093e1cd493 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 01:02:31.063860 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7d9cbe-a7e4-499a-a7f1-7fd6790f9f9e None None] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:02:31.064518 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7d9cbe-a7e4-499a-a7f1-7fd6790f9f9e None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:02:31.065115 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7d9cbe-a7e4-499a-a7f1-7fd6790f9f9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:02:31.101764 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.auth.core [None req-4f7d9cbe-a7e4-499a-a7f1-7fd6790f9f9e None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 01:02:31.102999 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-4f7d9cbe-a7e4-499a-a7f1-7fd6790f9f9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:02:31.196223 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1213/2393] 10.222.0.15 () {58 vars in 958 bytes} [Sun Oct 9 01:02:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 01:02:31.204387 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82440dc9-65ea-4d92-a35e-b549efaf1988 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:02:31.204670 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82440dc9-65ea-4d92-a35e-b549efaf1988 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:02:31.204957 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82440dc9-65ea-4d92-a35e-b549efaf1988 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:02:31.229804 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-82440dc9-65ea-4d92-a35e-b549efaf1988 None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 01:02:31.231432 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-82440dc9-65ea-4d92-a35e-b549efaf1988 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:02:31.240778 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1181/2394] 10.222.0.15 () {58 vars in 958 bytes} [Sun Oct 9 01:02:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 01:02:31.245343 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7d9cbe-a7e4-499a-a7f1-7fd6790f9f9e None None] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:02:31.258783 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7d9cbe-a7e4-499a-a7f1-7fd6790f9f9e None None] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:02:31.263912 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd10ebd-984c-4211-b100-ed8f835cb319 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:02:31.264544 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd10ebd-984c-4211-b100-ed8f835cb319 admin admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:02:31.264814 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd10ebd-984c-4211-b100-ed8f835cb319 admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:02:31.265106 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd10ebd-984c-4211-b100-ed8f835cb319 admin admin] PATH_INFO: `/v3/domains` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:02:31.265784 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd10ebd-984c-4211-b100-ed8f835cb319 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 01:02:31.266073 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd10ebd-984c-4211-b100-ed8f835cb319 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:02:31.267823 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd10ebd-984c-4211-b100-ed8f835cb319 admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:02:31.285574 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1214/2395] 10.222.0.15 () {58 vars in 1153 bytes} [Sun Oct 9 01:02:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 01:02:31.287503 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82440dc9-65ea-4d92-a35e-b549efaf1988 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:02:31.298819 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82440dc9-65ea-4d92-a35e-b549efaf1988 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:02:31.304306 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c453cec-8802-4f5c-898e-6780296f4f17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:02:31.304958 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c453cec-8802-4f5c-898e-6780296f4f17 admin admin] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:02:31.305229 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c453cec-8802-4f5c-898e-6780296f4f17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:02:31.305492 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c453cec-8802-4f5c-898e-6780296f4f17 admin admin] PATH_INFO: `/v3/projects` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:02:31.306149 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c453cec-8802-4f5c-898e-6780296f4f17 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:02:31.308605 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c453cec-8802-4f5c-898e-6780296f4f17 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:02:31.344348 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1182/2396] 10.222.0.15 () {60 vars in 1153 bytes} [Sun Oct 9 01:02:31 2022] POST /identity/v3/projects => generated 377 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 09 01:02:31.349430 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd10ebd-984c-4211-b100-ed8f835cb319 admin admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:02:31.360121 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd10ebd-984c-4211-b100-ed8f835cb319 admin admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:02:31.378231 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 01:02:31.473076 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2945879d-d7a3-45a1-8819-95e8a9da41da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:02:31.474115 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2945879d-d7a3-45a1-8819-95e8a9da41da admin admin] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:02:31.474606 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2945879d-d7a3-45a1-8819-95e8a9da41da admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:02:31.475056 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2945879d-d7a3-45a1-8819-95e8a9da41da admin admin] PATH_INFO: `/v3/users` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:02:31.476402 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2945879d-d7a3-45a1-8819-95e8a9da41da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:02:31.479984 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2945879d-d7a3-45a1-8819-95e8a9da41da admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:02:31.517627 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1215/2397] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Oct 9 01:02:31 2022] POST /identity/v3/users => generated 289 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 09 01:02:31.522838 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c453cec-8802-4f5c-898e-6780296f4f17 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:02:31.540166 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c453cec-8802-4f5c-898e-6780296f4f17 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:02:31.547472 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62a9bf6-2a16-4fb8-a7c3-84ec78fe8c56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:02:31.547472 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62a9bf6-2a16-4fb8-a7c3-84ec78fe8c56 admin admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:02:31.547472 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62a9bf6-2a16-4fb8-a7c3-84ec78fe8c56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:02:31.550951 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62a9bf6-2a16-4fb8-a7c3-84ec78fe8c56 admin admin] PATH_INFO: `/v3/roles` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:02:31.552441 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62a9bf6-2a16-4fb8-a7c3-84ec78fe8c56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:02:31.554699 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62a9bf6-2a16-4fb8-a7c3-84ec78fe8c56 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:02:31.569643 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1183/2398] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Oct 9 01:02:31 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 09 01:02:31.574392 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2945879d-d7a3-45a1-8819-95e8a9da41da admin admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:02:31.589751 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2945879d-d7a3-45a1-8819-95e8a9da41da admin admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:02:31.595106 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d59e100-bd5a-48f9-a3a0-a326e4bb8001 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:02:31.595780 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d59e100-bd5a-48f9-a3a0-a326e4bb8001 admin admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:02:31.596052 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d59e100-bd5a-48f9-a3a0-a326e4bb8001 admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:02:31.596322 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d59e100-bd5a-48f9-a3a0-a326e4bb8001 admin admin] PATH_INFO: `/v3/roles` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:02:31.597063 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d59e100-bd5a-48f9-a3a0-a326e4bb8001 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:02:31.599464 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d59e100-bd5a-48f9-a3a0-a326e4bb8001 admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:02:31.614510 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1216/2399] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Oct 9 01:02:31 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 09 01:02:31.621334 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62a9bf6-2a16-4fb8-a7c3-84ec78fe8c56 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:02:31.640307 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62a9bf6-2a16-4fb8-a7c3-84ec78fe8c56 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:02:31.645288 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74aad3d4-228a-45ea-b660-04e2a900e5d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:02:31.645976 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74aad3d4-228a-45ea-b660-04e2a900e5d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:02:31.646398 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74aad3d4-228a-45ea-b660-04e2a900e5d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:02:31.646562 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74aad3d4-228a-45ea-b660-04e2a900e5d6 admin admin] PATH_INFO: `/v3/projects/0ddeb547e85f40dfa922675a5df6be76/users/82d90b1a21ff4504a610146af089af20/roles/afb0a01183d9497795eaa4fa1a4046ae` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:02:31.671375 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74aad3d4-228a-45ea-b660-04e2a900e5d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ddeb547e85f40dfa922675a5df6be76, user_id=82d90b1a21ff4504a610146af089af20, role_id=afb0a01183d9497795eaa4fa1a4046ae)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:02:31.674823 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74aad3d4-228a-45ea-b660-04e2a900e5d6 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:02:31.703613 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1184/2400] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Oct 9 01:02:31 2022] PUT /identity/v3/projects/0ddeb547e85f40dfa922675a5df6be76/users/82d90b1a21ff4504a610146af089af20/roles/afb0a01183d9497795eaa4fa1a4046ae => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 01:02:31.724938 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adf915a-d788-407a-928d-f4fa6edcac7d None None] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:02:31.725305 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adf915a-d788-407a-928d-f4fa6edcac7d None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:02:31.725744 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adf915a-d788-407a-928d-f4fa6edcac7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:02:31.759510 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.auth.core [None req-7adf915a-d788-407a-928d-f4fa6edcac7d None None] MFA Rules not processed for user `82d90b1a21ff4504a610146af089af20`. Rule list: `[]` (Enabled: `True`). {{(pid=81525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 01:02:31.760915 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-7adf915a-d788-407a-928d-f4fa6edcac7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:02:31.839961 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1217/2401] 10.222.0.15 () {58 vars in 958 bytes} [Sun Oct 9 01:02:31 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 01:02:31.845789 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74aad3d4-228a-45ea-b660-04e2a900e5d6 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:02:31.920405 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74aad3d4-228a-45ea-b660-04e2a900e5d6 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:02:31.926313 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e26726-75bd-4971-9bb8-975fc2d090f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:02:31.926790 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e26726-75bd-4971-9bb8-975fc2d090f2 admin admin] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:02:31.927062 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e26726-75bd-4971-9bb8-975fc2d090f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:02:31.927433 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e26726-75bd-4971-9bb8-975fc2d090f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:02:31.928178 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e26726-75bd-4971-9bb8-975fc2d090f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:02:31.930410 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e26726-75bd-4971-9bb8-975fc2d090f2 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:02:31.962329 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1185/2402] 10.222.0.15 () {60 vars in 1153 bytes} [Sun Oct 9 01:02:31 2022] POST /identity/v3/projects => generated 375 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 09 01:02:31.967100 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adf915a-d788-407a-928d-f4fa6edcac7d None None] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:02:31.979958 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adf915a-d788-407a-928d-f4fa6edcac7d None None] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:02:32.046215 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcad3c9f-500a-4ec3-8b54-223934709d0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:02:32.046848 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcad3c9f-500a-4ec3-8b54-223934709d0c admin admin] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:02:32.047118 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcad3c9f-500a-4ec3-8b54-223934709d0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:02:32.047421 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcad3c9f-500a-4ec3-8b54-223934709d0c admin admin] PATH_INFO: `/v3/users` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:02:32.048057 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcad3c9f-500a-4ec3-8b54-223934709d0c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:02:32.050046 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcad3c9f-500a-4ec3-8b54-223934709d0c admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:02:32.074740 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1218/2403] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Oct 9 01:02:31 2022] POST /identity/v3/users => generated 294 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 09 01:02:32.079382 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e26726-75bd-4971-9bb8-975fc2d090f2 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:02:32.091506 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e26726-75bd-4971-9bb8-975fc2d090f2 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:02:32.097384 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496e3ff6-dc5a-4d8e-87d3-2992c7b23ee6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:02:32.098018 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496e3ff6-dc5a-4d8e-87d3-2992c7b23ee6 admin admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:02:32.098291 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496e3ff6-dc5a-4d8e-87d3-2992c7b23ee6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:02:32.098581 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496e3ff6-dc5a-4d8e-87d3-2992c7b23ee6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:02:32.099498 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496e3ff6-dc5a-4d8e-87d3-2992c7b23ee6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:02:32.101274 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496e3ff6-dc5a-4d8e-87d3-2992c7b23ee6 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:02:32.113845 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1186/2404] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Oct 9 01:02:32 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 09 01:02:32.125237 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcad3c9f-500a-4ec3-8b54-223934709d0c admin admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:02:32.136529 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcad3c9f-500a-4ec3-8b54-223934709d0c admin admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:02:32.142213 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33529d16-47fe-4af3-a710-79f314135609 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:02:32.142899 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33529d16-47fe-4af3-a710-79f314135609 admin admin] REQUEST_METHOD: `PUT` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:02:32.143177 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33529d16-47fe-4af3-a710-79f314135609 admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:02:32.143474 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33529d16-47fe-4af3-a710-79f314135609 admin admin] PATH_INFO: `/v3/projects/f9d4338abd494d63a4f8b9f0a80a396c/users/2928f3a77a1641eebc1ea04706af7498/roles/f69dddf26daf4dd79d4c962beb877af5` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:02:32.157520 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 01:02:32.162529 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33529d16-47fe-4af3-a710-79f314135609 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9d4338abd494d63a4f8b9f0a80a396c, user_id=2928f3a77a1641eebc1ea04706af7498, role_id=f69dddf26daf4dd79d4c962beb877af5)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:02:32.165905 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33529d16-47fe-4af3-a710-79f314135609 admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:02:32.182250 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1219/2405] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Oct 9 01:02:32 2022] PUT /identity/v3/projects/f9d4338abd494d63a4f8b9f0a80a396c/users/2928f3a77a1641eebc1ea04706af7498/roles/f69dddf26daf4dd79d4c962beb877af5 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 01:02:32.186558 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496e3ff6-dc5a-4d8e-87d3-2992c7b23ee6 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:02:32.197776 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496e3ff6-dc5a-4d8e-87d3-2992c7b23ee6 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:02:32.234137 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:DELETE=5,keystone:SELECT=91,keystone:INSERT=4 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 01:02:32.269121 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d659f20-f9f9-4cc5-91d2-e3b27cac8b34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:02:32.269751 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d659f20-f9f9-4cc5-91d2-e3b27cac8b34 admin admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:02:32.270025 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d659f20-f9f9-4cc5-91d2-e3b27cac8b34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:02:32.270309 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d659f20-f9f9-4cc5-91d2-e3b27cac8b34 admin admin] PATH_INFO: `/v3/roles` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:02:32.270940 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d659f20-f9f9-4cc5-91d2-e3b27cac8b34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:02:32.272597 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d659f20-f9f9-4cc5-91d2-e3b27cac8b34 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:02:32.283822 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1187/2406] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Oct 9 01:02:32 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 09 01:02:32.288943 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33529d16-47fe-4af3-a710-79f314135609 admin admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:02:32.300407 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33529d16-47fe-4af3-a710-79f314135609 admin admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:02:32.306732 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fe2be4-a797-4fc8-b2cf-0902cab61e7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:02:32.307583 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fe2be4-a797-4fc8-b2cf-0902cab61e7f admin admin] REQUEST_METHOD: `PUT` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:02:32.307945 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fe2be4-a797-4fc8-b2cf-0902cab61e7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:02:32.308219 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fe2be4-a797-4fc8-b2cf-0902cab61e7f admin admin] PATH_INFO: `/v3/projects/f9d4338abd494d63a4f8b9f0a80a396c/users/2928f3a77a1641eebc1ea04706af7498/roles/f69dddf26daf4dd79d4c962beb877af5` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:02:32.310828 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fe2be4-a797-4fc8-b2cf-0902cab61e7f admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9d4338abd494d63a4f8b9f0a80a396c, user_id=2928f3a77a1641eebc1ea04706af7498, role_id=f69dddf26daf4dd79d4c962beb877af5)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:02:32.313580 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fe2be4-a797-4fc8-b2cf-0902cab61e7f admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:02:32.326856 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1220/2407] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Oct 9 01:02:32 2022] PUT /identity/v3/projects/f9d4338abd494d63a4f8b9f0a80a396c/users/2928f3a77a1641eebc1ea04706af7498/roles/f69dddf26daf4dd79d4c962beb877af5 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 01:02:32.401784 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bc80f0-de3b-41f4-849e-a4e28210c42c None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:02:32.402066 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bc80f0-de3b-41f4-849e-a4e28210c42c None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:02:32.402324 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bc80f0-de3b-41f4-849e-a4e28210c42c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:02:32.436276 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-f8bc80f0-de3b-41f4-849e-a4e28210c42c None None] MFA Rules not processed for user `2928f3a77a1641eebc1ea04706af7498`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 01:02:32.437594 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-f8bc80f0-de3b-41f4-849e-a4e28210c42c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:02:32.522814 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1188/2408] 10.222.0.15 () {58 vars in 958 bytes} [Sun Oct 9 01:02:32 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 01:02:32.534465 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fe2be4-a797-4fc8-b2cf-0902cab61e7f admin admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:02:32.536649 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-f4fe2be4-a797-4fc8-b2cf-0902cab61e7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:02:32.633241 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fe2be4-a797-4fc8-b2cf-0902cab61e7f admin admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:02:32.639662 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f978bd-a28f-4854-9644-b5dc1c82c7c9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff7cb78bcd91467abe5c2e2b48aedd1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f148d39ced534860abfbe8fc3f98ace4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:02:32.640777 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f978bd-a28f-4854-9644-b5dc1c82c7c9 service cinder] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:02:32.641258 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f978bd-a28f-4854-9644-b5dc1c82c7c9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:02:32.641683 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f978bd-a28f-4854-9644-b5dc1c82c7c9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:02:32.738083 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f978bd-a28f-4854-9644-b5dc1c82c7c9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:02:32.740837 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f978bd-a28f-4854-9644-b5dc1c82c7c9 service cinder] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:02:32.763037 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1221/2409] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Oct 9 01:02:32 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 09 01:02:35.471309 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bc80f0-de3b-41f4-849e-a4e28210c42c None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:02:35.473520 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-f8bc80f0-de3b-41f4-849e-a4e28210c42c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:02:35.553704 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bc80f0-de3b-41f4-849e-a4e28210c42c None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:02:35.559909 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d252a1d-9f70-4f4e-8e43-6b53e019acad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4ef90d456d2483e8ddafbe2d4d4fb5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f148d39ced534860abfbe8fc3f98ace4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:02:35.560866 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d252a1d-9f70-4f4e-8e43-6b53e019acad service neutron] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:02:35.561319 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d252a1d-9f70-4f4e-8e43-6b53e019acad service neutron] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:02:35.561849 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d252a1d-9f70-4f4e-8e43-6b53e019acad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:02:35.564788 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-2d252a1d-9f70-4f4e-8e43-6b53e019acad service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:02:35.671034 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d252a1d-9f70-4f4e-8e43-6b53e019acad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:02:35.672527 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d252a1d-9f70-4f4e-8e43-6b53e019acad service neutron] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:02:35.684909 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1189/2410] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Oct 9 01:02:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 09 01:02:35.877554 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f978bd-a28f-4854-9644-b5dc1c82c7c9 service cinder] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:02:35.879685 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-e8f978bd-a28f-4854-9644-b5dc1c82c7c9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:02:35.908721 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f978bd-a28f-4854-9644-b5dc1c82c7c9 service cinder] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:02:35.918290 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1321a271-51d3-4fb9-8338-ff7fed93ef22 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff7cb78bcd91467abe5c2e2b48aedd1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f148d39ced534860abfbe8fc3f98ace4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:02:35.919150 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1321a271-51d3-4fb9-8338-ff7fed93ef22 service cinder] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:02:35.919565 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1321a271-51d3-4fb9-8338-ff7fed93ef22 service cinder] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:02:35.920826 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1321a271-51d3-4fb9-8338-ff7fed93ef22 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:02:35.946804 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1321a271-51d3-4fb9-8338-ff7fed93ef22 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:02:35.950103 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1321a271-51d3-4fb9-8338-ff7fed93ef22 service cinder] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:02:35.973575 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1222/2411] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Oct 9 01:02:35 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 09 01:02:43.380547 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d252a1d-9f70-4f4e-8e43-6b53e019acad service neutron] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:02:43.384462 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-2d252a1d-9f70-4f4e-8e43-6b53e019acad service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:02:43.405241 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 01:02:43.504827 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1321a271-51d3-4fb9-8338-ff7fed93ef22 service cinder] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:02:43.508435 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-1321a271-51d3-4fb9-8338-ff7fed93ef22 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:02:43.555372 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1321a271-51d3-4fb9-8338-ff7fed93ef22 service cinder] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:02:43.587670 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d252a1d-9f70-4f4e-8e43-6b53e019acad service neutron] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:02:43.592700 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4696d029-f9c9-483d-b1c2-97f7be83ac9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:02:43.595851 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4696d029-f9c9-483d-b1c2-97f7be83ac9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:02:43.596979 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4696d029-f9c9-483d-b1c2-97f7be83ac9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:02:43.599938 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4696d029-f9c9-483d-b1c2-97f7be83ac9e admin admin] PATH_INFO: `/v3/users/c4df6b9e42314edcbee1710279d0aa5a` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:02:43.617248 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3e97e1-e124-4fe4-90a7-39d97993045a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64be9d44437e4247a72334b9bab3cdd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f148d39ced534860abfbe8fc3f98ace4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:02:43.617248 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3e97e1-e124-4fe4-90a7-39d97993045a service placement] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:02:43.617248 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3e97e1-e124-4fe4-90a7-39d97993045a service placement] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:02:43.617248 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3e97e1-e124-4fe4-90a7-39d97993045a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:02:43.617979 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4696d029-f9c9-483d-b1c2-97f7be83ac9e admin admin] RBAC: Authorizing `identity:delete_user(user_id=c4df6b9e42314edcbee1710279d0aa5a)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:02:43.618609 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-fa3e97e1-e124-4fe4-90a7-39d97993045a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:02:43.619952 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4696d029-f9c9-483d-b1c2-97f7be83ac9e admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:02:43.644959 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3e97e1-e124-4fe4-90a7-39d97993045a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:02:43.647909 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3e97e1-e124-4fe4-90a7-39d97993045a service placement] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:02:43.671588 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1190/2412] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Oct 9 01:02:43 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 09 01:02:43.730134 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-4696d029-f9c9-483d-b1c2-97f7be83ac9e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c4df6b9e42314edcbee1710279d0aa5a'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:02:43.760740 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-4696d029-f9c9-483d-b1c2-97f7be83ac9e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c4df6b9e42314edcbee1710279d0aa5a'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:02:43.762718 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-4696d029-f9c9-483d-b1c2-97f7be83ac9e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c4df6b9e42314edcbee1710279d0aa5a'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:02:43.764036 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-4696d029-f9c9-483d-b1c2-97f7be83ac9e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c4df6b9e42314edcbee1710279d0aa5a'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:02:43.791905 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-4696d029-f9c9-483d-b1c2-97f7be83ac9e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c4df6b9e42314edcbee1710279d0aa5a'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:02:43.799661 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 01:02:43.825272 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1223/2413] 10.222.0.15 () {58 vars in 1224 bytes} [Sun Oct 9 01:02:43 2022] DELETE /identity/v3/users/c4df6b9e42314edcbee1710279d0aa5a => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 01:02:44.129057 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3e97e1-e124-4fe4-90a7-39d97993045a service placement] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:02:44.174781 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3e97e1-e124-4fe4-90a7-39d97993045a service placement] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:02:44.275145 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a41217-c3be-407d-88f2-385307c504db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:02:44.277317 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a41217-c3be-407d-88f2-385307c504db admin admin] REQUEST_METHOD: `DELETE` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:02:44.277778 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a41217-c3be-407d-88f2-385307c504db admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:02:44.279750 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a41217-c3be-407d-88f2-385307c504db admin admin] PATH_INFO: `/v3/projects/feaf08f170154714be8503f68562741a` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:02:44.281841 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a41217-c3be-407d-88f2-385307c504db admin admin] RBAC: Authorizing `identity:delete_project(project_id=feaf08f170154714be8503f68562741a)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:02:44.284799 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a41217-c3be-407d-88f2-385307c504db admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:02:44.369629 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-82a41217-c3be-407d-88f2-385307c504db admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'feaf08f170154714be8503f68562741a', 'request_id': 'req-82a41217-c3be-407d-88f2-385307c504db'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:02:44.382644 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-82a41217-c3be-407d-88f2-385307c504db admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'feaf08f170154714be8503f68562741a', 'request_id': 'req-82a41217-c3be-407d-88f2-385307c504db'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:02:44.391963 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-82a41217-c3be-407d-88f2-385307c504db admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'feaf08f170154714be8503f68562741a', 'request_id': 'req-82a41217-c3be-407d-88f2-385307c504db'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:02:44.405634 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-82a41217-c3be-407d-88f2-385307c504db admin admin] The token cache is being invalidate because project feaf08f170154714be8503f68562741a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81524) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 09 01:02:44.405942 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-82a41217-c3be-407d-88f2-385307c504db admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:02:44.406654 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-82a41217-c3be-407d-88f2-385307c504db admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:02:44.409518 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1191/2414] 10.222.0.15 () {58 vars in 1233 bytes} [Sun Oct 9 01:02:44 2022] DELETE /identity/v3/projects/feaf08f170154714be8503f68562741a => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 01:02:44.413764 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6f357a-37ef-46ff-9f2e-43ce5eafc771 None None] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:02:44.414341 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6f357a-37ef-46ff-9f2e-43ce5eafc771 None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:02:44.414604 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6f357a-37ef-46ff-9f2e-43ce5eafc771 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:02:44.438976 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.auth.core [None req-fd6f357a-37ef-46ff-9f2e-43ce5eafc771 None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 01:02:44.440294 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-fd6f357a-37ef-46ff-9f2e-43ce5eafc771 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:02:44.522104 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1224/2415] 10.222.0.15 () {58 vars in 958 bytes} [Sun Oct 9 01:02:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 09 01:02:44.532457 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fead6cbf-95a7-4b25-a384-a722bace24f3 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:02:44.532931 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fead6cbf-95a7-4b25-a384-a722bace24f3 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:02:44.533417 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fead6cbf-95a7-4b25-a384-a722bace24f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:02:44.567397 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-fead6cbf-95a7-4b25-a384-a722bace24f3 None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 01:02:44.569533 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-fead6cbf-95a7-4b25-a384-a722bace24f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:02:44.584111 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1192/2416] 10.222.0.15 () {58 vars in 958 bytes} [Sun Oct 9 01:02:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 09 01:02:44.589174 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6f357a-37ef-46ff-9f2e-43ce5eafc771 None None] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:02:44.606980 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6f357a-37ef-46ff-9f2e-43ce5eafc771 None None] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:02:44.615843 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad4ec45-45c2-4f10-902b-c539daa189d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:02:44.616698 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad4ec45-45c2-4f10-902b-c539daa189d0 admin admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:02:44.617065 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad4ec45-45c2-4f10-902b-c539daa189d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:02:44.617450 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad4ec45-45c2-4f10-902b-c539daa189d0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:02:44.618603 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad4ec45-45c2-4f10-902b-c539daa189d0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 01:02:44.619153 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad4ec45-45c2-4f10-902b-c539daa189d0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:02:44.622466 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad4ec45-45c2-4f10-902b-c539daa189d0 admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:02:44.644776 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1225/2417] 10.222.0.15 () {58 vars in 1153 bytes} [Sun Oct 9 01:02:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 01:02:44.650228 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fead6cbf-95a7-4b25-a384-a722bace24f3 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:02:44.667224 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fead6cbf-95a7-4b25-a384-a722bace24f3 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:02:44.675843 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09594f34-1314-4d33-a834-571b95fdb1e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:02:44.676910 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09594f34-1314-4d33-a834-571b95fdb1e1 admin admin] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:02:44.677389 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09594f34-1314-4d33-a834-571b95fdb1e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:02:44.677856 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09594f34-1314-4d33-a834-571b95fdb1e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:02:44.678989 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09594f34-1314-4d33-a834-571b95fdb1e1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:02:44.682952 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09594f34-1314-4d33-a834-571b95fdb1e1 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:02:44.713565 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 01:02:44.746250 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1193/2418] 10.222.0.15 () {60 vars in 1153 bytes} [Sun Oct 9 01:02:44 2022] POST /identity/v3/projects => generated 371 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 09 01:02:44.749088 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad4ec45-45c2-4f10-902b-c539daa189d0 admin admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:02:44.773048 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad4ec45-45c2-4f10-902b-c539daa189d0 admin admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:02:44.888376 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345328b8-588e-44bb-8841-8533dc147bc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:02:44.889027 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345328b8-588e-44bb-8841-8533dc147bc9 admin admin] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:02:44.889302 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345328b8-588e-44bb-8841-8533dc147bc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:02:44.889580 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345328b8-588e-44bb-8841-8533dc147bc9 admin admin] PATH_INFO: `/v3/users` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:02:44.890345 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345328b8-588e-44bb-8841-8533dc147bc9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:02:44.892804 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345328b8-588e-44bb-8841-8533dc147bc9 admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:02:44.933596 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1226/2419] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Oct 9 01:02:44 2022] POST /identity/v3/users => generated 286 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 09 01:02:44.940255 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09594f34-1314-4d33-a834-571b95fdb1e1 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:02:44.970547 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09594f34-1314-4d33-a834-571b95fdb1e1 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:02:44.976564 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac4a432-2ac8-4fcc-8064-6dbb8d113dae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:02:44.977226 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac4a432-2ac8-4fcc-8064-6dbb8d113dae admin admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:02:44.977504 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac4a432-2ac8-4fcc-8064-6dbb8d113dae admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:02:44.977764 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac4a432-2ac8-4fcc-8064-6dbb8d113dae admin admin] PATH_INFO: `/v3/roles` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:02:44.978504 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac4a432-2ac8-4fcc-8064-6dbb8d113dae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:02:44.980164 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac4a432-2ac8-4fcc-8064-6dbb8d113dae admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:02:45.001518 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1194/2420] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Oct 9 01:02:44 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 09 01:02:45.003384 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345328b8-588e-44bb-8841-8533dc147bc9 admin admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:02:45.027105 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345328b8-588e-44bb-8841-8533dc147bc9 admin admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:02:45.047458 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651d61ad-cd3c-45de-9500-6a5050f74a30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:02:45.065368 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651d61ad-cd3c-45de-9500-6a5050f74a30 admin admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:02:45.065855 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651d61ad-cd3c-45de-9500-6a5050f74a30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:02:45.066232 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651d61ad-cd3c-45de-9500-6a5050f74a30 admin admin] PATH_INFO: `/v3/roles` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:02:45.067051 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651d61ad-cd3c-45de-9500-6a5050f74a30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:02:45.069227 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651d61ad-cd3c-45de-9500-6a5050f74a30 admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:02:45.098636 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1227/2421] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Oct 9 01:02:45 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 09 01:02:45.101652 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac4a432-2ac8-4fcc-8064-6dbb8d113dae admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:02:45.123848 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac4a432-2ac8-4fcc-8064-6dbb8d113dae admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:02:45.176222 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98409de2-d6a8-4c83-9558-da256858c92c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:02:45.176721 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98409de2-d6a8-4c83-9558-da256858c92c admin admin] REQUEST_METHOD: `PUT` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:02:45.176995 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98409de2-d6a8-4c83-9558-da256858c92c admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:02:45.177263 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98409de2-d6a8-4c83-9558-da256858c92c admin admin] PATH_INFO: `/v3/projects/8b5e8a0be5cd46e8a7797b0da60ced76/users/a50e84cc220541aab9a883d8e99db444/roles/afb0a01183d9497795eaa4fa1a4046ae` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:02:45.214378 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98409de2-d6a8-4c83-9558-da256858c92c admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b5e8a0be5cd46e8a7797b0da60ced76, user_id=a50e84cc220541aab9a883d8e99db444, role_id=afb0a01183d9497795eaa4fa1a4046ae)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:02:45.218839 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98409de2-d6a8-4c83-9558-da256858c92c admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:02:45.241531 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1195/2422] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Oct 9 01:02:45 2022] PUT /identity/v3/projects/8b5e8a0be5cd46e8a7797b0da60ced76/users/a50e84cc220541aab9a883d8e99db444/roles/afb0a01183d9497795eaa4fa1a4046ae => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 01:02:45.261259 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96f22bf-6f67-46c2-9ec2-82126e97be2c None None] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:02:45.263053 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96f22bf-6f67-46c2-9ec2-82126e97be2c None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:02:45.263590 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96f22bf-6f67-46c2-9ec2-82126e97be2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:02:45.307882 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.auth.core [None req-a96f22bf-6f67-46c2-9ec2-82126e97be2c None None] MFA Rules not processed for user `a50e84cc220541aab9a883d8e99db444`. Rule list: `[]` (Enabled: `True`). {{(pid=81525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 01:02:45.309706 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-a96f22bf-6f67-46c2-9ec2-82126e97be2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:02:45.422669 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 01:02:45.464707 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1228/2423] 10.222.0.15 () {58 vars in 958 bytes} [Sun Oct 9 01:02:45 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 01:02:45.481194 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98409de2-d6a8-4c83-9558-da256858c92c admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:02:45.483525 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-98409de2-d6a8-4c83-9558-da256858c92c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:02:45.607412 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98409de2-d6a8-4c83-9558-da256858c92c admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:02:45.617292 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e0f42d-6b99-479b-b7b4-53cc94f483a1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ac83d57fba841e0a666710732249c49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f148d39ced534860abfbe8fc3f98ace4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:02:45.617891 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e0f42d-6b99-479b-b7b4-53cc94f483a1 service nova] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:02:45.618099 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e0f42d-6b99-479b-b7b4-53cc94f483a1 service nova] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:02:45.618482 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e0f42d-6b99-479b-b7b4-53cc94f483a1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:02:45.635182 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e0f42d-6b99-479b-b7b4-53cc94f483a1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:02:45.637020 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e0f42d-6b99-479b-b7b4-53cc94f483a1 service nova] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:02:45.652890 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1196/2424] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Oct 9 01:02:45 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 09 01:02:46.133540 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028e828b-8c10-4bb8-a19b-f5c2525ed96b None None] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:02:46.134262 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028e828b-8c10-4bb8-a19b-f5c2525ed96b None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:02:46.134467 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028e828b-8c10-4bb8-a19b-f5c2525ed96b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:02:46.167154 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.auth.core [None req-028e828b-8c10-4bb8-a19b-f5c2525ed96b None None] MFA Rules not processed for user `3a6cfef106c84f759ce0874be77f7380`. Rule list: `[]` (Enabled: `True`). {{(pid=81525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 01:02:46.168503 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-028e828b-8c10-4bb8-a19b-f5c2525ed96b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:02:46.230598 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1229/2425] 10.222.0.15 () {58 vars in 967 bytes} [Sun Oct 9 01:02:46 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 01:02:46.254206 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e0f42d-6b99-479b-b7b4-53cc94f483a1 service nova] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:02:46.256331 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-20e0f42d-6b99-479b-b7b4-53cc94f483a1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:02:46.339724 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e0f42d-6b99-479b-b7b4-53cc94f483a1 service nova] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:02:46.346141 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562bad6a-2abb-471e-9f0f-644949721a82 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4c467943b8f4d31a2f067ca6ed3b25c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f148d39ced534860abfbe8fc3f98ace4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:02:46.346799 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562bad6a-2abb-471e-9f0f-644949721a82 service swift] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:02:46.347075 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562bad6a-2abb-471e-9f0f-644949721a82 service swift] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:02:46.347374 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562bad6a-2abb-471e-9f0f-644949721a82 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:02:46.357189 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562bad6a-2abb-471e-9f0f-644949721a82 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:02:46.358826 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562bad6a-2abb-471e-9f0f-644949721a82 service swift] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:02:46.368568 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1197/2426] 10.222.0.15 () {60 vars in 1384 bytes} [Sun Oct 9 01:02:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 09 01:02:48.163622 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028e828b-8c10-4bb8-a19b-f5c2525ed96b None None] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:02:48.165838 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-028e828b-8c10-4bb8-a19b-f5c2525ed96b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:02:48.304260 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028e828b-8c10-4bb8-a19b-f5c2525ed96b None None] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:02:48.324463 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81070a9-1ad4-4f31-a365-62125a872af8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4ef90d456d2483e8ddafbe2d4d4fb5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f148d39ced534860abfbe8fc3f98ace4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:02:48.325961 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81070a9-1ad4-4f31-a365-62125a872af8 service neutron] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:02:48.326418 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81070a9-1ad4-4f31-a365-62125a872af8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:02:48.326894 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81070a9-1ad4-4f31-a365-62125a872af8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:02:48.329626 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-c81070a9-1ad4-4f31-a365-62125a872af8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:02:48.433338 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81070a9-1ad4-4f31-a365-62125a872af8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:02:48.436247 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81070a9-1ad4-4f31-a365-62125a872af8 service neutron] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:02:48.457340 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1230/2427] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Oct 9 01:02:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 09 01:02:48.588720 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562bad6a-2abb-471e-9f0f-644949721a82 service swift] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:02:48.613554 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562bad6a-2abb-471e-9f0f-644949721a82 service swift] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:02:48.624912 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a661af-0096-40f3-9f71-45dc15c4b3b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:02:48.626010 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a661af-0096-40f3-9f71-45dc15c4b3b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:02:48.626522 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a661af-0096-40f3-9f71-45dc15c4b3b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:02:48.627351 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a661af-0096-40f3-9f71-45dc15c4b3b3 admin admin] PATH_INFO: `/v3/users/a50e84cc220541aab9a883d8e99db444` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:02:48.631127 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a661af-0096-40f3-9f71-45dc15c4b3b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a50e84cc220541aab9a883d8e99db444)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:02:48.634198 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a661af-0096-40f3-9f71-45dc15c4b3b3 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:02:48.688282 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 01:02:48.714555 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-58a661af-0096-40f3-9f71-45dc15c4b3b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a50e84cc220541aab9a883d8e99db444'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:02:48.723398 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-58a661af-0096-40f3-9f71-45dc15c4b3b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a50e84cc220541aab9a883d8e99db444'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:02:48.725782 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-58a661af-0096-40f3-9f71-45dc15c4b3b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a50e84cc220541aab9a883d8e99db444'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:02:48.727435 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-58a661af-0096-40f3-9f71-45dc15c4b3b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a50e84cc220541aab9a883d8e99db444'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:02:48.740781 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-58a661af-0096-40f3-9f71-45dc15c4b3b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a50e84cc220541aab9a883d8e99db444'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:02:48.765834 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1198/2428] 10.222.0.15 () {58 vars in 1224 bytes} [Sun Oct 9 01:02:48 2022] DELETE /identity/v3/users/a50e84cc220541aab9a883d8e99db444 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 01:02:48.771183 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c39fd58-5948-4a30-9159-a84cf9ee4148 None None] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:02:48.772019 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c39fd58-5948-4a30-9159-a84cf9ee4148 None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:02:48.772555 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c39fd58-5948-4a30-9159-a84cf9ee4148 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:02:48.797955 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.auth.core [None req-5c39fd58-5948-4a30-9159-a84cf9ee4148 None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 01:02:48.799943 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-5c39fd58-5948-4a30-9159-a84cf9ee4148 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:02:48.868696 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 01:02:48.893547 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1231/2429] 10.222.0.15 () {58 vars in 958 bytes} [Sun Oct 9 01:02:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 01:02:48.906581 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a661af-0096-40f3-9f71-45dc15c4b3b3 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:02:48.908295 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-58a661af-0096-40f3-9f71-45dc15c4b3b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:02:49.002319 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a661af-0096-40f3-9f71-45dc15c4b3b3 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:02:49.010630 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0002f838-16c0-41a2-88c2-e758a62c6bdc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4ef90d456d2483e8ddafbe2d4d4fb5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f148d39ced534860abfbe8fc3f98ace4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:02:49.010630 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0002f838-16c0-41a2-88c2-e758a62c6bdc service neutron] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:02:49.012677 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0002f838-16c0-41a2-88c2-e758a62c6bdc service neutron] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:02:49.012677 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0002f838-16c0-41a2-88c2-e758a62c6bdc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:02:49.030284 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0002f838-16c0-41a2-88c2-e758a62c6bdc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:02:49.034884 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0002f838-16c0-41a2-88c2-e758a62c6bdc service neutron] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:02:49.063245 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1199/2430] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Oct 9 01:02:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 09 01:02:49.873421 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c39fd58-5948-4a30-9159-a84cf9ee4148 None None] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:02:49.876126 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-5c39fd58-5948-4a30-9159-a84cf9ee4148 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:02:49.905181 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c39fd58-5948-4a30-9159-a84cf9ee4148 None None] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:02:49.933612 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c832c999-e49f-4270-972f-eda3ce4e344e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:02:49.935113 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c832c999-e49f-4270-972f-eda3ce4e344e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:02:49.936107 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c832c999-e49f-4270-972f-eda3ce4e344e admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:02:49.936833 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c832c999-e49f-4270-972f-eda3ce4e344e admin admin] PATH_INFO: `/v3/projects/8b5e8a0be5cd46e8a7797b0da60ced76` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:02:49.940542 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c832c999-e49f-4270-972f-eda3ce4e344e admin admin] RBAC: Authorizing `identity:delete_project(project_id=8b5e8a0be5cd46e8a7797b0da60ced76)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:02:49.950201 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c832c999-e49f-4270-972f-eda3ce4e344e admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:02:50.184697 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-c832c999-e49f-4270-972f-eda3ce4e344e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b5e8a0be5cd46e8a7797b0da60ced76', 'request_id': 'req-c832c999-e49f-4270-972f-eda3ce4e344e'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:02:50.195599 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-c832c999-e49f-4270-972f-eda3ce4e344e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b5e8a0be5cd46e8a7797b0da60ced76', 'request_id': 'req-c832c999-e49f-4270-972f-eda3ce4e344e'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:02:50.205425 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-c832c999-e49f-4270-972f-eda3ce4e344e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b5e8a0be5cd46e8a7797b0da60ced76', 'request_id': 'req-c832c999-e49f-4270-972f-eda3ce4e344e'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:02:50.222598 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-c832c999-e49f-4270-972f-eda3ce4e344e admin admin] The token cache is being invalidate because project 8b5e8a0be5cd46e8a7797b0da60ced76 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81525) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 09 01:02:50.222988 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-c832c999-e49f-4270-972f-eda3ce4e344e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:02:50.223836 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-c832c999-e49f-4270-972f-eda3ce4e344e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:02:50.225514 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1232/2431] 10.222.0.15 () {58 vars in 1233 bytes} [Sun Oct 9 01:02:49 2022] DELETE /identity/v3/projects/8b5e8a0be5cd46e8a7797b0da60ced76 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 01:02:50.232745 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ce30ed-5904-4391-a500-296164f4bbf7 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:02:50.233659 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ce30ed-5904-4391-a500-296164f4bbf7 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:02:50.233844 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ce30ed-5904-4391-a500-296164f4bbf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:02:50.262904 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-f1ce30ed-5904-4391-a500-296164f4bbf7 None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 01:02:50.269807 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-f1ce30ed-5904-4391-a500-296164f4bbf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:02:50.378703 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1200/2432] 10.222.0.15 () {58 vars in 958 bytes} [Sun Oct 9 01:02:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 09 01:02:50.391549 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1cfad3-9535-44c2-97a3-af9ad605f968 None None] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:02:50.392033 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1cfad3-9535-44c2-97a3-af9ad605f968 None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:02:50.392492 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1cfad3-9535-44c2-97a3-af9ad605f968 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:02:50.433279 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.auth.core [None req-7b1cfad3-9535-44c2-97a3-af9ad605f968 None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 01:02:50.435634 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-7b1cfad3-9535-44c2-97a3-af9ad605f968 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:02:50.454097 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1233/2433] 10.222.0.15 () {58 vars in 958 bytes} [Sun Oct 9 01:02:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 09 01:02:50.459605 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ce30ed-5904-4391-a500-296164f4bbf7 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:02:50.478083 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ce30ed-5904-4391-a500-296164f4bbf7 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:02:50.486706 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701e6203-9933-4636-8192-e034d5e16262 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:02:50.488015 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701e6203-9933-4636-8192-e034d5e16262 admin admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:02:50.488343 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701e6203-9933-4636-8192-e034d5e16262 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:02:50.488767 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701e6203-9933-4636-8192-e034d5e16262 admin admin] PATH_INFO: `/v3/domains` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:02:50.490925 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701e6203-9933-4636-8192-e034d5e16262 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 01:02:50.491218 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701e6203-9933-4636-8192-e034d5e16262 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:02:50.493278 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701e6203-9933-4636-8192-e034d5e16262 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:02:50.507655 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1201/2434] 10.222.0.15 () {58 vars in 1153 bytes} [Sun Oct 9 01:02:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 01:02:50.513117 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1cfad3-9535-44c2-97a3-af9ad605f968 None None] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:02:50.527656 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1cfad3-9535-44c2-97a3-af9ad605f968 None None] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:02:50.534228 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9e8a58-2915-48df-84df-1a2f34276718 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:02:50.535300 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9e8a58-2915-48df-84df-1a2f34276718 admin admin] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:02:50.535714 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9e8a58-2915-48df-84df-1a2f34276718 admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:02:50.536167 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9e8a58-2915-48df-84df-1a2f34276718 admin admin] PATH_INFO: `/v3/projects` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:02:50.537066 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9e8a58-2915-48df-84df-1a2f34276718 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:02:50.540295 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9e8a58-2915-48df-84df-1a2f34276718 admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:02:50.579319 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1234/2435] 10.222.0.15 () {60 vars in 1153 bytes} [Sun Oct 9 01:02:50 2022] POST /identity/v3/projects => generated 369 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 09 01:02:50.584210 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701e6203-9933-4636-8192-e034d5e16262 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:02:50.596791 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701e6203-9933-4636-8192-e034d5e16262 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:02:50.645838 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 01:02:50.695766 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601887f9-65b6-4f7b-9410-a801bd7ba809 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:02:50.696488 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601887f9-65b6-4f7b-9410-a801bd7ba809 admin admin] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:02:50.697543 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601887f9-65b6-4f7b-9410-a801bd7ba809 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:02:50.697853 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601887f9-65b6-4f7b-9410-a801bd7ba809 admin admin] PATH_INFO: `/v3/users` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:02:50.698724 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601887f9-65b6-4f7b-9410-a801bd7ba809 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:02:50.702742 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601887f9-65b6-4f7b-9410-a801bd7ba809 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:02:50.736156 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1202/2436] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Oct 9 01:02:50 2022] POST /identity/v3/users => generated 285 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 09 01:02:50.742380 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9e8a58-2915-48df-84df-1a2f34276718 admin admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:02:50.767929 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9e8a58-2915-48df-84df-1a2f34276718 admin admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:02:50.776836 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f69868-4a43-4f88-afaa-8cae913f30e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:02:50.777979 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f69868-4a43-4f88-afaa-8cae913f30e1 admin admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:02:50.778465 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f69868-4a43-4f88-afaa-8cae913f30e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:02:50.778935 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f69868-4a43-4f88-afaa-8cae913f30e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:02:50.780481 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f69868-4a43-4f88-afaa-8cae913f30e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:02:50.784817 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f69868-4a43-4f88-afaa-8cae913f30e1 admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:02:50.815005 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1235/2437] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Oct 9 01:02:50 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 09 01:02:50.817499 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601887f9-65b6-4f7b-9410-a801bd7ba809 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:02:50.840568 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601887f9-65b6-4f7b-9410-a801bd7ba809 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:02:50.853912 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3769242a-15ee-4213-8332-602f7aefba00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:02:50.854622 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3769242a-15ee-4213-8332-602f7aefba00 admin admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:02:50.854965 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3769242a-15ee-4213-8332-602f7aefba00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:02:50.855351 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3769242a-15ee-4213-8332-602f7aefba00 admin admin] PATH_INFO: `/v3/roles` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:02:50.856118 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3769242a-15ee-4213-8332-602f7aefba00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:02:50.857908 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3769242a-15ee-4213-8332-602f7aefba00 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:02:50.875472 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1203/2438] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Oct 9 01:02:50 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 09 01:02:50.880801 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f69868-4a43-4f88-afaa-8cae913f30e1 admin admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:02:50.902544 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f69868-4a43-4f88-afaa-8cae913f30e1 admin admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:02:50.911691 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3769242a-15ee-4213-8332-602f7aefba00 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:02:50.915046 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-3769242a-15ee-4213-8332-602f7aefba00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:02:50.923300 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f75cf36-f035-4d21-8d1d-f3fe88e1b369 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:02:50.924183 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f75cf36-f035-4d21-8d1d-f3fe88e1b369 admin admin] REQUEST_METHOD: `PUT` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:02:50.924563 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f75cf36-f035-4d21-8d1d-f3fe88e1b369 admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:02:50.924933 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f75cf36-f035-4d21-8d1d-f3fe88e1b369 admin admin] PATH_INFO: `/v3/projects/09d90e6e99094d60b38d4e13a267d851/users/9bf08bd829e14e9288ab2cba63f3a856/roles/afb0a01183d9497795eaa4fa1a4046ae` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:02:50.931681 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3769242a-15ee-4213-8332-602f7aefba00 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:02:50.936818 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1956239f-4156-45d6-9d44-f24b81293d38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:02:50.937477 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1956239f-4156-45d6-9d44-f24b81293d38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:02:50.937753 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1956239f-4156-45d6-9d44-f24b81293d38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:02:50.938031 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1956239f-4156-45d6-9d44-f24b81293d38 admin admin] PATH_INFO: `/v3/users/82d90b1a21ff4504a610146af089af20` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:02:50.940159 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1956239f-4156-45d6-9d44-f24b81293d38 admin admin] RBAC: Authorizing `identity:delete_user(user_id=82d90b1a21ff4504a610146af089af20)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:02:50.942035 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1956239f-4156-45d6-9d44-f24b81293d38 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:02:50.956866 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f75cf36-f035-4d21-8d1d-f3fe88e1b369 admin admin] RBAC: Authorizing `identity:create_grant(project_id=09d90e6e99094d60b38d4e13a267d851, user_id=9bf08bd829e14e9288ab2cba63f3a856, role_id=afb0a01183d9497795eaa4fa1a4046ae)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:02:50.960410 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f75cf36-f035-4d21-8d1d-f3fe88e1b369 admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:02:50.995301 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1236/2439] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Oct 9 01:02:50 2022] PUT /identity/v3/projects/09d90e6e99094d60b38d4e13a267d851/users/9bf08bd829e14e9288ab2cba63f3a856/roles/afb0a01183d9497795eaa4fa1a4046ae => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 01:02:51.017781 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7a5a14-82c0-4169-9b06-2612d684792d None None] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:02:51.019878 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7a5a14-82c0-4169-9b06-2612d684792d None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:02:51.021960 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7a5a14-82c0-4169-9b06-2612d684792d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:02:51.036107 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-1956239f-4156-45d6-9d44-f24b81293d38 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '82d90b1a21ff4504a610146af089af20'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:02:51.052284 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-1956239f-4156-45d6-9d44-f24b81293d38 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '82d90b1a21ff4504a610146af089af20'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:02:51.053598 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-1956239f-4156-45d6-9d44-f24b81293d38 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '82d90b1a21ff4504a610146af089af20'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:02:51.054703 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-1956239f-4156-45d6-9d44-f24b81293d38 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '82d90b1a21ff4504a610146af089af20'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:02:51.078226 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-1956239f-4156-45d6-9d44-f24b81293d38 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '82d90b1a21ff4504a610146af089af20'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:02:51.111958 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.auth.core [None req-5a7a5a14-82c0-4169-9b06-2612d684792d None None] MFA Rules not processed for user `9bf08bd829e14e9288ab2cba63f3a856`. Rule list: `[]` (Enabled: `True`). {{(pid=81525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 01:02:51.120766 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-5a7a5a14-82c0-4169-9b06-2612d684792d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:02:51.142525 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1204/2440] 10.222.0.15 () {58 vars in 1224 bytes} [Sun Oct 9 01:02:50 2022] DELETE /identity/v3/users/82d90b1a21ff4504a610146af089af20 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 01:02:51.148757 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866fe12e-def7-46ca-9be4-665310da2fcb None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:02:51.149956 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866fe12e-def7-46ca-9be4-665310da2fcb None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:02:51.150713 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866fe12e-def7-46ca-9be4-665310da2fcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:02:51.213569 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-866fe12e-def7-46ca-9be4-665310da2fcb None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 01:02:51.219453 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-866fe12e-def7-46ca-9be4-665310da2fcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:02:51.285694 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 01:02:51.336369 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1237/2441] 10.222.0.15 () {58 vars in 958 bytes} [Sun Oct 9 01:02:51 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 324 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 01:02:51.342802 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7a5a14-82c0-4169-9b06-2612d684792d None None] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:02:51.346304 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-5a7a5a14-82c0-4169-9b06-2612d684792d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:02:51.425554 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1205/2442] 10.222.0.15 () {58 vars in 958 bytes} [Sun Oct 9 01:02:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 01:02:51.463368 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866fe12e-def7-46ca-9be4-665310da2fcb None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:02:51.465826 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-866fe12e-def7-46ca-9be4-665310da2fcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:02:51.544745 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7a5a14-82c0-4169-9b06-2612d684792d None None] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:02:51.550461 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ff1733-e043-4446-8b21-27de2d839f73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:02:51.551154 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ff1733-e043-4446-8b21-27de2d839f73 admin admin] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:02:51.551462 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ff1733-e043-4446-8b21-27de2d839f73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:02:51.551729 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ff1733-e043-4446-8b21-27de2d839f73 admin admin] PATH_INFO: `/v3/projects` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:02:51.552373 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ff1733-e043-4446-8b21-27de2d839f73 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:02:51.554442 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ff1733-e043-4446-8b21-27de2d839f73 admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:02:51.580961 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 01:02:51.619653 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1238/2443] 10.222.0.15 () {60 vars in 1153 bytes} [Sun Oct 9 01:02:51 2022] POST /identity/v3/projects => generated 369 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 09 01:02:51.622176 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ff1733-e043-4446-8b21-27de2d839f73 admin admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:02:51.639805 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866fe12e-def7-46ca-9be4-665310da2fcb None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:02:51.756074 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b317a917-ff72-493e-a233-7dca5b484f45 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4ef90d456d2483e8ddafbe2d4d4fb5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f148d39ced534860abfbe8fc3f98ace4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:02:51.757168 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b317a917-ff72-493e-a233-7dca5b484f45 service neutron] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:02:51.757645 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b317a917-ff72-493e-a233-7dca5b484f45 service neutron] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:02:51.758119 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b317a917-ff72-493e-a233-7dca5b484f45 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:02:51.776781 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ff1733-e043-4446-8b21-27de2d839f73 admin admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:02:51.778973 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b317a917-ff72-493e-a233-7dca5b484f45 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:02:51.783244 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b317a917-ff72-493e-a233-7dca5b484f45 service neutron] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:02:51.786029 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0920d05f-fa72-48ad-a82b-61ef164a38b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:02:51.786407 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0920d05f-fa72-48ad-a82b-61ef164a38b8 admin admin] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:02:51.786771 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0920d05f-fa72-48ad-a82b-61ef164a38b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:02:51.787248 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0920d05f-fa72-48ad-a82b-61ef164a38b8 admin admin] PATH_INFO: `/v3/users` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:02:51.788531 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0920d05f-fa72-48ad-a82b-61ef164a38b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:02:51.792375 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0920d05f-fa72-48ad-a82b-61ef164a38b8 admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:02:51.814314 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1206/2444] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Oct 9 01:02:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 09 01:02:51.837633 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1239/2445] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Oct 9 01:02:51 2022] POST /identity/v3/users => generated 291 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 09 01:02:51.845485 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b317a917-ff72-493e-a233-7dca5b484f45 service neutron] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:02:51.864628 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b317a917-ff72-493e-a233-7dca5b484f45 service neutron] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:02:51.876211 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776dfeb3-7beb-4349-9ed7-b3c0358d43ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:02:51.877550 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776dfeb3-7beb-4349-9ed7-b3c0358d43ef admin admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:02:51.878198 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776dfeb3-7beb-4349-9ed7-b3c0358d43ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:02:51.878681 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776dfeb3-7beb-4349-9ed7-b3c0358d43ef admin admin] PATH_INFO: `/v3/roles` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:02:51.880072 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776dfeb3-7beb-4349-9ed7-b3c0358d43ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:02:51.883110 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776dfeb3-7beb-4349-9ed7-b3c0358d43ef admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:02:51.908204 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1207/2446] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Oct 9 01:02:51 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 09 01:02:51.908514 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0920d05f-fa72-48ad-a82b-61ef164a38b8 admin admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:02:51.932932 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0920d05f-fa72-48ad-a82b-61ef164a38b8 admin admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:02:51.941862 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bdf1d7-d266-4032-b2ba-a8b060d62202 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:02:51.943654 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bdf1d7-d266-4032-b2ba-a8b060d62202 admin admin] REQUEST_METHOD: `PUT` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:02:51.944425 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bdf1d7-d266-4032-b2ba-a8b060d62202 admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:02:51.944964 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bdf1d7-d266-4032-b2ba-a8b060d62202 admin admin] PATH_INFO: `/v3/projects/578f83af27b04f959c79832a3e920766/users/3101e1e9816043dd94a9a45509cb8fd6/roles/f69dddf26daf4dd79d4c962beb877af5` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:02:51.976891 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bdf1d7-d266-4032-b2ba-a8b060d62202 admin admin] RBAC: Authorizing `identity:create_grant(project_id=578f83af27b04f959c79832a3e920766, user_id=3101e1e9816043dd94a9a45509cb8fd6, role_id=f69dddf26daf4dd79d4c962beb877af5)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:02:51.982578 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bdf1d7-d266-4032-b2ba-a8b060d62202 admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:02:52.017458 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1240/2447] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Oct 9 01:02:51 2022] PUT /identity/v3/projects/578f83af27b04f959c79832a3e920766/users/3101e1e9816043dd94a9a45509cb8fd6/roles/f69dddf26daf4dd79d4c962beb877af5 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 09 01:02:52.023298 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776dfeb3-7beb-4349-9ed7-b3c0358d43ef admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:02:52.058489 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776dfeb3-7beb-4349-9ed7-b3c0358d43ef admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:02:52.211721 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f603e5e7-bf38-4f25-97b1-63b2af5d3e7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:02:52.214282 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f603e5e7-bf38-4f25-97b1-63b2af5d3e7c admin admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:02:52.214951 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f603e5e7-bf38-4f25-97b1-63b2af5d3e7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:02:52.216002 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f603e5e7-bf38-4f25-97b1-63b2af5d3e7c admin admin] PATH_INFO: `/v3/roles` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:02:52.217324 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f603e5e7-bf38-4f25-97b1-63b2af5d3e7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:02:52.221746 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f603e5e7-bf38-4f25-97b1-63b2af5d3e7c admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:02:52.251361 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1208/2448] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Oct 9 01:02:52 2022] GET /identity/v3/roles => generated 1420 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 09 01:02:52.252678 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bdf1d7-d266-4032-b2ba-a8b060d62202 admin admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:02:52.294590 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bdf1d7-d266-4032-b2ba-a8b060d62202 admin admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:02:52.307523 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c383cffc-561e-4f82-ac52-d024adca0d55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:02:52.308969 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c383cffc-561e-4f82-ac52-d024adca0d55 admin admin] REQUEST_METHOD: `PUT` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:02:52.309631 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c383cffc-561e-4f82-ac52-d024adca0d55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:02:52.310286 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c383cffc-561e-4f82-ac52-d024adca0d55 admin admin] PATH_INFO: `/v3/projects/578f83af27b04f959c79832a3e920766/users/3101e1e9816043dd94a9a45509cb8fd6/roles/f69dddf26daf4dd79d4c962beb877af5` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:02:52.314673 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c383cffc-561e-4f82-ac52-d024adca0d55 admin admin] RBAC: Authorizing `identity:create_grant(project_id=578f83af27b04f959c79832a3e920766, user_id=3101e1e9816043dd94a9a45509cb8fd6, role_id=f69dddf26daf4dd79d4c962beb877af5)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:02:52.322425 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c383cffc-561e-4f82-ac52-d024adca0d55 admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:02:52.388732 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781906e2-a97a-4829-a8f8-d8dd3d9eee9c None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:02:52.390089 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781906e2-a97a-4829-a8f8-d8dd3d9eee9c None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:02:52.390880 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781906e2-a97a-4829-a8f8-d8dd3d9eee9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:02:52.396402 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1241/2449] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Oct 9 01:02:52 2022] PUT /identity/v3/projects/578f83af27b04f959c79832a3e920766/users/3101e1e9816043dd94a9a45509cb8fd6/roles/f69dddf26daf4dd79d4c962beb877af5 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 01:02:52.501734 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-781906e2-a97a-4829-a8f8-d8dd3d9eee9c None None] MFA Rules not processed for user `3101e1e9816043dd94a9a45509cb8fd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 01:02:52.505534 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-781906e2-a97a-4829-a8f8-d8dd3d9eee9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:02:52.676758 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 01:02:52.688109 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1209/2450] 10.222.0.15 () {58 vars in 958 bytes} [Sun Oct 9 01:02:52 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 304 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 01:02:52.718081 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c383cffc-561e-4f82-ac52-d024adca0d55 admin admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:02:52.721653 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-c383cffc-561e-4f82-ac52-d024adca0d55 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:02:52.830189 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 01:02:52.899137 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c383cffc-561e-4f82-ac52-d024adca0d55 admin admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:02:52.907102 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42eaf19-f4df-4305-9ee0-b2b5fa8d7974 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff7cb78bcd91467abe5c2e2b48aedd1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f148d39ced534860abfbe8fc3f98ace4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:02:52.908753 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42eaf19-f4df-4305-9ee0-b2b5fa8d7974 service cinder] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:02:52.908753 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42eaf19-f4df-4305-9ee0-b2b5fa8d7974 service cinder] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:02:52.909832 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42eaf19-f4df-4305-9ee0-b2b5fa8d7974 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:02:52.931037 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42eaf19-f4df-4305-9ee0-b2b5fa8d7974 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:02:52.934488 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42eaf19-f4df-4305-9ee0-b2b5fa8d7974 service cinder] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:02:52.976046 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1242/2451] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Oct 9 01:02:52 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 09 01:02:53.092265 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781906e2-a97a-4829-a8f8-d8dd3d9eee9c None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:02:53.096282 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-781906e2-a97a-4829-a8f8-d8dd3d9eee9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:02:53.124341 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781906e2-a97a-4829-a8f8-d8dd3d9eee9c None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:02:53.131233 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5f12a1-f28c-4645-b0d8-b2d97a8b1830 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff7cb78bcd91467abe5c2e2b48aedd1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f148d39ced534860abfbe8fc3f98ace4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:02:53.132587 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5f12a1-f28c-4645-b0d8-b2d97a8b1830 service cinder] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:02:53.133129 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5f12a1-f28c-4645-b0d8-b2d97a8b1830 service cinder] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:02:53.133672 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5f12a1-f28c-4645-b0d8-b2d97a8b1830 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:02:53.261661 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42eaf19-f4df-4305-9ee0-b2b5fa8d7974 service cinder] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:02:53.264490 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-d42eaf19-f4df-4305-9ee0-b2b5fa8d7974 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:02:53.304874 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5f12a1-f28c-4645-b0d8-b2d97a8b1830 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:02:53.308575 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5f12a1-f28c-4645-b0d8-b2d97a8b1830 service cinder] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:02:53.352579 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1210/2452] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Oct 9 01:02:53 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 09 01:02:53.556060 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42eaf19-f4df-4305-9ee0-b2b5fa8d7974 service cinder] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:02:53.578775 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f50e10-e791-4036-bb1e-9e1a06fe2d94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:02:53.579780 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f50e10-e791-4036-bb1e-9e1a06fe2d94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:02:53.580239 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f50e10-e791-4036-bb1e-9e1a06fe2d94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:02:53.580690 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f50e10-e791-4036-bb1e-9e1a06fe2d94 admin admin] PATH_INFO: `/v3/projects/0ddeb547e85f40dfa922675a5df6be76` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:02:53.584668 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f50e10-e791-4036-bb1e-9e1a06fe2d94 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0ddeb547e85f40dfa922675a5df6be76)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:02:53.590989 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f50e10-e791-4036-bb1e-9e1a06fe2d94 admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:02:53.742519 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-a6f50e10-e791-4036-bb1e-9e1a06fe2d94 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0ddeb547e85f40dfa922675a5df6be76', 'request_id': 'req-a6f50e10-e791-4036-bb1e-9e1a06fe2d94'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:02:53.778986 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-a6f50e10-e791-4036-bb1e-9e1a06fe2d94 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0ddeb547e85f40dfa922675a5df6be76', 'request_id': 'req-a6f50e10-e791-4036-bb1e-9e1a06fe2d94'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:02:53.808874 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-a6f50e10-e791-4036-bb1e-9e1a06fe2d94 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0ddeb547e85f40dfa922675a5df6be76', 'request_id': 'req-a6f50e10-e791-4036-bb1e-9e1a06fe2d94'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:02:53.845916 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-a6f50e10-e791-4036-bb1e-9e1a06fe2d94 admin admin] The token cache is being invalidate because project 0ddeb547e85f40dfa922675a5df6be76 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81525) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 09 01:02:53.846399 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-a6f50e10-e791-4036-bb1e-9e1a06fe2d94 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:02:53.848000 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-a6f50e10-e791-4036-bb1e-9e1a06fe2d94 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:02:53.851046 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1243/2453] 10.222.0.15 () {58 vars in 1233 bytes} [Sun Oct 9 01:02:53 2022] DELETE /identity/v3/projects/0ddeb547e85f40dfa922675a5df6be76 => generated 0 bytes in 591 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 01:02:53.855838 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5f12a1-f28c-4645-b0d8-b2d97a8b1830 service cinder] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:02:53.893522 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5f12a1-f28c-4645-b0d8-b2d97a8b1830 service cinder] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:02:54.035445 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b484e12-143e-4faf-9bae-b3f99bc983b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:02:54.036292 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b484e12-143e-4faf-9bae-b3f99bc983b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:02:54.037377 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b484e12-143e-4faf-9bae-b3f99bc983b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:02:54.037789 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b484e12-143e-4faf-9bae-b3f99bc983b7 admin admin] PATH_INFO: `/v3/users/2928f3a77a1641eebc1ea04706af7498` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:02:54.039633 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b484e12-143e-4faf-9bae-b3f99bc983b7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2928f3a77a1641eebc1ea04706af7498)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:02:54.043283 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b484e12-143e-4faf-9bae-b3f99bc983b7 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:02:54.188405 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-0b484e12-143e-4faf-9bae-b3f99bc983b7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2928f3a77a1641eebc1ea04706af7498'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:02:54.203550 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-0b484e12-143e-4faf-9bae-b3f99bc983b7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2928f3a77a1641eebc1ea04706af7498'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:02:54.207856 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-0b484e12-143e-4faf-9bae-b3f99bc983b7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2928f3a77a1641eebc1ea04706af7498'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:02:54.209307 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-0b484e12-143e-4faf-9bae-b3f99bc983b7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2928f3a77a1641eebc1ea04706af7498'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:02:54.228393 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-0b484e12-143e-4faf-9bae-b3f99bc983b7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2928f3a77a1641eebc1ea04706af7498'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:02:54.273714 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1211/2454] 10.222.0.15 () {58 vars in 1224 bytes} [Sun Oct 9 01:02:53 2022] DELETE /identity/v3/users/2928f3a77a1641eebc1ea04706af7498 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 09 01:02:54.994449 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f50e10-e791-4036-bb1e-9e1a06fe2d94 admin admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:02:54.998499 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-a6f50e10-e791-4036-bb1e-9e1a06fe2d94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:02:55.048963 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f50e10-e791-4036-bb1e-9e1a06fe2d94 admin admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:02:55.231445 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5138b4-e690-40dc-94a3-a8704f816e23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:02:55.232752 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5138b4-e690-40dc-94a3-a8704f816e23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:02:55.233234 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5138b4-e690-40dc-94a3-a8704f816e23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:02:55.247995 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5138b4-e690-40dc-94a3-a8704f816e23 admin admin] PATH_INFO: `/v3/projects/f9d4338abd494d63a4f8b9f0a80a396c` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:02:55.250523 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5138b4-e690-40dc-94a3-a8704f816e23 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f9d4338abd494d63a4f8b9f0a80a396c)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:02:55.254611 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5138b4-e690-40dc-94a3-a8704f816e23 admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:02:55.274971 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 01:02:55.479991 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-cb5138b4-e690-40dc-94a3-a8704f816e23 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f9d4338abd494d63a4f8b9f0a80a396c', 'request_id': 'req-cb5138b4-e690-40dc-94a3-a8704f816e23'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:02:55.507820 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-cb5138b4-e690-40dc-94a3-a8704f816e23 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f9d4338abd494d63a4f8b9f0a80a396c', 'request_id': 'req-cb5138b4-e690-40dc-94a3-a8704f816e23'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:02:55.553417 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-cb5138b4-e690-40dc-94a3-a8704f816e23 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f9d4338abd494d63a4f8b9f0a80a396c', 'request_id': 'req-cb5138b4-e690-40dc-94a3-a8704f816e23'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:02:55.602286 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-cb5138b4-e690-40dc-94a3-a8704f816e23 admin admin] The token cache is being invalidate because project f9d4338abd494d63a4f8b9f0a80a396c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81525) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 09 01:02:55.602665 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-cb5138b4-e690-40dc-94a3-a8704f816e23 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:02:55.605314 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-cb5138b4-e690-40dc-94a3-a8704f816e23 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:02:55.612758 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1244/2455] 10.222.0.15 () {58 vars in 1233 bytes} [Sun Oct 9 01:02:54 2022] DELETE /identity/v3/projects/f9d4338abd494d63a4f8b9f0a80a396c => generated 0 bytes in 619 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 01:02:55.619092 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744df38b-6007-46bf-8932-a3a3f9a1db53 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:02:55.620506 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744df38b-6007-46bf-8932-a3a3f9a1db53 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:02:55.621098 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744df38b-6007-46bf-8932-a3a3f9a1db53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:02:55.696408 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-744df38b-6007-46bf-8932-a3a3f9a1db53 None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 01:02:55.705129 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-744df38b-6007-46bf-8932-a3a3f9a1db53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:02:55.732471 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 01:02:55.837167 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1212/2456] 10.222.0.15 () {58 vars in 958 bytes} [Sun Oct 9 01:02:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 01:02:55.845920 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ec4725-7769-45bc-be2d-3b1db3c40050 None None] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:02:55.846492 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ec4725-7769-45bc-be2d-3b1db3c40050 None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:02:55.846920 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ec4725-7769-45bc-be2d-3b1db3c40050 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:02:55.890822 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.auth.core [None req-69ec4725-7769-45bc-be2d-3b1db3c40050 None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 01:02:55.893616 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-69ec4725-7769-45bc-be2d-3b1db3c40050 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:02:55.913723 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1245/2457] 10.222.0.15 () {58 vars in 958 bytes} [Sun Oct 9 01:02:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 01:02:55.918545 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744df38b-6007-46bf-8932-a3a3f9a1db53 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:02:55.939811 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744df38b-6007-46bf-8932-a3a3f9a1db53 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:02:55.949302 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552f112d-923a-4cc2-b709-85e8a5d8ae43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:02:55.950325 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552f112d-923a-4cc2-b709-85e8a5d8ae43 admin admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:02:55.950963 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552f112d-923a-4cc2-b709-85e8a5d8ae43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:02:55.959932 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552f112d-923a-4cc2-b709-85e8a5d8ae43 admin admin] PATH_INFO: `/v3/domains` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:02:55.960765 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552f112d-923a-4cc2-b709-85e8a5d8ae43 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 01:02:55.963946 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552f112d-923a-4cc2-b709-85e8a5d8ae43 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:02:55.968659 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552f112d-923a-4cc2-b709-85e8a5d8ae43 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:02:56.005451 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1213/2458] 10.222.0.15 () {58 vars in 1153 bytes} [Sun Oct 9 01:02:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 09 01:02:56.014845 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ec4725-7769-45bc-be2d-3b1db3c40050 None None] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:02:56.034771 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552f112d-923a-4cc2-b709-85e8a5d8ae43 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:02:56.042423 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-552f112d-923a-4cc2-b709-85e8a5d8ae43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:02:56.055282 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ec4725-7769-45bc-be2d-3b1db3c40050 None None] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:02:56.065825 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6434ce68-a23a-4712-bc41-52bf8bc633d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:02:56.067121 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6434ce68-a23a-4712-bc41-52bf8bc633d2 admin admin] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:02:56.067712 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6434ce68-a23a-4712-bc41-52bf8bc633d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:02:56.068268 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6434ce68-a23a-4712-bc41-52bf8bc633d2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:02:56.069223 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552f112d-923a-4cc2-b709-85e8a5d8ae43 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:02:56.070184 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6434ce68-a23a-4712-bc41-52bf8bc633d2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:02:56.073434 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6434ce68-a23a-4712-bc41-52bf8bc633d2 admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:02:56.077251 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f79153-aa89-4f18-890b-dde111682e58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:02:56.078034 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f79153-aa89-4f18-890b-dde111682e58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:02:56.078305 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f79153-aa89-4f18-890b-dde111682e58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:02:56.078830 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f79153-aa89-4f18-890b-dde111682e58 admin admin] PATH_INFO: `/v3/users/6a2d7675a1fe4301b2920c86a35312dd` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:02:56.080717 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f79153-aa89-4f18-890b-dde111682e58 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6a2d7675a1fe4301b2920c86a35312dd)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:02:56.083971 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f79153-aa89-4f18-890b-dde111682e58 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:02:56.142281 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1246/2459] 10.222.0.15 () {60 vars in 1153 bytes} [Sun Oct 9 01:02:56 2022] POST /identity/v3/projects => generated 387 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 09 01:02:56.147916 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6434ce68-a23a-4712-bc41-52bf8bc633d2 admin admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:02:56.188415 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-a2f79153-aa89-4f18-890b-dde111682e58 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a2d7675a1fe4301b2920c86a35312dd'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:02:56.204788 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-a2f79153-aa89-4f18-890b-dde111682e58 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a2d7675a1fe4301b2920c86a35312dd'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:02:56.206123 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-a2f79153-aa89-4f18-890b-dde111682e58 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a2d7675a1fe4301b2920c86a35312dd'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:02:56.207117 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-a2f79153-aa89-4f18-890b-dde111682e58 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a2d7675a1fe4301b2920c86a35312dd'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:02:56.224498 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-a2f79153-aa89-4f18-890b-dde111682e58 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a2d7675a1fe4301b2920c86a35312dd'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:02:56.273325 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6434ce68-a23a-4712-bc41-52bf8bc633d2 admin admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:02:56.280074 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1214/2460] 10.222.0.15 () {58 vars in 1224 bytes} [Sun Oct 9 01:02:56 2022] DELETE /identity/v3/users/6a2d7675a1fe4301b2920c86a35312dd => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 01:02:56.290870 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f181fe4-3505-40f1-a4f8-eba0ccc8fd23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:02:56.291893 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f181fe4-3505-40f1-a4f8-eba0ccc8fd23 admin admin] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:02:56.292332 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f181fe4-3505-40f1-a4f8-eba0ccc8fd23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:02:56.292757 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f181fe4-3505-40f1-a4f8-eba0ccc8fd23 admin admin] PATH_INFO: `/v3/users` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:02:56.293832 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f181fe4-3505-40f1-a4f8-eba0ccc8fd23 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:02:56.297579 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f181fe4-3505-40f1-a4f8-eba0ccc8fd23 admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:02:56.344255 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1247/2461] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Oct 9 01:02:56 2022] POST /identity/v3/users => generated 294 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 09 01:02:56.360165 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f79153-aa89-4f18-890b-dde111682e58 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:02:56.366086 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-a2f79153-aa89-4f18-890b-dde111682e58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:02:56.498812 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f79153-aa89-4f18-890b-dde111682e58 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:02:56.507502 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cc26ee-1c86-4b52-a499-7f497be89842 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:02:56.508288 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cc26ee-1c86-4b52-a499-7f497be89842 admin admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:02:56.508828 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cc26ee-1c86-4b52-a499-7f497be89842 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:02:56.509450 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cc26ee-1c86-4b52-a499-7f497be89842 admin admin] PATH_INFO: `/v3/roles` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:02:56.510787 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cc26ee-1c86-4b52-a499-7f497be89842 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:02:56.514589 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cc26ee-1c86-4b52-a499-7f497be89842 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:02:56.534757 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1215/2462] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Oct 9 01:02:56 2022] GET /identity/v3/roles => generated 1420 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 09 01:02:56.541286 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f181fe4-3505-40f1-a4f8-eba0ccc8fd23 admin admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:02:56.560754 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f181fe4-3505-40f1-a4f8-eba0ccc8fd23 admin admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:02:56.569398 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e20c015-63c5-459a-b558-0e6742c93b22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:02:56.570418 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e20c015-63c5-459a-b558-0e6742c93b22 admin admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:02:56.570907 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e20c015-63c5-459a-b558-0e6742c93b22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:02:56.571411 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e20c015-63c5-459a-b558-0e6742c93b22 admin admin] PATH_INFO: `/v3/roles` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:02:56.572687 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e20c015-63c5-459a-b558-0e6742c93b22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:02:56.575216 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e20c015-63c5-459a-b558-0e6742c93b22 admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:02:56.595187 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1248/2463] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Oct 9 01:02:56 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 09 01:02:56.599460 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cc26ee-1c86-4b52-a499-7f497be89842 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:02:56.613961 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cc26ee-1c86-4b52-a499-7f497be89842 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:02:56.616086 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e20c015-63c5-459a-b558-0e6742c93b22 admin admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:02:56.618231 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-0e20c015-63c5-459a-b558-0e6742c93b22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:02:56.620426 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beddc044-73b7-4477-be2c-a60ced03a7fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:02:56.621232 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beddc044-73b7-4477-be2c-a60ced03a7fc admin admin] REQUEST_METHOD: `PUT` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:02:56.621584 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beddc044-73b7-4477-be2c-a60ced03a7fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:02:56.621921 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beddc044-73b7-4477-be2c-a60ced03a7fc admin admin] PATH_INFO: `/v3/projects/850227d7c0f048fe97ecc269394aa2b6/users/8a8d7f4d0681467e9ec0353328847df7/roles/afb0a01183d9497795eaa4fa1a4046ae` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:02:56.634477 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 01:02:56.646420 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beddc044-73b7-4477-be2c-a60ced03a7fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=850227d7c0f048fe97ecc269394aa2b6, user_id=8a8d7f4d0681467e9ec0353328847df7, role_id=afb0a01183d9497795eaa4fa1a4046ae)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:02:56.648701 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e20c015-63c5-459a-b558-0e6742c93b22 admin admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:02:56.650946 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beddc044-73b7-4477-be2c-a60ced03a7fc admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:02:56.660178 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410de9c9-ec18-4561-a3de-bd0a4c613d94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:02:56.662105 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410de9c9-ec18-4561-a3de-bd0a4c613d94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:02:56.662513 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410de9c9-ec18-4561-a3de-bd0a4c613d94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:02:56.662771 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410de9c9-ec18-4561-a3de-bd0a4c613d94 admin admin] PATH_INFO: `/v3/projects/a8c85369a53d49d1a96cf7ed0bba8e3a` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:02:56.664399 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410de9c9-ec18-4561-a3de-bd0a4c613d94 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a8c85369a53d49d1a96cf7ed0bba8e3a)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:02:56.668662 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410de9c9-ec18-4561-a3de-bd0a4c613d94 admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:02:56.675714 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1216/2464] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Oct 9 01:02:56 2022] PUT /identity/v3/projects/850227d7c0f048fe97ecc269394aa2b6/users/8a8d7f4d0681467e9ec0353328847df7/roles/afb0a01183d9497795eaa4fa1a4046ae => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 09 01:02:56.692963 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e55e241-6450-4ae9-bdc9-7176bbf98df4 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:02:56.693447 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e55e241-6450-4ae9-bdc9-7176bbf98df4 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:02:56.693894 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e55e241-6450-4ae9-bdc9-7176bbf98df4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:02:56.723901 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=85,keystone:DELETE=10,keystone:INSERT=5 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 01:02:56.740374 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-8e55e241-6450-4ae9-bdc9-7176bbf98df4 None None] MFA Rules not processed for user `8a8d7f4d0681467e9ec0353328847df7`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 01:02:56.742475 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-8e55e241-6450-4ae9-bdc9-7176bbf98df4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:02:56.745787 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-410de9c9-ec18-4561-a3de-bd0a4c613d94 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a8c85369a53d49d1a96cf7ed0bba8e3a', 'request_id': 'req-410de9c9-ec18-4561-a3de-bd0a4c613d94'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:02:56.758933 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-410de9c9-ec18-4561-a3de-bd0a4c613d94 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a8c85369a53d49d1a96cf7ed0bba8e3a', 'request_id': 'req-410de9c9-ec18-4561-a3de-bd0a4c613d94'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:02:56.769268 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-410de9c9-ec18-4561-a3de-bd0a4c613d94 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a8c85369a53d49d1a96cf7ed0bba8e3a', 'request_id': 'req-410de9c9-ec18-4561-a3de-bd0a4c613d94'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:02:56.790583 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-410de9c9-ec18-4561-a3de-bd0a4c613d94 admin admin] The token cache is being invalidate because project a8c85369a53d49d1a96cf7ed0bba8e3a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81525) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 09 01:02:56.790914 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-410de9c9-ec18-4561-a3de-bd0a4c613d94 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:02:56.792624 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-410de9c9-ec18-4561-a3de-bd0a4c613d94 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:02:56.799086 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1249/2465] 10.222.0.15 () {58 vars in 1233 bytes} [Sun Oct 9 01:02:56 2022] DELETE /identity/v3/projects/a8c85369a53d49d1a96cf7ed0bba8e3a => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 01:02:56.801145 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f3b8b0-24cb-4785-a11f-aa2ccfaf364d None None] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:02:56.801439 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f3b8b0-24cb-4785-a11f-aa2ccfaf364d None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:02:56.801732 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f3b8b0-24cb-4785-a11f-aa2ccfaf364d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:02:56.845506 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.auth.core [None req-02f3b8b0-24cb-4785-a11f-aa2ccfaf364d None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 01:02:56.847871 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-02f3b8b0-24cb-4785-a11f-aa2ccfaf364d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:02:56.851509 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1217/2466] 10.222.0.15 () {58 vars in 958 bytes} [Sun Oct 9 01:02:56 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 01:02:56.855832 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e55e241-6450-4ae9-bdc9-7176bbf98df4 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:02:56.858771 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-8e55e241-6450-4ae9-bdc9-7176bbf98df4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:02:56.966641 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1250/2467] 10.222.0.15 () {58 vars in 958 bytes} [Sun Oct 9 01:02:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 09 01:02:56.981042 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe95e78-baf5-4e42-b3fb-eb9326a93643 None None] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:02:56.981524 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe95e78-baf5-4e42-b3fb-eb9326a93643 None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:02:56.982468 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe95e78-baf5-4e42-b3fb-eb9326a93643 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:02:57.006247 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e55e241-6450-4ae9-bdc9-7176bbf98df4 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:02:57.016749 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b194cd0-3efc-4ca2-927f-0616bbe5556c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:02:57.017872 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.auth.core [None req-fbe95e78-baf5-4e42-b3fb-eb9326a93643 None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 01:02:57.018618 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b194cd0-3efc-4ca2-927f-0616bbe5556c admin admin] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:02:57.018618 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b194cd0-3efc-4ca2-927f-0616bbe5556c admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:02:57.019188 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b194cd0-3efc-4ca2-927f-0616bbe5556c admin admin] PATH_INFO: `/v3/projects` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:02:57.020321 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b194cd0-3efc-4ca2-927f-0616bbe5556c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:02:57.021891 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-fbe95e78-baf5-4e42-b3fb-eb9326a93643 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:02:57.023733 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b194cd0-3efc-4ca2-927f-0616bbe5556c admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:02:57.053145 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1251/2468] 10.222.0.15 () {58 vars in 958 bytes} [Sun Oct 9 01:02:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 01:02:57.062969 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe95e78-baf5-4e42-b3fb-eb9326a93643 None None] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:02:57.067786 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1218/2469] 10.222.0.15 () {60 vars in 1153 bytes} [Sun Oct 9 01:02:56 2022] POST /identity/v3/projects => generated 385 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 09 01:02:57.073821 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b194cd0-3efc-4ca2-927f-0616bbe5556c admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:02:57.115714 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe95e78-baf5-4e42-b3fb-eb9326a93643 None None] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:02:57.173273 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b194cd0-3efc-4ca2-927f-0616bbe5556c admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:02:57.194758 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b658ae74-3c3b-4708-ba3c-a108a2aa6e6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:02:57.195468 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b658ae74-3c3b-4708-ba3c-a108a2aa6e6e admin admin] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:02:57.195737 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b658ae74-3c3b-4708-ba3c-a108a2aa6e6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:02:57.196008 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b658ae74-3c3b-4708-ba3c-a108a2aa6e6e admin admin] PATH_INFO: `/v3/users` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:02:57.197613 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b658ae74-3c3b-4708-ba3c-a108a2aa6e6e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:02:57.200112 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b658ae74-3c3b-4708-ba3c-a108a2aa6e6e admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:02:57.213016 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 01:02:57.251706 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1219/2470] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Oct 9 01:02:57 2022] POST /identity/v3/users => generated 299 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 09 01:02:57.257186 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b658ae74-3c3b-4708-ba3c-a108a2aa6e6e admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:02:57.285716 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b658ae74-3c3b-4708-ba3c-a108a2aa6e6e admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:02:57.294357 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8fdba5-2194-4eda-82fa-068527c5e67c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:02:57.295806 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8fdba5-2194-4eda-82fa-068527c5e67c admin admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:02:57.296207 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8fdba5-2194-4eda-82fa-068527c5e67c admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:02:57.296702 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8fdba5-2194-4eda-82fa-068527c5e67c admin admin] PATH_INFO: `/v3/roles` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:02:57.297532 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8fdba5-2194-4eda-82fa-068527c5e67c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:02:57.300073 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8fdba5-2194-4eda-82fa-068527c5e67c admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:02:57.301014 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21111bc8-5502-45e1-b73f-bcd7468472de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:02:57.301921 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21111bc8-5502-45e1-b73f-bcd7468472de admin admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:02:57.302525 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21111bc8-5502-45e1-b73f-bcd7468472de admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:02:57.302525 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21111bc8-5502-45e1-b73f-bcd7468472de admin admin] PATH_INFO: `/v3/domains` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:02:57.303380 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21111bc8-5502-45e1-b73f-bcd7468472de admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 01:02:57.303745 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21111bc8-5502-45e1-b73f-bcd7468472de admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:02:57.305521 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21111bc8-5502-45e1-b73f-bcd7468472de admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:02:57.321882 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1220/2471] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Oct 9 01:02:57 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 09 01:02:57.325100 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8fdba5-2194-4eda-82fa-068527c5e67c admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:02:57.332031 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1252/2472] 10.222.0.15 () {58 vars in 1153 bytes} [Sun Oct 9 01:02:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 01:02:57.333833 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21111bc8-5502-45e1-b73f-bcd7468472de admin admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:02:57.347152 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8fdba5-2194-4eda-82fa-068527c5e67c admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:02:57.350439 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21111bc8-5502-45e1-b73f-bcd7468472de admin admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:02:57.363408 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce97c86-f581-4fdf-a4f4-16948c021c76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:02:57.365790 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce97c86-f581-4fdf-a4f4-16948c021c76 admin admin] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:02:57.366259 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce97c86-f581-4fdf-a4f4-16948c021c76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:02:57.366731 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce97c86-f581-4fdf-a4f4-16948c021c76 admin admin] PATH_INFO: `/v3/projects` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:02:57.368282 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce97c86-f581-4fdf-a4f4-16948c021c76 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:02:57.375294 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce97c86-f581-4fdf-a4f4-16948c021c76 admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:02:57.390729 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85d8348-2778-4308-bde9-3c747736acb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:02:57.392381 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85d8348-2778-4308-bde9-3c747736acb8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:02:57.394136 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85d8348-2778-4308-bde9-3c747736acb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:02:57.394845 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85d8348-2778-4308-bde9-3c747736acb8 admin admin] PATH_INFO: `/v3/projects/88b479a1c6594ae5ae6cbb6c418cbcd1/users/2fad13eeb1d244e7bf47cf5fe730230c/roles/f69dddf26daf4dd79d4c962beb877af5` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:02:57.424891 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85d8348-2778-4308-bde9-3c747736acb8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=88b479a1c6594ae5ae6cbb6c418cbcd1, user_id=2fad13eeb1d244e7bf47cf5fe730230c, role_id=f69dddf26daf4dd79d4c962beb877af5)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:02:57.431244 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85d8348-2778-4308-bde9-3c747736acb8 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:02:57.468088 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1221/2473] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Oct 9 01:02:57 2022] PUT /identity/v3/projects/88b479a1c6594ae5ae6cbb6c418cbcd1/users/2fad13eeb1d244e7bf47cf5fe730230c/roles/f69dddf26daf4dd79d4c962beb877af5 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 01:02:57.472017 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85d8348-2778-4308-bde9-3c747736acb8 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:02:57.479115 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1253/2474] 10.222.0.15 () {60 vars in 1153 bytes} [Sun Oct 9 01:02:57 2022] POST /identity/v3/projects => generated 383 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 09 01:02:57.481063 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce97c86-f581-4fdf-a4f4-16948c021c76 admin admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:02:57.579801 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 01:02:57.653023 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85d8348-2778-4308-bde9-3c747736acb8 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:02:57.662723 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a448ea-79e1-4a2f-bcda-16da9cf94b8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:02:57.663308 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce97c86-f581-4fdf-a4f4-16948c021c76 admin admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:02:57.663811 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a448ea-79e1-4a2f-bcda-16da9cf94b8b admin admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:02:57.664398 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a448ea-79e1-4a2f-bcda-16da9cf94b8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:02:57.664856 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a448ea-79e1-4a2f-bcda-16da9cf94b8b admin admin] PATH_INFO: `/v3/roles` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:02:57.668215 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a448ea-79e1-4a2f-bcda-16da9cf94b8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:02:57.669316 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a448ea-79e1-4a2f-bcda-16da9cf94b8b admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:02:57.684943 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bf3598-85b2-4666-94ee-4d8a160d0c6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:02:57.685597 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bf3598-85b2-4666-94ee-4d8a160d0c6d admin admin] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:02:57.685932 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bf3598-85b2-4666-94ee-4d8a160d0c6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:02:57.686152 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bf3598-85b2-4666-94ee-4d8a160d0c6d admin admin] PATH_INFO: `/v3/users` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:02:57.686774 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bf3598-85b2-4666-94ee-4d8a160d0c6d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:02:57.689258 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bf3598-85b2-4666-94ee-4d8a160d0c6d admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:02:57.692802 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1222/2475] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Oct 9 01:02:57 2022] GET /identity/v3/roles => generated 1420 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 09 01:02:57.697619 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a448ea-79e1-4a2f-bcda-16da9cf94b8b admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:02:57.717704 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a448ea-79e1-4a2f-bcda-16da9cf94b8b admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:02:57.727727 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2050f455-5a38-4426-b704-c32481684a98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:02:57.729440 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2050f455-5a38-4426-b704-c32481684a98 admin admin] REQUEST_METHOD: `PUT` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:02:57.730092 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2050f455-5a38-4426-b704-c32481684a98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:02:57.731646 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2050f455-5a38-4426-b704-c32481684a98 admin admin] PATH_INFO: `/v3/projects/88b479a1c6594ae5ae6cbb6c418cbcd1/users/2fad13eeb1d244e7bf47cf5fe730230c/roles/f69dddf26daf4dd79d4c962beb877af5` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:02:57.736914 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2050f455-5a38-4426-b704-c32481684a98 admin admin] RBAC: Authorizing `identity:create_grant(project_id=88b479a1c6594ae5ae6cbb6c418cbcd1, user_id=2fad13eeb1d244e7bf47cf5fe730230c, role_id=f69dddf26daf4dd79d4c962beb877af5)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:02:57.742898 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2050f455-5a38-4426-b704-c32481684a98 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:02:57.744538 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1254/2476] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Oct 9 01:02:57 2022] POST /identity/v3/users => generated 292 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 09 01:02:57.746729 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bf3598-85b2-4666-94ee-4d8a160d0c6d admin admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:02:57.767692 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bf3598-85b2-4666-94ee-4d8a160d0c6d admin admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:02:57.780864 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1223/2477] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Oct 9 01:02:57 2022] PUT /identity/v3/projects/88b479a1c6594ae5ae6cbb6c418cbcd1/users/2fad13eeb1d244e7bf47cf5fe730230c/roles/f69dddf26daf4dd79d4c962beb877af5 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 09 01:02:57.794271 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf13041-9348-4490-b09f-3b43d906af41 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:02:57.794936 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf13041-9348-4490-b09f-3b43d906af41 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:02:57.795667 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf13041-9348-4490-b09f-3b43d906af41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:02:57.874725 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-fdf13041-9348-4490-b09f-3b43d906af41 None None] MFA Rules not processed for user `2fad13eeb1d244e7bf47cf5fe730230c`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 01:02:57.879405 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-fdf13041-9348-4490-b09f-3b43d906af41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:02:57.945276 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10895d5-bc04-474c-a53d-480fd096462d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:02:57.948642 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10895d5-bc04-474c-a53d-480fd096462d admin admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:02:57.951380 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10895d5-bc04-474c-a53d-480fd096462d admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:02:57.952062 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10895d5-bc04-474c-a53d-480fd096462d admin admin] PATH_INFO: `/v3/roles` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:02:57.953424 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10895d5-bc04-474c-a53d-480fd096462d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:02:57.956149 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10895d5-bc04-474c-a53d-480fd096462d admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:02:57.991247 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1255/2478] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Oct 9 01:02:57 2022] GET /identity/v3/roles => generated 1420 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 09 01:02:57.997820 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10895d5-bc04-474c-a53d-480fd096462d admin admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:02:58.024103 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10895d5-bc04-474c-a53d-480fd096462d admin admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:02:58.042277 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3746c83c-ebe1-4be7-af14-67c19f2e3aa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:02:58.043661 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3746c83c-ebe1-4be7-af14-67c19f2e3aa6 admin admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:02:58.044324 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3746c83c-ebe1-4be7-af14-67c19f2e3aa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:02:58.045020 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3746c83c-ebe1-4be7-af14-67c19f2e3aa6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:02:58.046441 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3746c83c-ebe1-4be7-af14-67c19f2e3aa6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:02:58.049522 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3746c83c-ebe1-4be7-af14-67c19f2e3aa6 admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:02:58.083403 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1256/2479] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Oct 9 01:02:57 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 09 01:02:58.088462 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3746c83c-ebe1-4be7-af14-67c19f2e3aa6 admin admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:02:58.115045 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3746c83c-ebe1-4be7-af14-67c19f2e3aa6 admin admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:02:58.129119 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0877882-3284-4386-bc75-a76e65eaa33e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:02:58.130478 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0877882-3284-4386-bc75-a76e65eaa33e admin admin] REQUEST_METHOD: `PUT` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:02:58.131053 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0877882-3284-4386-bc75-a76e65eaa33e admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:02:58.131536 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0877882-3284-4386-bc75-a76e65eaa33e admin admin] PATH_INFO: `/v3/projects/f9385682a69941f4bb31d13abd9c3a9c/users/6e7c8609723e4e5795c0b84ae2accaee/roles/afb0a01183d9497795eaa4fa1a4046ae` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:02:58.137933 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1224/2480] 10.222.0.15 () {58 vars in 958 bytes} [Sun Oct 9 01:02:57 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 347 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 01:02:58.167838 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0877882-3284-4386-bc75-a76e65eaa33e admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9385682a69941f4bb31d13abd9c3a9c, user_id=6e7c8609723e4e5795c0b84ae2accaee, role_id=afb0a01183d9497795eaa4fa1a4046ae)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:02:58.174327 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0877882-3284-4386-bc75-a76e65eaa33e admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:02:58.178681 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf13041-9348-4490-b09f-3b43d906af41 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:02:58.189381 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-fdf13041-9348-4490-b09f-3b43d906af41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:02:58.215365 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1257/2481] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Oct 9 01:02:58 2022] PUT /identity/v3/projects/f9385682a69941f4bb31d13abd9c3a9c/users/6e7c8609723e4e5795c0b84ae2accaee/roles/afb0a01183d9497795eaa4fa1a4046ae => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 01:02:58.229233 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc23a93-7786-4965-b5c0-e8bc648f4e9a None None] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:02:58.229689 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc23a93-7786-4965-b5c0-e8bc648f4e9a None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:02:58.230675 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc23a93-7786-4965-b5c0-e8bc648f4e9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:02:58.277953 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 01:02:58.347569 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.auth.core [None req-ccc23a93-7786-4965-b5c0-e8bc648f4e9a None None] MFA Rules not processed for user `6e7c8609723e4e5795c0b84ae2accaee`. Rule list: `[]` (Enabled: `True`). {{(pid=81525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 01:02:58.352523 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-ccc23a93-7786-4965-b5c0-e8bc648f4e9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:02:58.376126 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf13041-9348-4490-b09f-3b43d906af41 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:02:58.525573 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b8037c-6c44-4831-9f6a-d3b84c4e78d3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff7cb78bcd91467abe5c2e2b48aedd1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f148d39ced534860abfbe8fc3f98ace4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:02:58.526448 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b8037c-6c44-4831-9f6a-d3b84c4e78d3 service cinder] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:02:58.526868 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b8037c-6c44-4831-9f6a-d3b84c4e78d3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:02:58.527333 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b8037c-6c44-4831-9f6a-d3b84c4e78d3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:02:58.587840 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1258/2482] 10.222.0.15 () {58 vars in 958 bytes} [Sun Oct 9 01:02:58 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 363 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 09 01:02:58.589509 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc23a93-7786-4965-b5c0-e8bc648f4e9a None None] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:02:58.593774 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-ccc23a93-7786-4965-b5c0-e8bc648f4e9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:02:58.627792 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 01:02:58.706264 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b8037c-6c44-4831-9f6a-d3b84c4e78d3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:02:58.707877 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b8037c-6c44-4831-9f6a-d3b84c4e78d3 service cinder] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:02:58.733814 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1225/2483] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Oct 9 01:02:58 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 563 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 09 01:02:58.737992 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b8037c-6c44-4831-9f6a-d3b84c4e78d3 service cinder] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:02:58.742395 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-a9b8037c-6c44-4831-9f6a-d3b84c4e78d3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:02:58.746934 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc23a93-7786-4965-b5c0-e8bc648f4e9a None None] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:02:58.765971 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772f5fc8-44e1-48e2-a7ea-6d2baf0d19d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:02:58.767236 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772f5fc8-44e1-48e2-a7ea-6d2baf0d19d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:02:58.767936 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772f5fc8-44e1-48e2-a7ea-6d2baf0d19d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:02:58.768512 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772f5fc8-44e1-48e2-a7ea-6d2baf0d19d5 admin admin] PATH_INFO: `/v3/users/9bf08bd829e14e9288ab2cba63f3a856` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:02:58.770535 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772f5fc8-44e1-48e2-a7ea-6d2baf0d19d5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9bf08bd829e14e9288ab2cba63f3a856)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:02:58.775030 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772f5fc8-44e1-48e2-a7ea-6d2baf0d19d5 admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:02:58.891188 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-772f5fc8-44e1-48e2-a7ea-6d2baf0d19d5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9bf08bd829e14e9288ab2cba63f3a856'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:02:58.905023 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b8037c-6c44-4831-9f6a-d3b84c4e78d3 service cinder] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:02:58.913695 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ddbbb0-4566-42af-ab7f-33ea261435db service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ac83d57fba841e0a666710732249c49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f148d39ced534860abfbe8fc3f98ace4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:02:58.914204 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-772f5fc8-44e1-48e2-a7ea-6d2baf0d19d5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9bf08bd829e14e9288ab2cba63f3a856'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:02:58.914377 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ddbbb0-4566-42af-ab7f-33ea261435db service nova] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:02:58.914697 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ddbbb0-4566-42af-ab7f-33ea261435db service nova] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:02:58.914884 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ddbbb0-4566-42af-ab7f-33ea261435db service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:02:58.915432 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-772f5fc8-44e1-48e2-a7ea-6d2baf0d19d5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9bf08bd829e14e9288ab2cba63f3a856'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:02:58.916567 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-772f5fc8-44e1-48e2-a7ea-6d2baf0d19d5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9bf08bd829e14e9288ab2cba63f3a856'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:02:58.918100 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-42ddbbb0-4566-42af-ab7f-33ea261435db service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:02:58.932609 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-772f5fc8-44e1-48e2-a7ea-6d2baf0d19d5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9bf08bd829e14e9288ab2cba63f3a856'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:02:58.933191 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ddbbb0-4566-42af-ab7f-33ea261435db service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:02:58.935160 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ddbbb0-4566-42af-ab7f-33ea261435db service nova] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:02:58.951986 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1226/2484] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Oct 9 01:02:58 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 09 01:02:58.953431 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ddbbb0-4566-42af-ab7f-33ea261435db service nova] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:02:58.955386 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-42ddbbb0-4566-42af-ab7f-33ea261435db service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:02:58.973213 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ddbbb0-4566-42af-ab7f-33ea261435db service nova] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:02:58.975413 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1259/2485] 10.222.0.15 () {58 vars in 1224 bytes} [Sun Oct 9 01:02:58 2022] DELETE /identity/v3/users/9bf08bd829e14e9288ab2cba63f3a856 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 01:02:58.984955 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168cbc4e-9702-41e5-b627-bfb69c87bc49 None None] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:02:58.986229 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168cbc4e-9702-41e5-b627-bfb69c87bc49 None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:02:58.987642 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168cbc4e-9702-41e5-b627-bfb69c87bc49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:02:58.992278 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 01:02:59.015088 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.auth.core [None req-168cbc4e-9702-41e5-b627-bfb69c87bc49 None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 01:02:59.016357 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-168cbc4e-9702-41e5-b627-bfb69c87bc49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:02:59.075462 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d1d9d5-db88-4c8e-9eb7-4e1c3ead95c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:02:59.076894 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d1d9d5-db88-4c8e-9eb7-4e1c3ead95c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:02:59.077512 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d1d9d5-db88-4c8e-9eb7-4e1c3ead95c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:02:59.078065 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d1d9d5-db88-4c8e-9eb7-4e1c3ead95c9 admin admin] PATH_INFO: `/v3/users/8a8d7f4d0681467e9ec0353328847df7` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:02:59.082279 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d1d9d5-db88-4c8e-9eb7-4e1c3ead95c9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a8d7f4d0681467e9ec0353328847df7)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:02:59.087475 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d1d9d5-db88-4c8e-9eb7-4e1c3ead95c9 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:02:59.122661 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1260/2486] 10.222.0.15 () {58 vars in 958 bytes} [Sun Oct 9 01:02:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 01:02:59.131883 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168cbc4e-9702-41e5-b627-bfb69c87bc49 None None] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:02:59.138245 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-168cbc4e-9702-41e5-b627-bfb69c87bc49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:02:59.220082 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-69d1d9d5-db88-4c8e-9eb7-4e1c3ead95c9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a8d7f4d0681467e9ec0353328847df7'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:02:59.232960 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-69d1d9d5-db88-4c8e-9eb7-4e1c3ead95c9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a8d7f4d0681467e9ec0353328847df7'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:02:59.233849 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-69d1d9d5-db88-4c8e-9eb7-4e1c3ead95c9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a8d7f4d0681467e9ec0353328847df7'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:02:59.235183 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-69d1d9d5-db88-4c8e-9eb7-4e1c3ead95c9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a8d7f4d0681467e9ec0353328847df7'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:02:59.250081 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 01:02:59.256995 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-69d1d9d5-db88-4c8e-9eb7-4e1c3ead95c9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a8d7f4d0681467e9ec0353328847df7'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:02:59.298728 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1227/2487] 10.222.0.15 () {58 vars in 1224 bytes} [Sun Oct 9 01:02:58 2022] DELETE /identity/v3/users/8a8d7f4d0681467e9ec0353328847df7 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 01:02:59.304673 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168cbc4e-9702-41e5-b627-bfb69c87bc49 None None] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:02:59.305943 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4273de1-06d5-4992-b80e-4296ffb713c6 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:02:59.306178 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4273de1-06d5-4992-b80e-4296ffb713c6 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:02:59.307044 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4273de1-06d5-4992-b80e-4296ffb713c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:02:59.339694 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-e4273de1-06d5-4992-b80e-4296ffb713c6 None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 01:02:59.341069 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-e4273de1-06d5-4992-b80e-4296ffb713c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:02:59.470204 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12a5159-3aba-406c-a46c-8fbb021da97d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4ef90d456d2483e8ddafbe2d4d4fb5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f148d39ced534860abfbe8fc3f98ace4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:02:59.471689 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12a5159-3aba-406c-a46c-8fbb021da97d service neutron] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:02:59.471986 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12a5159-3aba-406c-a46c-8fbb021da97d service neutron] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:02:59.472466 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12a5159-3aba-406c-a46c-8fbb021da97d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:02:59.475905 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-d12a5159-3aba-406c-a46c-8fbb021da97d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:02:59.498425 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1228/2488] 10.222.0.15 () {58 vars in 958 bytes} [Sun Oct 9 01:02:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 01:02:59.516864 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4273de1-06d5-4992-b80e-4296ffb713c6 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:02:59.518716 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-e4273de1-06d5-4992-b80e-4296ffb713c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:02:59.519724 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12a5159-3aba-406c-a46c-8fbb021da97d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:02:59.523642 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12a5159-3aba-406c-a46c-8fbb021da97d service neutron] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:02:59.545186 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4273de1-06d5-4992-b80e-4296ffb713c6 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:02:59.551096 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1261/2489] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Oct 9 01:02:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 09 01:02:59.566881 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b43cb19-3450-4283-b93f-93b4f0241890 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4ef90d456d2483e8ddafbe2d4d4fb5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f148d39ced534860abfbe8fc3f98ace4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:02:59.567854 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b43cb19-3450-4283-b93f-93b4f0241890 service neutron] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:02:59.568335 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b43cb19-3450-4283-b93f-93b4f0241890 service neutron] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:02:59.570032 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b43cb19-3450-4283-b93f-93b4f0241890 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:02:59.599015 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b43cb19-3450-4283-b93f-93b4f0241890 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:02:59.602037 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b43cb19-3450-4283-b93f-93b4f0241890 service neutron] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:02:59.631525 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1229/2490] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Oct 9 01:02:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 09 01:03:00.456456 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12a5159-3aba-406c-a46c-8fbb021da97d service neutron] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:03:00.460644 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-d12a5159-3aba-406c-a46c-8fbb021da97d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:03:00.481154 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12a5159-3aba-406c-a46c-8fbb021da97d service neutron] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:03:00.500863 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e8bad0-2480-4d5f-a989-40f4e8d86791 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:03:00.502339 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e8bad0-2480-4d5f-a989-40f4e8d86791 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:03:00.503594 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e8bad0-2480-4d5f-a989-40f4e8d86791 admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:03:00.503594 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e8bad0-2480-4d5f-a989-40f4e8d86791 admin admin] PATH_INFO: `/v3/projects/850227d7c0f048fe97ecc269394aa2b6` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:03:00.505775 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e8bad0-2480-4d5f-a989-40f4e8d86791 admin admin] RBAC: Authorizing `identity:delete_project(project_id=850227d7c0f048fe97ecc269394aa2b6)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:03:00.510991 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e8bad0-2480-4d5f-a989-40f4e8d86791 admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:03:00.601370 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-74e8bad0-2480-4d5f-a989-40f4e8d86791 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '850227d7c0f048fe97ecc269394aa2b6', 'request_id': 'req-74e8bad0-2480-4d5f-a989-40f4e8d86791'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:03:00.614424 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-74e8bad0-2480-4d5f-a989-40f4e8d86791 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '850227d7c0f048fe97ecc269394aa2b6', 'request_id': 'req-74e8bad0-2480-4d5f-a989-40f4e8d86791'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:03:00.623218 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-74e8bad0-2480-4d5f-a989-40f4e8d86791 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '850227d7c0f048fe97ecc269394aa2b6', 'request_id': 'req-74e8bad0-2480-4d5f-a989-40f4e8d86791'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:03:00.639015 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-74e8bad0-2480-4d5f-a989-40f4e8d86791 admin admin] The token cache is being invalidate because project 850227d7c0f048fe97ecc269394aa2b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81525) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 09 01:03:00.639592 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-74e8bad0-2480-4d5f-a989-40f4e8d86791 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:03:00.640339 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-74e8bad0-2480-4d5f-a989-40f4e8d86791 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:03:00.642443 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1262/2491] 10.222.0.15 () {58 vars in 1233 bytes} [Sun Oct 9 01:03:00 2022] DELETE /identity/v3/projects/850227d7c0f048fe97ecc269394aa2b6 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 01:03:00.647733 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b43cb19-3450-4283-b93f-93b4f0241890 service neutron] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:03:00.662357 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b43cb19-3450-4283-b93f-93b4f0241890 service neutron] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:03:00.712212 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 01:03:00.763549 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f20c3c-fa62-45c0-a9d9-ad1d70a3ee57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:03:00.764813 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f20c3c-fa62-45c0-a9d9-ad1d70a3ee57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:03:00.765049 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f20c3c-fa62-45c0-a9d9-ad1d70a3ee57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:03:00.765583 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f20c3c-fa62-45c0-a9d9-ad1d70a3ee57 admin admin] PATH_INFO: `/v3/users/2fad13eeb1d244e7bf47cf5fe730230c` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:03:00.767927 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f20c3c-fa62-45c0-a9d9-ad1d70a3ee57 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2fad13eeb1d244e7bf47cf5fe730230c)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:03:00.771753 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f20c3c-fa62-45c0-a9d9-ad1d70a3ee57 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:03:00.859890 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-f9f20c3c-fa62-45c0-a9d9-ad1d70a3ee57 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2fad13eeb1d244e7bf47cf5fe730230c'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:03:00.871849 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-f9f20c3c-fa62-45c0-a9d9-ad1d70a3ee57 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2fad13eeb1d244e7bf47cf5fe730230c'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:03:00.872756 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-f9f20c3c-fa62-45c0-a9d9-ad1d70a3ee57 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2fad13eeb1d244e7bf47cf5fe730230c'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:03:00.873461 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-f9f20c3c-fa62-45c0-a9d9-ad1d70a3ee57 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2fad13eeb1d244e7bf47cf5fe730230c'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:03:00.886020 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-f9f20c3c-fa62-45c0-a9d9-ad1d70a3ee57 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2fad13eeb1d244e7bf47cf5fe730230c'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:03:00.897993 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e8bad0-2480-4d5f-a989-40f4e8d86791 admin admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:03:00.901763 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-74e8bad0-2480-4d5f-a989-40f4e8d86791 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:03:00.931446 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1230/2492] 10.222.0.15 () {58 vars in 1224 bytes} [Sun Oct 9 01:03:00 2022] DELETE /identity/v3/users/2fad13eeb1d244e7bf47cf5fe730230c => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 09 01:03:00.937595 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f20c3c-fa62-45c0-a9d9-ad1d70a3ee57 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:03:00.940025 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-f9f20c3c-fa62-45c0-a9d9-ad1d70a3ee57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:03:00.954353 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e8bad0-2480-4d5f-a989-40f4e8d86791 admin admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:03:01.153936 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f20c3c-fa62-45c0-a9d9-ad1d70a3ee57 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:03:01.189310 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a1a394-6c33-494a-9956-c326e0b54f40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:03:01.190315 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a1a394-6c33-494a-9956-c326e0b54f40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:03:01.196128 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a1a394-6c33-494a-9956-c326e0b54f40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:03:01.196662 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a1a394-6c33-494a-9956-c326e0b54f40 admin admin] PATH_INFO: `/v3/users/751dff59acee4f188dd1edbfff46713c` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:03:01.199609 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a1a394-6c33-494a-9956-c326e0b54f40 admin admin] RBAC: Authorizing `identity:delete_user(user_id=751dff59acee4f188dd1edbfff46713c)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:03:01.211616 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a1a394-6c33-494a-9956-c326e0b54f40 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:03:01.234603 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80a9e54-d98d-4f14-bf5b-102c6b08f53c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:03:01.246069 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80a9e54-d98d-4f14-bf5b-102c6b08f53c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:03:01.246956 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80a9e54-d98d-4f14-bf5b-102c6b08f53c admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:03:01.249546 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80a9e54-d98d-4f14-bf5b-102c6b08f53c admin admin] PATH_INFO: `/v3/projects/09d90e6e99094d60b38d4e13a267d851` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:03:01.253301 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80a9e54-d98d-4f14-bf5b-102c6b08f53c admin admin] RBAC: Authorizing `identity:delete_project(project_id=09d90e6e99094d60b38d4e13a267d851)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:03:01.261698 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80a9e54-d98d-4f14-bf5b-102c6b08f53c admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:03:01.354896 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 01:03:01.387117 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 01:03:01.395214 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-59a1a394-6c33-494a-9956-c326e0b54f40 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '751dff59acee4f188dd1edbfff46713c'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:03:01.424369 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-59a1a394-6c33-494a-9956-c326e0b54f40 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '751dff59acee4f188dd1edbfff46713c'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:03:01.426001 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-59a1a394-6c33-494a-9956-c326e0b54f40 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '751dff59acee4f188dd1edbfff46713c'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:03:01.427041 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-59a1a394-6c33-494a-9956-c326e0b54f40 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '751dff59acee4f188dd1edbfff46713c'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:03:01.468149 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-59a1a394-6c33-494a-9956-c326e0b54f40 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '751dff59acee4f188dd1edbfff46713c'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:03:01.539875 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1231/2493] 10.222.0.15 () {58 vars in 1224 bytes} [Sun Oct 9 01:03:00 2022] DELETE /identity/v3/users/751dff59acee4f188dd1edbfff46713c => generated 0 bytes in 608 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 01:03:01.547836 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-d80a9e54-d98d-4f14-bf5b-102c6b08f53c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '09d90e6e99094d60b38d4e13a267d851', 'request_id': 'req-d80a9e54-d98d-4f14-bf5b-102c6b08f53c'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:03:01.580162 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-d80a9e54-d98d-4f14-bf5b-102c6b08f53c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '09d90e6e99094d60b38d4e13a267d851', 'request_id': 'req-d80a9e54-d98d-4f14-bf5b-102c6b08f53c'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:03:01.593446 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-d80a9e54-d98d-4f14-bf5b-102c6b08f53c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '09d90e6e99094d60b38d4e13a267d851', 'request_id': 'req-d80a9e54-d98d-4f14-bf5b-102c6b08f53c'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:03:01.608781 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-d80a9e54-d98d-4f14-bf5b-102c6b08f53c admin admin] The token cache is being invalidate because project 09d90e6e99094d60b38d4e13a267d851 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81525) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 09 01:03:01.609255 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-d80a9e54-d98d-4f14-bf5b-102c6b08f53c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:03:01.610153 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-d80a9e54-d98d-4f14-bf5b-102c6b08f53c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:03:01.613135 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1263/2494] 10.222.0.15 () {58 vars in 1233 bytes} [Sun Oct 9 01:03:00 2022] DELETE /identity/v3/projects/09d90e6e99094d60b38d4e13a267d851 => generated 0 bytes in 716 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 01:03:01.619610 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a1a394-6c33-494a-9956-c326e0b54f40 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:03:01.621631 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-59a1a394-6c33-494a-9956-c326e0b54f40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:03:01.812655 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80a9e54-d98d-4f14-bf5b-102c6b08f53c admin admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:03:01.814295 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-d80a9e54-d98d-4f14-bf5b-102c6b08f53c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:03:01.880867 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a1a394-6c33-494a-9956-c326e0b54f40 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:03:01.895571 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3272128f-c9e6-4415-b672-a5e1ee2a0fd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:03:01.896517 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3272128f-c9e6-4415-b672-a5e1ee2a0fd1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:03:01.896663 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3272128f-c9e6-4415-b672-a5e1ee2a0fd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:03:01.896866 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3272128f-c9e6-4415-b672-a5e1ee2a0fd1 admin admin] PATH_INFO: `/v3/users/3101e1e9816043dd94a9a45509cb8fd6` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:03:01.903488 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3272128f-c9e6-4415-b672-a5e1ee2a0fd1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3101e1e9816043dd94a9a45509cb8fd6)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:03:01.905684 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3272128f-c9e6-4415-b672-a5e1ee2a0fd1 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:03:02.011393 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80a9e54-d98d-4f14-bf5b-102c6b08f53c admin admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:03:02.017961 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749cdef4-68f2-4dc7-a230-95cba48821f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:03:02.018641 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749cdef4-68f2-4dc7-a230-95cba48821f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:03:02.018914 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749cdef4-68f2-4dc7-a230-95cba48821f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:03:02.019309 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749cdef4-68f2-4dc7-a230-95cba48821f6 admin admin] PATH_INFO: `/v3/projects/88b479a1c6594ae5ae6cbb6c418cbcd1` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:03:02.020738 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749cdef4-68f2-4dc7-a230-95cba48821f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=88b479a1c6594ae5ae6cbb6c418cbcd1)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:03:02.023324 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749cdef4-68f2-4dc7-a230-95cba48821f6 admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:03:02.041456 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-3272128f-c9e6-4415-b672-a5e1ee2a0fd1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3101e1e9816043dd94a9a45509cb8fd6'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:03:02.053776 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-3272128f-c9e6-4415-b672-a5e1ee2a0fd1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3101e1e9816043dd94a9a45509cb8fd6'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:03:02.054877 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-3272128f-c9e6-4415-b672-a5e1ee2a0fd1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3101e1e9816043dd94a9a45509cb8fd6'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:03:02.055817 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-3272128f-c9e6-4415-b672-a5e1ee2a0fd1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3101e1e9816043dd94a9a45509cb8fd6'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:03:02.069107 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-3272128f-c9e6-4415-b672-a5e1ee2a0fd1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3101e1e9816043dd94a9a45509cb8fd6'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:03:02.111430 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1232/2495] 10.222.0.15 () {58 vars in 1224 bytes} [Sun Oct 9 01:03:01 2022] DELETE /identity/v3/users/3101e1e9816043dd94a9a45509cb8fd6 => generated 0 bytes in 493 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 01:03:02.112308 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3272128f-c9e6-4415-b672-a5e1ee2a0fd1 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:03:02.114407 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-749cdef4-68f2-4dc7-a230-95cba48821f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '88b479a1c6594ae5ae6cbb6c418cbcd1', 'request_id': 'req-749cdef4-68f2-4dc7-a230-95cba48821f6'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:03:02.126935 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-3272128f-c9e6-4415-b672-a5e1ee2a0fd1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:03:02.129384 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-749cdef4-68f2-4dc7-a230-95cba48821f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '88b479a1c6594ae5ae6cbb6c418cbcd1', 'request_id': 'req-749cdef4-68f2-4dc7-a230-95cba48821f6'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:03:02.151234 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-749cdef4-68f2-4dc7-a230-95cba48821f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '88b479a1c6594ae5ae6cbb6c418cbcd1', 'request_id': 'req-749cdef4-68f2-4dc7-a230-95cba48821f6'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:03:02.175710 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-749cdef4-68f2-4dc7-a230-95cba48821f6 admin admin] The token cache is being invalidate because project 88b479a1c6594ae5ae6cbb6c418cbcd1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81525) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 09 01:03:02.175983 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-749cdef4-68f2-4dc7-a230-95cba48821f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:03:02.176695 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-749cdef4-68f2-4dc7-a230-95cba48821f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:03:02.181247 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1264/2496] 10.222.0.15 () {58 vars in 1233 bytes} [Sun Oct 9 01:03:01 2022] DELETE /identity/v3/projects/88b479a1c6594ae5ae6cbb6c418cbcd1 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 01:03:02.187119 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1abb085-5137-440b-8420-4ea29250e0a3 None None] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:03:02.187436 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1abb085-5137-440b-8420-4ea29250e0a3 None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:03:02.187677 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1abb085-5137-440b-8420-4ea29250e0a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:03:02.218665 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 01:03:02.233501 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.auth.core [None req-d1abb085-5137-440b-8420-4ea29250e0a3 None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 01:03:02.234833 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-d1abb085-5137-440b-8420-4ea29250e0a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:03:02.263597 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3272128f-c9e6-4415-b672-a5e1ee2a0fd1 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:03:02.272508 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf40900-5976-4e3b-acd2-2c40faa82d41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:03:02.273993 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf40900-5976-4e3b-acd2-2c40faa82d41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:03:02.274651 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf40900-5976-4e3b-acd2-2c40faa82d41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:03:02.275184 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf40900-5976-4e3b-acd2-2c40faa82d41 admin admin] PATH_INFO: `/v3/projects/9227a48214a24854b4f3365ce7d9c04c` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:03:02.277238 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf40900-5976-4e3b-acd2-2c40faa82d41 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9227a48214a24854b4f3365ce7d9c04c)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:03:02.281196 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1265/2497] 10.222.0.15 () {58 vars in 958 bytes} [Sun Oct 9 01:03:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 09 01:03:02.281404 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf40900-5976-4e3b-acd2-2c40faa82d41 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:03:02.288946 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe4935d-8ffc-4e34-9032-b2d9c2398010 None None] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:03:02.289452 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe4935d-8ffc-4e34-9032-b2d9c2398010 None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:03:02.289777 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe4935d-8ffc-4e34-9032-b2d9c2398010 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:03:02.336125 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.auth.core [None req-0fe4935d-8ffc-4e34-9032-b2d9c2398010 None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 01:03:02.340760 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-0fe4935d-8ffc-4e34-9032-b2d9c2398010 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:03:02.357136 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1266/2498] 10.222.0.15 () {58 vars in 958 bytes} [Sun Oct 9 01:03:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 01:03:02.365651 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe4935d-8ffc-4e34-9032-b2d9c2398010 None None] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:03:02.398095 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe4935d-8ffc-4e34-9032-b2d9c2398010 None None] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:03:02.410285 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-9bf40900-5976-4e3b-acd2-2c40faa82d41 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9227a48214a24854b4f3365ce7d9c04c', 'request_id': 'req-9bf40900-5976-4e3b-acd2-2c40faa82d41'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:03:02.468482 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-9bf40900-5976-4e3b-acd2-2c40faa82d41 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9227a48214a24854b4f3365ce7d9c04c', 'request_id': 'req-9bf40900-5976-4e3b-acd2-2c40faa82d41'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:03:02.490558 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-9bf40900-5976-4e3b-acd2-2c40faa82d41 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9227a48214a24854b4f3365ce7d9c04c', 'request_id': 'req-9bf40900-5976-4e3b-acd2-2c40faa82d41'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:03:02.497012 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 01:03:02.522410 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-9bf40900-5976-4e3b-acd2-2c40faa82d41 admin admin] The token cache is being invalidate because project 9227a48214a24854b4f3365ce7d9c04c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81524) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 09 01:03:02.522708 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-9bf40900-5976-4e3b-acd2-2c40faa82d41 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:03:02.523708 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-9bf40900-5976-4e3b-acd2-2c40faa82d41 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:03:02.534371 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1233/2499] 10.222.0.15 () {58 vars in 1233 bytes} [Sun Oct 9 01:03:02 2022] DELETE /identity/v3/projects/9227a48214a24854b4f3365ce7d9c04c => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 01:03:02.536425 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf40900-5976-4e3b-acd2-2c40faa82d41 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:03:02.538885 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-9bf40900-5976-4e3b-acd2-2c40faa82d41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:03:02.593246 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef60649-f8e6-4865-8bc2-289befc8f1f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:03:02.595823 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef60649-f8e6-4865-8bc2-289befc8f1f7 admin admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:03:02.596125 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef60649-f8e6-4865-8bc2-289befc8f1f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:03:02.597456 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef60649-f8e6-4865-8bc2-289befc8f1f7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:03:02.599305 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef60649-f8e6-4865-8bc2-289befc8f1f7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 01:03:02.599955 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef60649-f8e6-4865-8bc2-289befc8f1f7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:03:02.603508 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef60649-f8e6-4865-8bc2-289befc8f1f7 admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:03:02.648414 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1267/2500] 10.222.0.15 () {58 vars in 1153 bytes} [Sun Oct 9 01:03:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 01:03:02.652180 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef60649-f8e6-4865-8bc2-289befc8f1f7 admin admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:03:02.655448 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-1ef60649-f8e6-4865-8bc2-289befc8f1f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:03:02.682079 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef60649-f8e6-4865-8bc2-289befc8f1f7 admin admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:03:02.697977 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf40900-5976-4e3b-acd2-2c40faa82d41 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:03:02.704897 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755e5f75-84fa-4be6-b293-06ce5a4f95ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:03:02.706442 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755e5f75-84fa-4be6-b293-06ce5a4f95ab admin admin] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:03:02.706743 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755e5f75-84fa-4be6-b293-06ce5a4f95ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:03:02.710006 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755e5f75-84fa-4be6-b293-06ce5a4f95ab admin admin] PATH_INFO: `/v3/projects` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:03:02.710760 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755e5f75-84fa-4be6-b293-06ce5a4f95ab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:03:02.713780 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783bdeb6-31a9-4ac1-94de-70b859eb932f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:03:02.714629 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783bdeb6-31a9-4ac1-94de-70b859eb932f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:03:02.714963 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783bdeb6-31a9-4ac1-94de-70b859eb932f admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:03:02.715285 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783bdeb6-31a9-4ac1-94de-70b859eb932f admin admin] PATH_INFO: `/v3/users/366b3ff4b8114d8dbd2d7ab9d8b962e5` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:03:02.718944 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783bdeb6-31a9-4ac1-94de-70b859eb932f admin admin] RBAC: Authorizing `identity:delete_user(user_id=366b3ff4b8114d8dbd2d7ab9d8b962e5)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:03:02.722040 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755e5f75-84fa-4be6-b293-06ce5a4f95ab admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:03:02.722732 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783bdeb6-31a9-4ac1-94de-70b859eb932f admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:03:02.787753 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1268/2501] 10.222.0.15 () {60 vars in 1153 bytes} [Sun Oct 9 01:03:02 2022] POST /identity/v3/projects => generated 373 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 09 01:03:02.791053 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755e5f75-84fa-4be6-b293-06ce5a4f95ab admin admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:03:02.793799 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-755e5f75-84fa-4be6-b293-06ce5a4f95ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:03:02.861878 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-783bdeb6-31a9-4ac1-94de-70b859eb932f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '366b3ff4b8114d8dbd2d7ab9d8b962e5'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:03:02.888191 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-783bdeb6-31a9-4ac1-94de-70b859eb932f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '366b3ff4b8114d8dbd2d7ab9d8b962e5'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:03:02.889402 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-783bdeb6-31a9-4ac1-94de-70b859eb932f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '366b3ff4b8114d8dbd2d7ab9d8b962e5'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:03:02.890386 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-783bdeb6-31a9-4ac1-94de-70b859eb932f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '366b3ff4b8114d8dbd2d7ab9d8b962e5'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:03:02.905590 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755e5f75-84fa-4be6-b293-06ce5a4f95ab admin admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:03:02.908375 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-783bdeb6-31a9-4ac1-94de-70b859eb932f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '366b3ff4b8114d8dbd2d7ab9d8b962e5'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:03:02.915193 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6ac421-70a2-498f-83ed-af96a4ab43e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:03:02.916735 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6ac421-70a2-498f-83ed-af96a4ab43e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:03:02.917169 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6ac421-70a2-498f-83ed-af96a4ab43e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:03:02.917596 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6ac421-70a2-498f-83ed-af96a4ab43e6 admin admin] PATH_INFO: `/v3/projects/578f83af27b04f959c79832a3e920766` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:03:02.919490 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6ac421-70a2-498f-83ed-af96a4ab43e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=578f83af27b04f959c79832a3e920766)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:03:02.923073 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6ac421-70a2-498f-83ed-af96a4ab43e6 admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:03:02.924643 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 01:03:02.949584 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1234/2502] 10.222.0.15 () {58 vars in 1224 bytes} [Sun Oct 9 01:03:02 2022] DELETE /identity/v3/users/366b3ff4b8114d8dbd2d7ab9d8b962e5 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 01:03:02.956853 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783bdeb6-31a9-4ac1-94de-70b859eb932f admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:03:02.959096 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-783bdeb6-31a9-4ac1-94de-70b859eb932f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:03:03.031714 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-4f6ac421-70a2-498f-83ed-af96a4ab43e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '578f83af27b04f959c79832a3e920766', 'request_id': 'req-4f6ac421-70a2-498f-83ed-af96a4ab43e6'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:03:03.062537 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-4f6ac421-70a2-498f-83ed-af96a4ab43e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '578f83af27b04f959c79832a3e920766', 'request_id': 'req-4f6ac421-70a2-498f-83ed-af96a4ab43e6'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:03:03.091817 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-4f6ac421-70a2-498f-83ed-af96a4ab43e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '578f83af27b04f959c79832a3e920766', 'request_id': 'req-4f6ac421-70a2-498f-83ed-af96a4ab43e6'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:03:03.110392 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783bdeb6-31a9-4ac1-94de-70b859eb932f admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:03:03.120627 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-4f6ac421-70a2-498f-83ed-af96a4ab43e6 admin admin] The token cache is being invalidate because project 578f83af27b04f959c79832a3e920766 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81525) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 09 01:03:03.121185 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-4f6ac421-70a2-498f-83ed-af96a4ab43e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:03:03.123132 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-4f6ac421-70a2-498f-83ed-af96a4ab43e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:03:03.125757 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1269/2503] 10.222.0.15 () {58 vars in 1233 bytes} [Sun Oct 9 01:03:02 2022] DELETE /identity/v3/projects/578f83af27b04f959c79832a3e920766 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 01:03:03.132389 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc5e32c-e3d4-4e62-97da-842ce2f38766 None None] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:03:03.132980 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc5e32c-e3d4-4e62-97da-842ce2f38766 None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:03:03.133396 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc5e32c-e3d4-4e62-97da-842ce2f38766 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:03:03.181660 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.auth.core [None req-7fc5e32c-e3d4-4e62-97da-842ce2f38766 None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 01:03:03.183612 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-7fc5e32c-e3d4-4e62-97da-842ce2f38766 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:03:03.214151 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 01:03:03.275302 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ed289c-2ecd-4908-87d3-4616da25b42d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:03:03.276145 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ed289c-2ecd-4908-87d3-4616da25b42d admin admin] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:03:03.276431 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ed289c-2ecd-4908-87d3-4616da25b42d admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:03:03.276708 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ed289c-2ecd-4908-87d3-4616da25b42d admin admin] PATH_INFO: `/v3/users` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:03:03.277382 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ed289c-2ecd-4908-87d3-4616da25b42d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:03:03.279993 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ed289c-2ecd-4908-87d3-4616da25b42d admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:03:03.307234 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1270/2504] 10.222.0.15 () {58 vars in 958 bytes} [Sun Oct 9 01:03:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 01:03:03.310097 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc5e32c-e3d4-4e62-97da-842ce2f38766 None None] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:03:03.316482 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-7fc5e32c-e3d4-4e62-97da-842ce2f38766 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:03:03.332829 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1235/2505] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Oct 9 01:03:02 2022] POST /identity/v3/users => generated 287 bytes in 383 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 09 01:03:03.336636 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca240ce2-65c2-48f2-ae86-90db1749472d None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:03:03.337522 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca240ce2-65c2-48f2-ae86-90db1749472d None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:03:03.338057 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca240ce2-65c2-48f2-ae86-90db1749472d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:03:03.340243 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc5e32c-e3d4-4e62-97da-842ce2f38766 None None] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:03:03.346457 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf43982-a1d7-47e7-9cb1-7b000ba43fda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:03:03.347170 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf43982-a1d7-47e7-9cb1-7b000ba43fda admin admin] REQUEST_METHOD: `DELETE` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:03:03.347783 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf43982-a1d7-47e7-9cb1-7b000ba43fda admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:03:03.347951 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf43982-a1d7-47e7-9cb1-7b000ba43fda admin admin] PATH_INFO: `/v3/projects/a7986203bd9f47039d130daa94a34cfe` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:03:03.349249 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf43982-a1d7-47e7-9cb1-7b000ba43fda admin admin] RBAC: Authorizing `identity:delete_project(project_id=a7986203bd9f47039d130daa94a34cfe)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:03:03.351450 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf43982-a1d7-47e7-9cb1-7b000ba43fda admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:03:03.373802 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-ca240ce2-65c2-48f2-ae86-90db1749472d None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 01:03:03.376171 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-ca240ce2-65c2-48f2-ae86-90db1749472d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:03:03.391410 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1236/2506] 10.222.0.15 () {58 vars in 958 bytes} [Sun Oct 9 01:03:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 01:03:03.393128 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca240ce2-65c2-48f2-ae86-90db1749472d None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:03:03.395550 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-ca240ce2-65c2-48f2-ae86-90db1749472d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:03:03.422759 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca240ce2-65c2-48f2-ae86-90db1749472d None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:03:03.439066 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-9bf43982-a1d7-47e7-9cb1-7b000ba43fda admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a7986203bd9f47039d130daa94a34cfe', 'request_id': 'req-9bf43982-a1d7-47e7-9cb1-7b000ba43fda'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:03:03.455027 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-9bf43982-a1d7-47e7-9cb1-7b000ba43fda admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a7986203bd9f47039d130daa94a34cfe', 'request_id': 'req-9bf43982-a1d7-47e7-9cb1-7b000ba43fda'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:03:03.472645 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-9bf43982-a1d7-47e7-9cb1-7b000ba43fda admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a7986203bd9f47039d130daa94a34cfe', 'request_id': 'req-9bf43982-a1d7-47e7-9cb1-7b000ba43fda'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:03:03.494885 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-9bf43982-a1d7-47e7-9cb1-7b000ba43fda admin admin] The token cache is being invalidate because project a7986203bd9f47039d130daa94a34cfe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81525) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 09 01:03:03.495611 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-9bf43982-a1d7-47e7-9cb1-7b000ba43fda admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:03:03.497357 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-9bf43982-a1d7-47e7-9cb1-7b000ba43fda admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:03:03.500265 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1271/2507] 10.222.0.15 () {58 vars in 1233 bytes} [Sun Oct 9 01:03:03 2022] DELETE /identity/v3/projects/a7986203bd9f47039d130daa94a34cfe => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 01:03:03.502193 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf43982-a1d7-47e7-9cb1-7b000ba43fda admin admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:03:03.512276 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-9bf43982-a1d7-47e7-9cb1-7b000ba43fda admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:03:03.529271 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912deb4a-8630-4199-b505-8e744810ed4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:03:03.530466 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912deb4a-8630-4199-b505-8e744810ed4d admin admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:03:03.530950 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912deb4a-8630-4199-b505-8e744810ed4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:03:03.531423 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912deb4a-8630-4199-b505-8e744810ed4d admin admin] PATH_INFO: `/v3/roles` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:03:03.532433 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912deb4a-8630-4199-b505-8e744810ed4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:03:03.534487 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912deb4a-8630-4199-b505-8e744810ed4d admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:03:03.551774 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1237/2508] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Oct 9 01:03:03 2022] GET /identity/v3/roles => generated 1420 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 09 01:03:03.557724 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912deb4a-8630-4199-b505-8e744810ed4d admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:03:03.559050 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf43982-a1d7-47e7-9cb1-7b000ba43fda admin admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:03:03.560602 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-912deb4a-8630-4199-b505-8e744810ed4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:03:03.568479 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e8013d-9c1b-4c33-8ffa-04f8345e1a38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:03:03.570916 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e8013d-9c1b-4c33-8ffa-04f8345e1a38 admin admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:03:03.570916 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e8013d-9c1b-4c33-8ffa-04f8345e1a38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:03:03.571550 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e8013d-9c1b-4c33-8ffa-04f8345e1a38 admin admin] PATH_INFO: `/v3/domains` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:03:03.572959 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e8013d-9c1b-4c33-8ffa-04f8345e1a38 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 01:03:03.573616 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e8013d-9c1b-4c33-8ffa-04f8345e1a38 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:03:03.577019 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e8013d-9c1b-4c33-8ffa-04f8345e1a38 admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:03:03.588547 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912deb4a-8630-4199-b505-8e744810ed4d admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:03:03.594792 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16af40e1-01df-4c74-aaba-d8e7f5f213c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:03:03.595757 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16af40e1-01df-4c74-aaba-d8e7f5f213c7 admin admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:03:03.596180 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16af40e1-01df-4c74-aaba-d8e7f5f213c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:03:03.596733 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16af40e1-01df-4c74-aaba-d8e7f5f213c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:03:03.597762 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16af40e1-01df-4c74-aaba-d8e7f5f213c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:03:03.599580 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16af40e1-01df-4c74-aaba-d8e7f5f213c7 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:03:03.611750 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1272/2509] 10.222.0.15 () {58 vars in 1153 bytes} [Sun Oct 9 01:03:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 01:03:03.619895 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1238/2510] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Oct 9 01:03:03 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 09 01:03:03.620185 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e8013d-9c1b-4c33-8ffa-04f8345e1a38 admin admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:03:03.622200 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16af40e1-01df-4c74-aaba-d8e7f5f213c7 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:03:03.634798 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 01:03:03.640605 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16af40e1-01df-4c74-aaba-d8e7f5f213c7 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:03:03.650354 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e8013d-9c1b-4c33-8ffa-04f8345e1a38 admin admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:03:03.654821 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe48450-93f7-48a2-913a-91b90205c3a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:03:03.655845 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe48450-93f7-48a2-913a-91b90205c3a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:03:03.656228 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe48450-93f7-48a2-913a-91b90205c3a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:03:03.656623 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe48450-93f7-48a2-913a-91b90205c3a6 admin admin] PATH_INFO: `/v3/projects/5bc84fa6d13449be96f3fc98a0457a30/users/112d86f581d54523b8b001d2b8fea404/roles/afb0a01183d9497795eaa4fa1a4046ae` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:03:03.674601 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a79cdbd-0be8-446a-af6b-3dec6f72f4a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:03:03.675441 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a79cdbd-0be8-446a-af6b-3dec6f72f4a7 admin admin] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:03:03.675818 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a79cdbd-0be8-446a-af6b-3dec6f72f4a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:03:03.676259 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a79cdbd-0be8-446a-af6b-3dec6f72f4a7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:03:03.676473 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe48450-93f7-48a2-913a-91b90205c3a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5bc84fa6d13449be96f3fc98a0457a30, user_id=112d86f581d54523b8b001d2b8fea404, role_id=afb0a01183d9497795eaa4fa1a4046ae)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:03:03.677108 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a79cdbd-0be8-446a-af6b-3dec6f72f4a7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:03:03.679558 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe48450-93f7-48a2-913a-91b90205c3a6 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:03:03.679873 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a79cdbd-0be8-446a-af6b-3dec6f72f4a7 admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:03:03.706809 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1239/2511] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Oct 9 01:03:03 2022] PUT /identity/v3/projects/5bc84fa6d13449be96f3fc98a0457a30/users/112d86f581d54523b8b001d2b8fea404/roles/afb0a01183d9497795eaa4fa1a4046ae => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 01:03:03.721903 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945da28d-f0b2-4eaf-a6c2-7e1226fd1098 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:03:03.722324 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945da28d-f0b2-4eaf-a6c2-7e1226fd1098 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:03:03.723621 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945da28d-f0b2-4eaf-a6c2-7e1226fd1098 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:03:03.755349 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1273/2512] 10.222.0.15 () {60 vars in 1153 bytes} [Sun Oct 9 01:03:03 2022] POST /identity/v3/projects => generated 387 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 09 01:03:03.761196 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a79cdbd-0be8-446a-af6b-3dec6f72f4a7 admin admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:03:03.781552 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-945da28d-f0b2-4eaf-a6c2-7e1226fd1098 None None] MFA Rules not processed for user `112d86f581d54523b8b001d2b8fea404`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 01:03:03.784210 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-945da28d-f0b2-4eaf-a6c2-7e1226fd1098 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:03:03.901630 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1240/2513] 10.222.0.15 () {58 vars in 958 bytes} [Sun Oct 9 01:03:03 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 09 01:03:03.923053 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945da28d-f0b2-4eaf-a6c2-7e1226fd1098 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:03:03.925756 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a79cdbd-0be8-446a-af6b-3dec6f72f4a7 admin admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:03:03.926303 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-945da28d-f0b2-4eaf-a6c2-7e1226fd1098 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:03:03.935020 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ddf375-f592-437b-8e0d-3805192baa11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:03:03.935708 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ddf375-f592-437b-8e0d-3805192baa11 admin admin] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:03:03.936123 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ddf375-f592-437b-8e0d-3805192baa11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:03:03.936558 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ddf375-f592-437b-8e0d-3805192baa11 admin admin] PATH_INFO: `/v3/users` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:03:03.937730 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ddf375-f592-437b-8e0d-3805192baa11 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:03:03.943373 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ddf375-f592-437b-8e0d-3805192baa11 admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:03:03.974652 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 01:03:03.993923 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1274/2514] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Oct 9 01:03:03 2022] POST /identity/v3/users => generated 294 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 09 01:03:03.996269 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ddf375-f592-437b-8e0d-3805192baa11 admin admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:03:04.019232 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ddf375-f592-437b-8e0d-3805192baa11 admin admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:03:04.026142 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8b3908-1cf8-4609-b122-cbb2e2055594 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:03:04.027159 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8b3908-1cf8-4609-b122-cbb2e2055594 admin admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:03:04.027654 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8b3908-1cf8-4609-b122-cbb2e2055594 admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:03:04.028149 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8b3908-1cf8-4609-b122-cbb2e2055594 admin admin] PATH_INFO: `/v3/roles` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:03:04.029016 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8b3908-1cf8-4609-b122-cbb2e2055594 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:03:04.031016 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8b3908-1cf8-4609-b122-cbb2e2055594 admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:03:04.043911 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1275/2515] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Oct 9 01:03:03 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 09 01:03:04.047626 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945da28d-f0b2-4eaf-a6c2-7e1226fd1098 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:03:04.049589 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8b3908-1cf8-4609-b122-cbb2e2055594 admin admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:03:04.061119 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8b3908-1cf8-4609-b122-cbb2e2055594 admin admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:03:04.064475 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870eb811-c8c9-4275-aa2c-85e750dd1fa9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff7cb78bcd91467abe5c2e2b48aedd1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f148d39ced534860abfbe8fc3f98ace4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:03:04.065686 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870eb811-c8c9-4275-aa2c-85e750dd1fa9 service cinder] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:03:04.066244 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870eb811-c8c9-4275-aa2c-85e750dd1fa9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:03:04.066802 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870eb811-c8c9-4275-aa2c-85e750dd1fa9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:03:04.075674 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da10b82-9a52-41f9-adbb-7d37d5336cfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:03:04.076922 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da10b82-9a52-41f9-adbb-7d37d5336cfe admin admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:03:04.077609 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da10b82-9a52-41f9-adbb-7d37d5336cfe admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:03:04.078073 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da10b82-9a52-41f9-adbb-7d37d5336cfe admin admin] PATH_INFO: `/v3/roles` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:03:04.078956 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da10b82-9a52-41f9-adbb-7d37d5336cfe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:03:04.081343 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da10b82-9a52-41f9-adbb-7d37d5336cfe admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:03:04.084615 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870eb811-c8c9-4275-aa2c-85e750dd1fa9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:03:04.087432 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870eb811-c8c9-4275-aa2c-85e750dd1fa9 service cinder] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:03:04.101466 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1276/2516] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Oct 9 01:03:04 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 09 01:03:04.107974 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da10b82-9a52-41f9-adbb-7d37d5336cfe admin admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:03:04.123178 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1241/2517] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Oct 9 01:03:03 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 09 01:03:04.123415 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da10b82-9a52-41f9-adbb-7d37d5336cfe admin admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:03:04.130609 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60eaef2f-5a2d-43d8-8b6d-31a70a4aa8a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:03:04.131667 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eaef2f-5a2d-43d8-8b6d-31a70a4aa8a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:03:04.131984 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eaef2f-5a2d-43d8-8b6d-31a70a4aa8a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:03:04.132304 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eaef2f-5a2d-43d8-8b6d-31a70a4aa8a4 admin admin] PATH_INFO: `/v3/projects/6a6c741177c1454996438e734fe2f093/users/44d1f85e5a4142ed9e6c4dd8056d9c7c/roles/afb0a01183d9497795eaa4fa1a4046ae` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:03:04.152714 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60eaef2f-5a2d-43d8-8b6d-31a70a4aa8a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a6c741177c1454996438e734fe2f093, user_id=44d1f85e5a4142ed9e6c4dd8056d9c7c, role_id=afb0a01183d9497795eaa4fa1a4046ae)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:03:04.155685 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60eaef2f-5a2d-43d8-8b6d-31a70a4aa8a4 admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:03:04.175724 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1277/2518] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Oct 9 01:03:04 2022] PUT /identity/v3/projects/6a6c741177c1454996438e734fe2f093/users/44d1f85e5a4142ed9e6c4dd8056d9c7c/roles/afb0a01183d9497795eaa4fa1a4046ae => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 01:03:04.189547 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61528956-9209-443a-ae12-3031fa3dafdd None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:03:04.189874 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61528956-9209-443a-ae12-3031fa3dafdd None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:03:04.190164 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61528956-9209-443a-ae12-3031fa3dafdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:03:04.226842 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-61528956-9209-443a-ae12-3031fa3dafdd None None] MFA Rules not processed for user `44d1f85e5a4142ed9e6c4dd8056d9c7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 01:03:04.229039 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-61528956-9209-443a-ae12-3031fa3dafdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:03:04.398428 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1242/2519] 10.222.0.15 () {58 vars in 958 bytes} [Sun Oct 9 01:03:04 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 01:03:04.403494 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60eaef2f-5a2d-43d8-8b6d-31a70a4aa8a4 admin admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:03:04.577292 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60eaef2f-5a2d-43d8-8b6d-31a70a4aa8a4 admin admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:03:04.594469 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14f5d87-eca8-42ba-9b06-a2e13c7402ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:03:04.595976 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14f5d87-eca8-42ba-9b06-a2e13c7402ea admin admin] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:03:04.596919 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14f5d87-eca8-42ba-9b06-a2e13c7402ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:03:04.597644 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14f5d87-eca8-42ba-9b06-a2e13c7402ea admin admin] PATH_INFO: `/v3/projects` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:03:04.599643 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14f5d87-eca8-42ba-9b06-a2e13c7402ea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:03:04.606230 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14f5d87-eca8-42ba-9b06-a2e13c7402ea admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:03:04.677152 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1278/2520] 10.222.0.15 () {60 vars in 1153 bytes} [Sun Oct 9 01:03:04 2022] POST /identity/v3/projects => generated 389 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 09 01:03:04.683528 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61528956-9209-443a-ae12-3031fa3dafdd None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:03:04.691009 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 01:03:04.720074 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61528956-9209-443a-ae12-3031fa3dafdd None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:03:04.881632 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbeabee-f7da-4889-aa9a-47929a66dd35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:03:04.882329 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbeabee-f7da-4889-aa9a-47929a66dd35 admin admin] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:03:04.882642 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbeabee-f7da-4889-aa9a-47929a66dd35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:03:04.883001 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbeabee-f7da-4889-aa9a-47929a66dd35 admin admin] PATH_INFO: `/v3/users` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:03:04.883829 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbeabee-f7da-4889-aa9a-47929a66dd35 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:03:04.885998 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbeabee-f7da-4889-aa9a-47929a66dd35 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:03:04.918440 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1243/2521] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Oct 9 01:03:04 2022] POST /identity/v3/users => generated 301 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 09 01:03:04.924337 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14f5d87-eca8-42ba-9b06-a2e13c7402ea admin admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:03:04.936521 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14f5d87-eca8-42ba-9b06-a2e13c7402ea admin admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:03:04.941494 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74de0a4-16bc-489a-9a3b-b237adb2310e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:03:04.942125 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74de0a4-16bc-489a-9a3b-b237adb2310e admin admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:03:04.942449 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74de0a4-16bc-489a-9a3b-b237adb2310e admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:03:04.942886 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74de0a4-16bc-489a-9a3b-b237adb2310e admin admin] PATH_INFO: `/v3/roles` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:03:04.943605 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74de0a4-16bc-489a-9a3b-b237adb2310e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:03:04.945297 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74de0a4-16bc-489a-9a3b-b237adb2310e admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:03:04.966422 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1279/2522] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Oct 9 01:03:04 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 09 01:03:04.970215 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbeabee-f7da-4889-aa9a-47929a66dd35 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:03:04.989440 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbeabee-f7da-4889-aa9a-47929a66dd35 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:03:05.000228 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1955fc43-f084-464d-b6f8-b00d11c3f11f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:03:05.001392 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1955fc43-f084-464d-b6f8-b00d11c3f11f admin admin] REQUEST_METHOD: `PUT` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:03:05.002047 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1955fc43-f084-464d-b6f8-b00d11c3f11f admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:03:05.002544 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1955fc43-f084-464d-b6f8-b00d11c3f11f admin admin] PATH_INFO: `/v3/projects/1da2542fff9247c49fa4f5be6d85f85f/users/1ec40392deb34166a54882cd84464148/roles/f69dddf26daf4dd79d4c962beb877af5` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:03:05.034180 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1955fc43-f084-464d-b6f8-b00d11c3f11f admin admin] RBAC: Authorizing `identity:create_grant(project_id=1da2542fff9247c49fa4f5be6d85f85f, user_id=1ec40392deb34166a54882cd84464148, role_id=f69dddf26daf4dd79d4c962beb877af5)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:03:05.038739 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1955fc43-f084-464d-b6f8-b00d11c3f11f admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:03:05.063700 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1244/2523] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Oct 9 01:03:04 2022] PUT /identity/v3/projects/1da2542fff9247c49fa4f5be6d85f85f/users/1ec40392deb34166a54882cd84464148/roles/f69dddf26daf4dd79d4c962beb877af5 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 01:03:05.069839 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74de0a4-16bc-489a-9a3b-b237adb2310e admin admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:03:05.084942 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74de0a4-16bc-489a-9a3b-b237adb2310e admin admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:03:05.191948 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e79848a-816c-483d-a518-5402ff7757f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:03:05.192765 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e79848a-816c-483d-a518-5402ff7757f5 admin admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:03:05.193189 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e79848a-816c-483d-a518-5402ff7757f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:03:05.193815 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e79848a-816c-483d-a518-5402ff7757f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:03:05.194862 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e79848a-816c-483d-a518-5402ff7757f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:03:05.197285 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e79848a-816c-483d-a518-5402ff7757f5 admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:03:05.213720 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1280/2524] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Oct 9 01:03:05 2022] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 09 01:03:05.220061 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1955fc43-f084-464d-b6f8-b00d11c3f11f admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:03:05.236208 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1955fc43-f084-464d-b6f8-b00d11c3f11f admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:03:05.247889 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44115aeb-5357-404e-81af-dd521adf979c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:03:05.248756 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44115aeb-5357-404e-81af-dd521adf979c admin admin] REQUEST_METHOD: `PUT` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:03:05.251180 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44115aeb-5357-404e-81af-dd521adf979c admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:03:05.251655 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44115aeb-5357-404e-81af-dd521adf979c admin admin] PATH_INFO: `/v3/projects/1da2542fff9247c49fa4f5be6d85f85f/users/1ec40392deb34166a54882cd84464148/roles/f69dddf26daf4dd79d4c962beb877af5` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:03:05.256119 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44115aeb-5357-404e-81af-dd521adf979c admin admin] RBAC: Authorizing `identity:create_grant(project_id=1da2542fff9247c49fa4f5be6d85f85f, user_id=1ec40392deb34166a54882cd84464148, role_id=f69dddf26daf4dd79d4c962beb877af5)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:03:05.262155 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44115aeb-5357-404e-81af-dd521adf979c admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:03:05.280488 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1245/2525] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Oct 9 01:03:05 2022] PUT /identity/v3/projects/1da2542fff9247c49fa4f5be6d85f85f/users/1ec40392deb34166a54882cd84464148/roles/f69dddf26daf4dd79d4c962beb877af5 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 01:03:05.295089 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c750488-09f7-432e-8e27-ed72894af23d None None] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:03:05.295674 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c750488-09f7-432e-8e27-ed72894af23d None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:03:05.297110 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c750488-09f7-432e-8e27-ed72894af23d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:03:05.340607 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.auth.core [None req-6c750488-09f7-432e-8e27-ed72894af23d None None] MFA Rules not processed for user `1ec40392deb34166a54882cd84464148`. Rule list: `[]` (Enabled: `True`). {{(pid=81525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 01:03:05.342839 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-6c750488-09f7-432e-8e27-ed72894af23d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:03:05.366852 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 01:03:05.485576 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1281/2526] 10.222.0.15 () {58 vars in 958 bytes} [Sun Oct 9 01:03:05 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 01:03:05.499704 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44115aeb-5357-404e-81af-dd521adf979c admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:03:05.576081 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44115aeb-5357-404e-81af-dd521adf979c admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:03:05.580399 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64853124-fd7a-41e3-a81e-e131d016bf80 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff7cb78bcd91467abe5c2e2b48aedd1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f148d39ced534860abfbe8fc3f98ace4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:03:05.581198 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64853124-fd7a-41e3-a81e-e131d016bf80 service cinder] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:03:05.581691 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64853124-fd7a-41e3-a81e-e131d016bf80 service cinder] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:03:05.582067 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64853124-fd7a-41e3-a81e-e131d016bf80 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:03:05.593350 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64853124-fd7a-41e3-a81e-e131d016bf80 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:03:05.594960 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64853124-fd7a-41e3-a81e-e131d016bf80 service cinder] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:03:05.605924 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1246/2527] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Oct 9 01:03:05 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 09 01:03:05.782334 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c750488-09f7-432e-8e27-ed72894af23d None None] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:03:05.897417 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2683b958-7f21-4951-8d2d-f4a37596cdee None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:03:05.897417 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2683b958-7f21-4951-8d2d-f4a37596cdee None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:03:05.897417 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2683b958-7f21-4951-8d2d-f4a37596cdee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:03:05.901934 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c750488-09f7-432e-8e27-ed72894af23d None None] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:03:05.907888 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a37b01-d51d-4ea3-a656-5e232ed3b8d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:03:05.908546 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a37b01-d51d-4ea3-a656-5e232ed3b8d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:03:05.908812 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a37b01-d51d-4ea3-a656-5e232ed3b8d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:03:05.909086 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a37b01-d51d-4ea3-a656-5e232ed3b8d9 admin admin] PATH_INFO: `/v3/users/44d1f85e5a4142ed9e6c4dd8056d9c7c` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:03:05.910495 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a37b01-d51d-4ea3-a656-5e232ed3b8d9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=44d1f85e5a4142ed9e6c4dd8056d9c7c)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:03:05.913117 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a37b01-d51d-4ea3-a656-5e232ed3b8d9 admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:03:05.917812 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-2683b958-7f21-4951-8d2d-f4a37596cdee None None] MFA Rules not processed for user `112d86f581d54523b8b001d2b8fea404`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 01:03:05.920071 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-2683b958-7f21-4951-8d2d-f4a37596cdee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:03:05.982940 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-08a37b01-d51d-4ea3-a656-5e232ed3b8d9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '44d1f85e5a4142ed9e6c4dd8056d9c7c'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:03:05.997149 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-08a37b01-d51d-4ea3-a656-5e232ed3b8d9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '44d1f85e5a4142ed9e6c4dd8056d9c7c'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:03:05.998393 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-08a37b01-d51d-4ea3-a656-5e232ed3b8d9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '44d1f85e5a4142ed9e6c4dd8056d9c7c'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:03:05.999522 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-08a37b01-d51d-4ea3-a656-5e232ed3b8d9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '44d1f85e5a4142ed9e6c4dd8056d9c7c'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:03:06.012407 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-08a37b01-d51d-4ea3-a656-5e232ed3b8d9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '44d1f85e5a4142ed9e6c4dd8056d9c7c'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:03:06.012924 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1247/2528] 10.222.0.15 () {58 vars in 958 bytes} [Sun Oct 9 01:03:05 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 09 01:03:06.019805 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2683b958-7f21-4951-8d2d-f4a37596cdee None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:03:06.019805 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-2683b958-7f21-4951-8d2d-f4a37596cdee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:03:06.023835 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 01:03:06.031104 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2683b958-7f21-4951-8d2d-f4a37596cdee None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:03:06.040180 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d44c2a4-fb5e-4fa1-b76d-ad1d4e265da7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:03:06.041055 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d44c2a4-fb5e-4fa1-b76d-ad1d4e265da7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:03:06.041401 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d44c2a4-fb5e-4fa1-b76d-ad1d4e265da7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:03:06.041765 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d44c2a4-fb5e-4fa1-b76d-ad1d4e265da7 admin admin] PATH_INFO: `/v3/users/6e7c8609723e4e5795c0b84ae2accaee` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:03:06.042967 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1282/2529] 10.222.0.15 () {58 vars in 1224 bytes} [Sun Oct 9 01:03:05 2022] DELETE /identity/v3/users/44d1f85e5a4142ed9e6c4dd8056d9c7c => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 01:03:06.043684 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d44c2a4-fb5e-4fa1-b76d-ad1d4e265da7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6e7c8609723e4e5795c0b84ae2accaee)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:03:06.047065 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d44c2a4-fb5e-4fa1-b76d-ad1d4e265da7 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:03:06.048017 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870b35dd-1e14-4db3-9a4c-4c19eaf30640 None None] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:03:06.048302 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870b35dd-1e14-4db3-9a4c-4c19eaf30640 None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:03:06.048547 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870b35dd-1e14-4db3-9a4c-4c19eaf30640 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:03:06.071088 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.auth.core [None req-870b35dd-1e14-4db3-9a4c-4c19eaf30640 None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 01:03:06.072556 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-870b35dd-1e14-4db3-9a4c-4c19eaf30640 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:03:06.122492 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-7d44c2a4-fb5e-4fa1-b76d-ad1d4e265da7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6e7c8609723e4e5795c0b84ae2accaee'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:03:06.125210 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 01:03:06.131962 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-7d44c2a4-fb5e-4fa1-b76d-ad1d4e265da7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6e7c8609723e4e5795c0b84ae2accaee'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:03:06.132771 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-7d44c2a4-fb5e-4fa1-b76d-ad1d4e265da7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6e7c8609723e4e5795c0b84ae2accaee'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:03:06.133506 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-7d44c2a4-fb5e-4fa1-b76d-ad1d4e265da7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6e7c8609723e4e5795c0b84ae2accaee'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:03:06.145312 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-7d44c2a4-fb5e-4fa1-b76d-ad1d4e265da7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6e7c8609723e4e5795c0b84ae2accaee'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:03:06.174495 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1248/2530] 10.222.0.15 () {58 vars in 1224 bytes} [Sun Oct 9 01:03:06 2022] DELETE /identity/v3/users/6e7c8609723e4e5795c0b84ae2accaee => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 01:03:06.179041 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c01b1c-371d-42ef-a330-ce7712422b19 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:03:06.179473 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c01b1c-371d-42ef-a330-ce7712422b19 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:03:06.179844 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c01b1c-371d-42ef-a330-ce7712422b19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:03:06.215239 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1283/2531] 10.222.0.15 () {58 vars in 958 bytes} [Sun Oct 9 01:03:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 09 01:03:06.220468 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-72c01b1c-371d-42ef-a330-ce7712422b19 None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 01:03:06.223161 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-72c01b1c-371d-42ef-a330-ce7712422b19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:03:06.232269 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870b35dd-1e14-4db3-9a4c-4c19eaf30640 None None] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:03:06.234706 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-870b35dd-1e14-4db3-9a4c-4c19eaf30640 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:03:06.345512 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870b35dd-1e14-4db3-9a4c-4c19eaf30640 None None] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:03:06.367346 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1249/2532] 10.222.0.15 () {58 vars in 958 bytes} [Sun Oct 9 01:03:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 01:03:06.392539 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c01b1c-371d-42ef-a330-ce7712422b19 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:03:06.508902 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1503eaf-9e61-4e96-bb23-e4cb61b00729 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4ef90d456d2483e8ddafbe2d4d4fb5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f148d39ced534860abfbe8fc3f98ace4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:03:06.512532 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1503eaf-9e61-4e96-bb23-e4cb61b00729 service neutron] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:03:06.513180 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1503eaf-9e61-4e96-bb23-e4cb61b00729 service neutron] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:03:06.516446 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1503eaf-9e61-4e96-bb23-e4cb61b00729 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:03:06.554743 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1503eaf-9e61-4e96-bb23-e4cb61b00729 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:03:06.557494 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1503eaf-9e61-4e96-bb23-e4cb61b00729 service neutron] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:03:06.579644 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1284/2533] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Oct 9 01:03:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 09 01:03:06.624715 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c01b1c-371d-42ef-a330-ce7712422b19 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:03:06.637757 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df7299d-451c-4c6b-b044-e4123ee73a20 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4ef90d456d2483e8ddafbe2d4d4fb5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f148d39ced534860abfbe8fc3f98ace4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:03:06.638617 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df7299d-451c-4c6b-b044-e4123ee73a20 service neutron] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:03:06.639044 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df7299d-451c-4c6b-b044-e4123ee73a20 service neutron] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:03:06.639469 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df7299d-451c-4c6b-b044-e4123ee73a20 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:03:06.660408 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df7299d-451c-4c6b-b044-e4123ee73a20 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:03:06.665717 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df7299d-451c-4c6b-b044-e4123ee73a20 service neutron] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:03:06.690929 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1250/2534] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Oct 9 01:03:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 09 01:03:07.341505 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1503eaf-9e61-4e96-bb23-e4cb61b00729 service neutron] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:03:07.345318 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-f1503eaf-9e61-4e96-bb23-e4cb61b00729 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:03:07.425121 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1503eaf-9e61-4e96-bb23-e4cb61b00729 service neutron] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:03:07.435179 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a859df56-b6b8-4f07-8ddf-3cf6ba4fd658 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:03:07.443469 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a859df56-b6b8-4f07-8ddf-3cf6ba4fd658 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:03:07.443469 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a859df56-b6b8-4f07-8ddf-3cf6ba4fd658 admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:03:07.443469 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a859df56-b6b8-4f07-8ddf-3cf6ba4fd658 admin admin] PATH_INFO: `/v3/projects/6a6c741177c1454996438e734fe2f093` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:03:07.445759 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a859df56-b6b8-4f07-8ddf-3cf6ba4fd658 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6a6c741177c1454996438e734fe2f093)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:03:07.450457 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a859df56-b6b8-4f07-8ddf-3cf6ba4fd658 admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:03:07.466005 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df7299d-451c-4c6b-b044-e4123ee73a20 service neutron] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:03:07.475317 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-8df7299d-451c-4c6b-b044-e4123ee73a20 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:03:07.532215 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df7299d-451c-4c6b-b044-e4123ee73a20 service neutron] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:03:07.562951 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-a859df56-b6b8-4f07-8ddf-3cf6ba4fd658 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6a6c741177c1454996438e734fe2f093', 'request_id': 'req-a859df56-b6b8-4f07-8ddf-3cf6ba4fd658'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:03:07.567356 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 01:03:07.584013 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-a859df56-b6b8-4f07-8ddf-3cf6ba4fd658 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6a6c741177c1454996438e734fe2f093', 'request_id': 'req-a859df56-b6b8-4f07-8ddf-3cf6ba4fd658'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:03:07.605800 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-a859df56-b6b8-4f07-8ddf-3cf6ba4fd658 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6a6c741177c1454996438e734fe2f093', 'request_id': 'req-a859df56-b6b8-4f07-8ddf-3cf6ba4fd658'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:03:07.627645 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-a859df56-b6b8-4f07-8ddf-3cf6ba4fd658 admin admin] The token cache is being invalidate because project 6a6c741177c1454996438e734fe2f093 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81525) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 09 01:03:07.627938 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-a859df56-b6b8-4f07-8ddf-3cf6ba4fd658 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:03:07.628843 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-a859df56-b6b8-4f07-8ddf-3cf6ba4fd658 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:03:07.636057 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1285/2535] 10.222.0.15 () {58 vars in 1233 bytes} [Sun Oct 9 01:03:07 2022] DELETE /identity/v3/projects/6a6c741177c1454996438e734fe2f093 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 01:03:07.638530 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a859df56-b6b8-4f07-8ddf-3cf6ba4fd658 admin admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:03:07.641395 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-a859df56-b6b8-4f07-8ddf-3cf6ba4fd658 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:03:07.680042 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 01:03:07.712572 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1280addd-9bd0-48f6-8af6-91b948307933 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:03:07.713721 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1280addd-9bd0-48f6-8af6-91b948307933 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:03:07.714213 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1280addd-9bd0-48f6-8af6-91b948307933 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:03:07.714739 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1280addd-9bd0-48f6-8af6-91b948307933 admin admin] PATH_INFO: `/v3/projects/f9385682a69941f4bb31d13abd9c3a9c` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:03:07.717489 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1280addd-9bd0-48f6-8af6-91b948307933 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f9385682a69941f4bb31d13abd9c3a9c)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:03:07.721444 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1280addd-9bd0-48f6-8af6-91b948307933 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:03:07.771314 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a859df56-b6b8-4f07-8ddf-3cf6ba4fd658 admin admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:03:07.777203 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6454c0ea-8529-4a93-a25b-8b200eb410b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:03:07.777863 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6454c0ea-8529-4a93-a25b-8b200eb410b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:03:07.778130 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6454c0ea-8529-4a93-a25b-8b200eb410b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:03:07.778395 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6454c0ea-8529-4a93-a25b-8b200eb410b2 admin admin] PATH_INFO: `/v3/users/1ec40392deb34166a54882cd84464148` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:03:07.779683 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6454c0ea-8529-4a93-a25b-8b200eb410b2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1ec40392deb34166a54882cd84464148)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:03:07.781660 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6454c0ea-8529-4a93-a25b-8b200eb410b2 admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:03:07.796366 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-1280addd-9bd0-48f6-8af6-91b948307933 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f9385682a69941f4bb31d13abd9c3a9c', 'request_id': 'req-1280addd-9bd0-48f6-8af6-91b948307933'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:03:07.806770 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-1280addd-9bd0-48f6-8af6-91b948307933 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f9385682a69941f4bb31d13abd9c3a9c', 'request_id': 'req-1280addd-9bd0-48f6-8af6-91b948307933'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:03:07.814757 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-1280addd-9bd0-48f6-8af6-91b948307933 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f9385682a69941f4bb31d13abd9c3a9c', 'request_id': 'req-1280addd-9bd0-48f6-8af6-91b948307933'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:03:07.831931 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-1280addd-9bd0-48f6-8af6-91b948307933 admin admin] The token cache is being invalidate because project f9385682a69941f4bb31d13abd9c3a9c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81524) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 09 01:03:07.832268 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-1280addd-9bd0-48f6-8af6-91b948307933 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:03:07.833378 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-1280addd-9bd0-48f6-8af6-91b948307933 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:03:07.836365 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1251/2536] 10.222.0.15 () {58 vars in 1233 bytes} [Sun Oct 9 01:03:07 2022] DELETE /identity/v3/projects/f9385682a69941f4bb31d13abd9c3a9c => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 01:03:07.845605 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bea297-cd49-4490-bfcd-b89b01dadb1f None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:03:07.846105 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bea297-cd49-4490-bfcd-b89b01dadb1f None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:03:07.846562 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bea297-cd49-4490-bfcd-b89b01dadb1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:03:07.864593 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-6454c0ea-8529-4a93-a25b-8b200eb410b2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1ec40392deb34166a54882cd84464148'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:03:07.881190 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-6454c0ea-8529-4a93-a25b-8b200eb410b2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1ec40392deb34166a54882cd84464148'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:03:07.882756 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-6454c0ea-8529-4a93-a25b-8b200eb410b2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1ec40392deb34166a54882cd84464148'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:03:07.884083 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-6454c0ea-8529-4a93-a25b-8b200eb410b2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1ec40392deb34166a54882cd84464148'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:03:07.884315 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-92bea297-cd49-4490-bfcd-b89b01dadb1f None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 01:03:07.885933 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-92bea297-cd49-4490-bfcd-b89b01dadb1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:03:07.901137 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-6454c0ea-8529-4a93-a25b-8b200eb410b2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1ec40392deb34166a54882cd84464148'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:03:07.943042 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1286/2537] 10.222.0.15 () {58 vars in 1224 bytes} [Sun Oct 9 01:03:07 2022] DELETE /identity/v3/users/1ec40392deb34166a54882cd84464148 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 01:03:08.043173 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6454c0ea-8529-4a93-a25b-8b200eb410b2 admin admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:03:08.045810 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-6454c0ea-8529-4a93-a25b-8b200eb410b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:03:08.064919 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1252/2538] 10.222.0.15 () {58 vars in 958 bytes} [Sun Oct 9 01:03:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 01:03:08.079773 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a17fcc2-18b7-43a7-8da5-450599d4fdbd None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:03:08.080515 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a17fcc2-18b7-43a7-8da5-450599d4fdbd None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:03:08.081164 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a17fcc2-18b7-43a7-8da5-450599d4fdbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:03:08.125841 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-4a17fcc2-18b7-43a7-8da5-450599d4fdbd None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 01:03:08.129237 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-4a17fcc2-18b7-43a7-8da5-450599d4fdbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:03:08.157665 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6454c0ea-8529-4a93-a25b-8b200eb410b2 admin admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:03:08.188013 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf460380-499f-484b-bff6-598a9b3ed838 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4ef90d456d2483e8ddafbe2d4d4fb5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f148d39ced534860abfbe8fc3f98ace4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:03:08.188013 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf460380-499f-484b-bff6-598a9b3ed838 service neutron] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:03:08.188013 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf460380-499f-484b-bff6-598a9b3ed838 service neutron] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:03:08.188013 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf460380-499f-484b-bff6-598a9b3ed838 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:03:08.205489 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-cf460380-499f-484b-bff6-598a9b3ed838 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:03:08.207502 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 01:03:08.245924 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1253/2539] 10.222.0.15 () {58 vars in 958 bytes} [Sun Oct 9 01:03:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 01:03:08.252141 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a17fcc2-18b7-43a7-8da5-450599d4fdbd None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:03:08.270906 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a17fcc2-18b7-43a7-8da5-450599d4fdbd None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:03:08.280285 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cb6be3-c983-4657-ac62-684392ce9e15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:03:08.281269 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cb6be3-c983-4657-ac62-684392ce9e15 admin admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:03:08.281724 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cb6be3-c983-4657-ac62-684392ce9e15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:03:08.282604 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cb6be3-c983-4657-ac62-684392ce9e15 admin admin] PATH_INFO: `/v3/domains` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:03:08.283520 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cb6be3-c983-4657-ac62-684392ce9e15 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 01:03:08.284098 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cb6be3-c983-4657-ac62-684392ce9e15 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:03:08.287072 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cb6be3-c983-4657-ac62-684392ce9e15 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:03:08.304327 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 01:03:08.318262 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1254/2540] 10.222.0.15 () {58 vars in 1153 bytes} [Sun Oct 9 01:03:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 09 01:03:08.324046 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cb6be3-c983-4657-ac62-684392ce9e15 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:03:08.353726 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cb6be3-c983-4657-ac62-684392ce9e15 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:03:08.355391 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf460380-499f-484b-bff6-598a9b3ed838 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:03:08.358526 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf460380-499f-484b-bff6-598a9b3ed838 service neutron] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:03:08.361983 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbee421-f055-42f4-87fc-49a782341826 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:03:08.363092 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbee421-f055-42f4-87fc-49a782341826 admin admin] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:03:08.363599 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbee421-f055-42f4-87fc-49a782341826 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:03:08.364306 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbee421-f055-42f4-87fc-49a782341826 admin admin] PATH_INFO: `/v3/projects` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:03:08.365728 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbee421-f055-42f4-87fc-49a782341826 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:03:08.369312 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbee421-f055-42f4-87fc-49a782341826 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:03:08.380211 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1287/2541] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Oct 9 01:03:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 09 01:03:08.419761 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1255/2542] 10.222.0.15 () {60 vars in 1153 bytes} [Sun Oct 9 01:03:08 2022] POST /identity/v3/projects => generated 367 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 09 01:03:08.421237 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf460380-499f-484b-bff6-598a9b3ed838 service neutron] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:03:08.442688 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf460380-499f-484b-bff6-598a9b3ed838 service neutron] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:03:08.528293 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbee421-f055-42f4-87fc-49a782341826 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:03:08.531561 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-8bbee421-f055-42f4-87fc-49a782341826 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:03:08.541504 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fe9080-07bc-48cf-aae8-67893fc8780e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:03:08.542559 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fe9080-07bc-48cf-aae8-67893fc8780e admin admin] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:03:08.543088 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fe9080-07bc-48cf-aae8-67893fc8780e admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:03:08.543447 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fe9080-07bc-48cf-aae8-67893fc8780e admin admin] PATH_INFO: `/v3/users` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:03:08.544302 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fe9080-07bc-48cf-aae8-67893fc8780e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:03:08.546961 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fe9080-07bc-48cf-aae8-67893fc8780e admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:03:08.595204 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1288/2543] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Oct 9 01:03:08 2022] POST /identity/v3/users => generated 284 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 09 01:03:08.597080 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fe9080-07bc-48cf-aae8-67893fc8780e admin admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:03:08.618059 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fe9080-07bc-48cf-aae8-67893fc8780e admin admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:03:08.626467 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacccff6-0f4c-4654-9aae-934089c11b9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:03:08.627565 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacccff6-0f4c-4654-9aae-934089c11b9b admin admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:03:08.628104 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacccff6-0f4c-4654-9aae-934089c11b9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:03:08.628580 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacccff6-0f4c-4654-9aae-934089c11b9b admin admin] PATH_INFO: `/v3/roles` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:03:08.629789 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacccff6-0f4c-4654-9aae-934089c11b9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:03:08.632934 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacccff6-0f4c-4654-9aae-934089c11b9b admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:03:08.649504 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbee421-f055-42f4-87fc-49a782341826 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:03:08.661223 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1289/2544] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Oct 9 01:03:08 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 09 01:03:08.662605 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d0777e-8e44-471d-aa98-7a84ee54c9c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:03:08.662785 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacccff6-0f4c-4654-9aae-934089c11b9b admin admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:03:08.664016 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d0777e-8e44-471d-aa98-7a84ee54c9c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:03:08.664549 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d0777e-8e44-471d-aa98-7a84ee54c9c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:03:08.665075 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d0777e-8e44-471d-aa98-7a84ee54c9c6 admin admin] PATH_INFO: `/v3/projects/1da2542fff9247c49fa4f5be6d85f85f` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:03:08.667747 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d0777e-8e44-471d-aa98-7a84ee54c9c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1da2542fff9247c49fa4f5be6d85f85f)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:03:08.670432 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d0777e-8e44-471d-aa98-7a84ee54c9c6 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:03:08.681388 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacccff6-0f4c-4654-9aae-934089c11b9b admin admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:03:08.691318 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93c0a7a-db5f-4e86-8a09-457bd4647584 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:03:08.692222 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93c0a7a-db5f-4e86-8a09-457bd4647584 admin admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:03:08.692714 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93c0a7a-db5f-4e86-8a09-457bd4647584 admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:03:08.693206 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93c0a7a-db5f-4e86-8a09-457bd4647584 admin admin] PATH_INFO: `/v3/roles` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:03:08.696448 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93c0a7a-db5f-4e86-8a09-457bd4647584 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:03:08.697760 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93c0a7a-db5f-4e86-8a09-457bd4647584 admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:03:08.726359 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1290/2545] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Oct 9 01:03:08 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 09 01:03:08.728115 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93c0a7a-db5f-4e86-8a09-457bd4647584 admin admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:03:08.748586 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93c0a7a-db5f-4e86-8a09-457bd4647584 admin admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:03:08.766584 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-b9d0777e-8e44-471d-aa98-7a84ee54c9c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1da2542fff9247c49fa4f5be6d85f85f', 'request_id': 'req-b9d0777e-8e44-471d-aa98-7a84ee54c9c6'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:03:08.780223 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-b9d0777e-8e44-471d-aa98-7a84ee54c9c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1da2542fff9247c49fa4f5be6d85f85f', 'request_id': 'req-b9d0777e-8e44-471d-aa98-7a84ee54c9c6'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:03:08.789189 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-b9d0777e-8e44-471d-aa98-7a84ee54c9c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1da2542fff9247c49fa4f5be6d85f85f', 'request_id': 'req-b9d0777e-8e44-471d-aa98-7a84ee54c9c6'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:03:08.805012 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-b9d0777e-8e44-471d-aa98-7a84ee54c9c6 admin admin] The token cache is being invalidate because project 1da2542fff9247c49fa4f5be6d85f85f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81524) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 09 01:03:08.805362 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-b9d0777e-8e44-471d-aa98-7a84ee54c9c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:03:08.806680 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-b9d0777e-8e44-471d-aa98-7a84ee54c9c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:03:08.811619 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1256/2546] 10.222.0.15 () {58 vars in 1233 bytes} [Sun Oct 9 01:03:08 2022] DELETE /identity/v3/projects/1da2542fff9247c49fa4f5be6d85f85f => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 01:03:08.815792 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bd6c04-afbf-4045-b758-ebee5755cfc5 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:03:08.816082 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bd6c04-afbf-4045-b758-ebee5755cfc5 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:03:08.816492 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bd6c04-afbf-4045-b758-ebee5755cfc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:03:08.849801 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-f5bd6c04-afbf-4045-b758-ebee5755cfc5 None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 01:03:08.852564 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-f5bd6c04-afbf-4045-b758-ebee5755cfc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:03:08.870657 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d37c545-8b25-45dc-bfda-928c28b8edf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:03:08.871521 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d37c545-8b25-45dc-bfda-928c28b8edf6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:03:08.871819 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d37c545-8b25-45dc-bfda-928c28b8edf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:03:08.872091 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d37c545-8b25-45dc-bfda-928c28b8edf6 admin admin] PATH_INFO: `/v3/projects/ae988c55c13041999c0bf8be763e5efd/users/b811527f41e04c139658c7b1a5fcbd66/roles/afb0a01183d9497795eaa4fa1a4046ae` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:03:08.899739 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d37c545-8b25-45dc-bfda-928c28b8edf6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae988c55c13041999c0bf8be763e5efd, user_id=b811527f41e04c139658c7b1a5fcbd66, role_id=afb0a01183d9497795eaa4fa1a4046ae)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:03:08.902900 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d37c545-8b25-45dc-bfda-928c28b8edf6 admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:03:08.925496 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1291/2547] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Oct 9 01:03:08 2022] PUT /identity/v3/projects/ae988c55c13041999c0bf8be763e5efd/users/b811527f41e04c139658c7b1a5fcbd66/roles/afb0a01183d9497795eaa4fa1a4046ae => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 01:03:08.936362 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5e4a5b-5598-4bf4-85bc-d6e30fa621a5 None None] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:03:08.936732 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5e4a5b-5598-4bf4-85bc-d6e30fa621a5 None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:03:08.936922 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5e4a5b-5598-4bf4-85bc-d6e30fa621a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:03:08.957175 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 01:03:08.973777 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.auth.core [None req-5a5e4a5b-5598-4bf4-85bc-d6e30fa621a5 None None] MFA Rules not processed for user `b811527f41e04c139658c7b1a5fcbd66`. Rule list: `[]` (Enabled: `True`). {{(pid=81525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 01:03:08.975616 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-5a5e4a5b-5598-4bf4-85bc-d6e30fa621a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:03:09.001710 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1257/2548] 10.222.0.15 () {58 vars in 958 bytes} [Sun Oct 9 01:03:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 09 01:03:09.005363 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 01:03:09.011902 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2860a6f-1c33-4bfb-b8c5-b4d8d97723f2 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:03:09.011902 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2860a6f-1c33-4bfb-b8c5-b4d8d97723f2 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:03:09.012656 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2860a6f-1c33-4bfb-b8c5-b4d8d97723f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:03:09.056547 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-c2860a6f-1c33-4bfb-b8c5-b4d8d97723f2 None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 01:03:09.059644 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-c2860a6f-1c33-4bfb-b8c5-b4d8d97723f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:03:09.085059 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1292/2549] 10.222.0.15 () {58 vars in 958 bytes} [Sun Oct 9 01:03:08 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 09 01:03:09.097199 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5e4a5b-5598-4bf4-85bc-d6e30fa621a5 None None] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:03:09.098859 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-5a5e4a5b-5598-4bf4-85bc-d6e30fa621a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:03:09.188418 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1258/2550] 10.222.0.15 () {58 vars in 958 bytes} [Sun Oct 9 01:03:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 09 01:03:09.190594 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2860a6f-1c33-4bfb-b8c5-b4d8d97723f2 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:03:09.201109 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5e4a5b-5598-4bf4-85bc-d6e30fa621a5 None None] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:03:09.204251 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2860a6f-1c33-4bfb-b8c5-b4d8d97723f2 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:03:09.208041 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf202d9-cd97-4e13-995d-931e27bd609b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff7cb78bcd91467abe5c2e2b48aedd1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f148d39ced534860abfbe8fc3f98ace4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:03:09.210907 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf202d9-cd97-4e13-995d-931e27bd609b service cinder] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:03:09.210907 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf202d9-cd97-4e13-995d-931e27bd609b service cinder] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:03:09.210907 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf202d9-cd97-4e13-995d-931e27bd609b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:03:09.229284 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511bafeb-bc32-429c-aa89-6da255c75ba0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:03:09.232084 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf202d9-cd97-4e13-995d-931e27bd609b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:03:09.234894 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf202d9-cd97-4e13-995d-931e27bd609b service cinder] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:03:09.235708 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511bafeb-bc32-429c-aa89-6da255c75ba0 admin admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:03:09.236251 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511bafeb-bc32-429c-aa89-6da255c75ba0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:03:09.236708 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511bafeb-bc32-429c-aa89-6da255c75ba0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:03:09.237978 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511bafeb-bc32-429c-aa89-6da255c75ba0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 01:03:09.238512 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511bafeb-bc32-429c-aa89-6da255c75ba0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:03:09.248626 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511bafeb-bc32-429c-aa89-6da255c75ba0 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:03:09.287164 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1293/2551] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Oct 9 01:03:09 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 09 01:03:09.312788 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf202d9-cd97-4e13-995d-931e27bd609b service cinder] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:03:09.313084 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1259/2552] 10.222.0.15 () {58 vars in 1153 bytes} [Sun Oct 9 01:03:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 09 01:03:09.338527 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf202d9-cd97-4e13-995d-931e27bd609b service cinder] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:03:09.351529 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ba152c-2957-4ef8-ab92-727c1c28054d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:03:09.353493 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ba152c-2957-4ef8-ab92-727c1c28054d admin admin] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:03:09.354221 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ba152c-2957-4ef8-ab92-727c1c28054d admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:03:09.354926 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ba152c-2957-4ef8-ab92-727c1c28054d admin admin] PATH_INFO: `/v3/projects` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:03:09.356432 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ba152c-2957-4ef8-ab92-727c1c28054d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:03:09.362740 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ba152c-2957-4ef8-ab92-727c1c28054d admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:03:09.434762 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1294/2553] 10.222.0.15 () {60 vars in 1153 bytes} [Sun Oct 9 01:03:09 2022] POST /identity/v3/projects => generated 365 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 09 01:03:09.441295 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511bafeb-bc32-429c-aa89-6da255c75ba0 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:03:09.462963 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511bafeb-bc32-429c-aa89-6da255c75ba0 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:03:09.584988 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47de5d15-eb1a-467d-ab02-3fa04576aae3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:03:09.586452 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47de5d15-eb1a-467d-ab02-3fa04576aae3 admin admin] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:03:09.587243 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47de5d15-eb1a-467d-ab02-3fa04576aae3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:03:09.587861 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47de5d15-eb1a-467d-ab02-3fa04576aae3 admin admin] PATH_INFO: `/v3/users` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:03:09.589284 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47de5d15-eb1a-467d-ab02-3fa04576aae3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:03:09.593553 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47de5d15-eb1a-467d-ab02-3fa04576aae3 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:03:09.630792 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1260/2554] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Oct 9 01:03:09 2022] POST /identity/v3/users => generated 283 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 09 01:03:09.636385 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ba152c-2957-4ef8-ab92-727c1c28054d admin admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:03:09.656931 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ba152c-2957-4ef8-ab92-727c1c28054d admin admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:03:09.665780 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4751ae-f8f5-4c7f-95c9-a756c3219a57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:03:09.666930 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4751ae-f8f5-4c7f-95c9-a756c3219a57 admin admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:03:09.667557 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4751ae-f8f5-4c7f-95c9-a756c3219a57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:03:09.668106 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4751ae-f8f5-4c7f-95c9-a756c3219a57 admin admin] PATH_INFO: `/v3/roles` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:03:09.669241 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4751ae-f8f5-4c7f-95c9-a756c3219a57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:03:09.671350 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4751ae-f8f5-4c7f-95c9-a756c3219a57 admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:03:09.688400 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1295/2555] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Oct 9 01:03:09 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 09 01:03:09.694727 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47de5d15-eb1a-467d-ab02-3fa04576aae3 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:03:09.710844 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47de5d15-eb1a-467d-ab02-3fa04576aae3 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:03:09.720453 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b9ff57-8794-4b81-8aa4-25fac1409adb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:03:09.721476 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b9ff57-8794-4b81-8aa4-25fac1409adb admin admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:03:09.721985 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b9ff57-8794-4b81-8aa4-25fac1409adb admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:03:09.722527 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b9ff57-8794-4b81-8aa4-25fac1409adb admin admin] PATH_INFO: `/v3/roles` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:03:09.723755 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b9ff57-8794-4b81-8aa4-25fac1409adb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:03:09.726665 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b9ff57-8794-4b81-8aa4-25fac1409adb admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:03:09.763136 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1261/2556] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Oct 9 01:03:09 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 09 01:03:09.769976 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4751ae-f8f5-4c7f-95c9-a756c3219a57 admin admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:03:09.787952 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4751ae-f8f5-4c7f-95c9-a756c3219a57 admin admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:03:09.796274 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66ac6cb-6888-4b95-ae44-1ea5bf69a84b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:03:09.797465 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66ac6cb-6888-4b95-ae44-1ea5bf69a84b admin admin] REQUEST_METHOD: `PUT` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:03:09.797974 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66ac6cb-6888-4b95-ae44-1ea5bf69a84b admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:03:09.798596 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66ac6cb-6888-4b95-ae44-1ea5bf69a84b admin admin] PATH_INFO: `/v3/projects/57a8f059fe044a8092a06485dd4940d0/users/1a2755aa89ce41d3863d2baa5f7749ed/roles/afb0a01183d9497795eaa4fa1a4046ae` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:03:09.842119 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66ac6cb-6888-4b95-ae44-1ea5bf69a84b admin admin] RBAC: Authorizing `identity:create_grant(project_id=57a8f059fe044a8092a06485dd4940d0, user_id=1a2755aa89ce41d3863d2baa5f7749ed, role_id=afb0a01183d9497795eaa4fa1a4046ae)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:03:09.848831 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66ac6cb-6888-4b95-ae44-1ea5bf69a84b admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:03:09.888244 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1296/2557] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Oct 9 01:03:09 2022] PUT /identity/v3/projects/57a8f059fe044a8092a06485dd4940d0/users/1a2755aa89ce41d3863d2baa5f7749ed/roles/afb0a01183d9497795eaa4fa1a4046ae => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 09 01:03:09.900804 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bba87f-cced-435c-8971-6e6c5a6f8458 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:03:09.901092 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bba87f-cced-435c-8971-6e6c5a6f8458 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:03:09.901499 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bba87f-cced-435c-8971-6e6c5a6f8458 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:03:09.941000 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-e2bba87f-cced-435c-8971-6e6c5a6f8458 None None] MFA Rules not processed for user `1a2755aa89ce41d3863d2baa5f7749ed`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 01:03:09.942635 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-e2bba87f-cced-435c-8971-6e6c5a6f8458 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:03:10.031910 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 01:03:10.075177 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1262/2558] 10.222.0.15 () {58 vars in 958 bytes} [Sun Oct 9 01:03:09 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 01:03:10.080098 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66ac6cb-6888-4b95-ae44-1ea5bf69a84b admin admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:03:10.157791 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66ac6cb-6888-4b95-ae44-1ea5bf69a84b admin admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:03:10.162882 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7147b6c9-0feb-449c-ba7b-b0b4eb5fcb53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:03:10.163547 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7147b6c9-0feb-449c-ba7b-b0b4eb5fcb53 admin admin] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:03:10.163813 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7147b6c9-0feb-449c-ba7b-b0b4eb5fcb53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:03:10.164209 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7147b6c9-0feb-449c-ba7b-b0b4eb5fcb53 admin admin] PATH_INFO: `/v3/projects` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:03:10.165128 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7147b6c9-0feb-449c-ba7b-b0b4eb5fcb53 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:03:10.167587 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7147b6c9-0feb-449c-ba7b-b0b4eb5fcb53 admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:03:10.181029 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 01:03:10.204239 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1297/2559] 10.222.0.15 () {60 vars in 1153 bytes} [Sun Oct 9 01:03:10 2022] POST /identity/v3/projects => generated 367 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 09 01:03:10.209027 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bba87f-cced-435c-8971-6e6c5a6f8458 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:03:10.221249 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bba87f-cced-435c-8971-6e6c5a6f8458 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:03:10.304155 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b258b4d7-6ec3-40d6-9dfd-1016257fe8fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:03:10.305093 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b258b4d7-6ec3-40d6-9dfd-1016257fe8fb admin admin] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:03:10.305574 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b258b4d7-6ec3-40d6-9dfd-1016257fe8fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:03:10.306046 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b258b4d7-6ec3-40d6-9dfd-1016257fe8fb admin admin] PATH_INFO: `/v3/users` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:03:10.306864 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b258b4d7-6ec3-40d6-9dfd-1016257fe8fb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:03:10.310114 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b258b4d7-6ec3-40d6-9dfd-1016257fe8fb admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:03:10.346017 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1263/2560] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Oct 9 01:03:10 2022] POST /identity/v3/users => generated 290 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 09 01:03:10.350427 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7147b6c9-0feb-449c-ba7b-b0b4eb5fcb53 admin admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:03:10.361992 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7147b6c9-0feb-449c-ba7b-b0b4eb5fcb53 admin admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:03:10.368009 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cddb21-efb5-436e-bf07-d63d68dfe0d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:03:10.368945 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cddb21-efb5-436e-bf07-d63d68dfe0d8 admin admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:03:10.369338 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cddb21-efb5-436e-bf07-d63d68dfe0d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:03:10.369788 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cddb21-efb5-436e-bf07-d63d68dfe0d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:03:10.370640 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cddb21-efb5-436e-bf07-d63d68dfe0d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:03:10.373190 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cddb21-efb5-436e-bf07-d63d68dfe0d8 admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:03:10.387811 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1298/2561] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Oct 9 01:03:10 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 09 01:03:10.392399 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b258b4d7-6ec3-40d6-9dfd-1016257fe8fb admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:03:10.406115 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b258b4d7-6ec3-40d6-9dfd-1016257fe8fb admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:03:10.413433 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a68df31-5321-4c7a-beec-dd99e1f9b21b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:03:10.414229 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a68df31-5321-4c7a-beec-dd99e1f9b21b admin admin] REQUEST_METHOD: `PUT` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:03:10.414647 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a68df31-5321-4c7a-beec-dd99e1f9b21b admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:03:10.414911 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a68df31-5321-4c7a-beec-dd99e1f9b21b admin admin] PATH_INFO: `/v3/projects/b99db79f9b124491807df84a40df206e/users/a2a3daba376740149129775feaa5020b/roles/f69dddf26daf4dd79d4c962beb877af5` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:03:10.436185 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a68df31-5321-4c7a-beec-dd99e1f9b21b admin admin] RBAC: Authorizing `identity:create_grant(project_id=b99db79f9b124491807df84a40df206e, user_id=a2a3daba376740149129775feaa5020b, role_id=f69dddf26daf4dd79d4c962beb877af5)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:03:10.439556 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a68df31-5321-4c7a-beec-dd99e1f9b21b admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:03:10.460581 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1264/2562] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Oct 9 01:03:10 2022] PUT /identity/v3/projects/b99db79f9b124491807df84a40df206e/users/a2a3daba376740149129775feaa5020b/roles/f69dddf26daf4dd79d4c962beb877af5 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 01:03:10.464948 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cddb21-efb5-436e-bf07-d63d68dfe0d8 admin admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:03:10.476305 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cddb21-efb5-436e-bf07-d63d68dfe0d8 admin admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:03:10.563561 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6439fee-02e3-46bb-af13-089d46d5371f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:03:10.564523 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6439fee-02e3-46bb-af13-089d46d5371f admin admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:03:10.564895 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6439fee-02e3-46bb-af13-089d46d5371f admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:03:10.565305 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6439fee-02e3-46bb-af13-089d46d5371f admin admin] PATH_INFO: `/v3/roles` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:03:10.566084 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6439fee-02e3-46bb-af13-089d46d5371f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:03:10.568195 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6439fee-02e3-46bb-af13-089d46d5371f admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:03:10.581577 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1299/2563] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Oct 9 01:03:10 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 09 01:03:10.587101 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a68df31-5321-4c7a-beec-dd99e1f9b21b admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:03:10.620314 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a68df31-5321-4c7a-beec-dd99e1f9b21b admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:03:10.628278 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe73fde-7a31-4206-8c9c-add0e836aae0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:03:10.629372 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe73fde-7a31-4206-8c9c-add0e836aae0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:03:10.629866 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe73fde-7a31-4206-8c9c-add0e836aae0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:03:10.630320 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe73fde-7a31-4206-8c9c-add0e836aae0 admin admin] PATH_INFO: `/v3/projects/b99db79f9b124491807df84a40df206e/users/a2a3daba376740149129775feaa5020b/roles/f69dddf26daf4dd79d4c962beb877af5` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:03:10.634477 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe73fde-7a31-4206-8c9c-add0e836aae0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b99db79f9b124491807df84a40df206e, user_id=a2a3daba376740149129775feaa5020b, role_id=f69dddf26daf4dd79d4c962beb877af5)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:03:10.640000 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe73fde-7a31-4206-8c9c-add0e836aae0 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:03:10.661672 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1265/2564] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Oct 9 01:03:10 2022] PUT /identity/v3/projects/b99db79f9b124491807df84a40df206e/users/a2a3daba376740149129775feaa5020b/roles/f69dddf26daf4dd79d4c962beb877af5 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 01:03:10.676219 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c7d265-732f-46b8-b10d-fc0608b67b16 None None] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:03:10.676642 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c7d265-732f-46b8-b10d-fc0608b67b16 None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:03:10.677038 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c7d265-732f-46b8-b10d-fc0608b67b16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:03:10.718499 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.auth.core [None req-b0c7d265-732f-46b8-b10d-fc0608b67b16 None None] MFA Rules not processed for user `a2a3daba376740149129775feaa5020b`. Rule list: `[]` (Enabled: `True`). {{(pid=81525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 01:03:10.719941 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-b0c7d265-732f-46b8-b10d-fc0608b67b16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:03:10.811878 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1300/2565] 10.222.0.15 () {58 vars in 958 bytes} [Sun Oct 9 01:03:10 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 09 01:03:10.826015 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe73fde-7a31-4206-8c9c-add0e836aae0 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:03:10.950765 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe73fde-7a31-4206-8c9c-add0e836aae0 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:03:10.958073 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17090625-eecb-4b7b-a10c-6a548871a43a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff7cb78bcd91467abe5c2e2b48aedd1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f148d39ced534860abfbe8fc3f98ace4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:03:10.959169 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17090625-eecb-4b7b-a10c-6a548871a43a service cinder] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:03:10.959706 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17090625-eecb-4b7b-a10c-6a548871a43a service cinder] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:03:10.960207 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17090625-eecb-4b7b-a10c-6a548871a43a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:03:10.988097 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17090625-eecb-4b7b-a10c-6a548871a43a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:03:11.003401 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17090625-eecb-4b7b-a10c-6a548871a43a service cinder] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:03:11.021215 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1266/2566] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Oct 9 01:03:10 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 09 01:03:11.234071 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c7d265-732f-46b8-b10d-fc0608b67b16 None None] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:03:11.251370 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c7d265-732f-46b8-b10d-fc0608b67b16 None None] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:03:11.266042 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682c95f7-8191-474d-b4ce-c222a9fab9a0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff7cb78bcd91467abe5c2e2b48aedd1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f148d39ced534860abfbe8fc3f98ace4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:03:11.266808 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682c95f7-8191-474d-b4ce-c222a9fab9a0 service cinder] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:03:11.267324 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682c95f7-8191-474d-b4ce-c222a9fab9a0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:03:11.267817 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682c95f7-8191-474d-b4ce-c222a9fab9a0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:03:11.387933 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682c95f7-8191-474d-b4ce-c222a9fab9a0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:03:11.390172 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682c95f7-8191-474d-b4ce-c222a9fab9a0 service cinder] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:03:11.398524 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 01:03:11.419326 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1301/2567] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Oct 9 01:03:11 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 09 01:03:15.412805 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17090625-eecb-4b7b-a10c-6a548871a43a service cinder] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:03:15.414714 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-17090625-eecb-4b7b-a10c-6a548871a43a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:03:15.516893 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 01:03:15.565713 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17090625-eecb-4b7b-a10c-6a548871a43a service cinder] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:03:15.574415 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81175e52-5b0f-41b6-94fb-fe5800cde30a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:03:15.576430 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81175e52-5b0f-41b6-94fb-fe5800cde30a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:03:15.577132 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81175e52-5b0f-41b6-94fb-fe5800cde30a admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:03:15.577615 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81175e52-5b0f-41b6-94fb-fe5800cde30a admin admin] PATH_INFO: `/v3/users/6e66ef13ab7f4fc99966752b351e845c` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:03:15.580226 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81175e52-5b0f-41b6-94fb-fe5800cde30a admin admin] RBAC: Authorizing `identity:delete_user(user_id=6e66ef13ab7f4fc99966752b351e845c)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:03:15.586549 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81175e52-5b0f-41b6-94fb-fe5800cde30a admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:03:15.710203 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-81175e52-5b0f-41b6-94fb-fe5800cde30a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6e66ef13ab7f4fc99966752b351e845c'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:03:15.735349 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-81175e52-5b0f-41b6-94fb-fe5800cde30a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6e66ef13ab7f4fc99966752b351e845c'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:03:15.735349 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-81175e52-5b0f-41b6-94fb-fe5800cde30a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6e66ef13ab7f4fc99966752b351e845c'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:03:15.735349 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-81175e52-5b0f-41b6-94fb-fe5800cde30a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6e66ef13ab7f4fc99966752b351e845c'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:03:15.747599 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-81175e52-5b0f-41b6-94fb-fe5800cde30a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6e66ef13ab7f4fc99966752b351e845c'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:03:15.779300 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1267/2568] 10.222.0.15 () {58 vars in 1224 bytes} [Sun Oct 9 01:03:15 2022] DELETE /identity/v3/users/6e66ef13ab7f4fc99966752b351e845c => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 01:03:16.303686 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682c95f7-8191-474d-b4ce-c222a9fab9a0 service cinder] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:03:16.323666 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682c95f7-8191-474d-b4ce-c222a9fab9a0 service cinder] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:03:16.475781 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9373694f-d17a-4934-b36f-7257671b83b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:03:16.477499 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9373694f-d17a-4934-b36f-7257671b83b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:03:16.478362 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9373694f-d17a-4934-b36f-7257671b83b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:03:16.479168 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9373694f-d17a-4934-b36f-7257671b83b0 admin admin] PATH_INFO: `/v3/projects/325756eeb7724a9596fa324af7d5ea22` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:03:16.481794 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9373694f-d17a-4934-b36f-7257671b83b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=325756eeb7724a9596fa324af7d5ea22)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:03:16.486603 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9373694f-d17a-4934-b36f-7257671b83b0 admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:03:16.606640 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-9373694f-d17a-4934-b36f-7257671b83b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '325756eeb7724a9596fa324af7d5ea22', 'request_id': 'req-9373694f-d17a-4934-b36f-7257671b83b0'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:03:16.635677 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-9373694f-d17a-4934-b36f-7257671b83b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '325756eeb7724a9596fa324af7d5ea22', 'request_id': 'req-9373694f-d17a-4934-b36f-7257671b83b0'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:03:16.647666 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-9373694f-d17a-4934-b36f-7257671b83b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '325756eeb7724a9596fa324af7d5ea22', 'request_id': 'req-9373694f-d17a-4934-b36f-7257671b83b0'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:03:16.662702 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-9373694f-d17a-4934-b36f-7257671b83b0 admin admin] The token cache is being invalidate because project 325756eeb7724a9596fa324af7d5ea22 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81525) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 09 01:03:16.662971 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-9373694f-d17a-4934-b36f-7257671b83b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:03:16.663765 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-9373694f-d17a-4934-b36f-7257671b83b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:03:16.666077 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1302/2569] 10.222.0.15 () {58 vars in 1233 bytes} [Sun Oct 9 01:03:16 2022] DELETE /identity/v3/projects/325756eeb7724a9596fa324af7d5ea22 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 01:03:16.675566 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbb9d79-85f3-48fc-945e-6d61befab3c1 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:03:16.677081 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbb9d79-85f3-48fc-945e-6d61befab3c1 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:03:16.678065 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbb9d79-85f3-48fc-945e-6d61befab3c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:03:16.719403 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-bdbb9d79-85f3-48fc-945e-6d61befab3c1 None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 01:03:16.721598 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-bdbb9d79-85f3-48fc-945e-6d61befab3c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:03:16.843685 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1268/2570] 10.222.0.15 () {58 vars in 958 bytes} [Sun Oct 9 01:03:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 01:03:16.862483 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff77315-9272-465e-84e9-400f16a144cf None None] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:03:16.863120 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff77315-9272-465e-84e9-400f16a144cf None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:03:16.863524 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff77315-9272-465e-84e9-400f16a144cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:03:16.898132 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.auth.core [None req-8ff77315-9272-465e-84e9-400f16a144cf None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 01:03:16.900225 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-8ff77315-9272-465e-84e9-400f16a144cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:03:16.932345 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1303/2571] 10.222.0.15 () {58 vars in 958 bytes} [Sun Oct 9 01:03:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 01:03:16.945421 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbb9d79-85f3-48fc-945e-6d61befab3c1 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:03:16.962368 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbb9d79-85f3-48fc-945e-6d61befab3c1 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:03:16.969858 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf74883-522e-4583-b367-3117f88181c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:03:16.970894 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf74883-522e-4583-b367-3117f88181c3 admin admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:03:16.971298 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf74883-522e-4583-b367-3117f88181c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:03:16.971674 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf74883-522e-4583-b367-3117f88181c3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:03:16.972535 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf74883-522e-4583-b367-3117f88181c3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 01:03:16.972949 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf74883-522e-4583-b367-3117f88181c3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:03:16.975748 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf74883-522e-4583-b367-3117f88181c3 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:03:17.011644 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1269/2572] 10.222.0.15 () {58 vars in 1153 bytes} [Sun Oct 9 01:03:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 01:03:17.013744 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff77315-9272-465e-84e9-400f16a144cf None None] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:03:17.031030 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff77315-9272-465e-84e9-400f16a144cf None None] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:03:17.038859 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9605fe1-c72e-47b9-9eb1-809a1f1b5a92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:03:17.040020 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9605fe1-c72e-47b9-9eb1-809a1f1b5a92 admin admin] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:03:17.040474 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9605fe1-c72e-47b9-9eb1-809a1f1b5a92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:03:17.040925 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9605fe1-c72e-47b9-9eb1-809a1f1b5a92 admin admin] PATH_INFO: `/v3/projects` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:03:17.042094 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9605fe1-c72e-47b9-9eb1-809a1f1b5a92 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:03:17.045941 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9605fe1-c72e-47b9-9eb1-809a1f1b5a92 admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:03:17.095622 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1304/2573] 10.222.0.15 () {60 vars in 1153 bytes} [Sun Oct 9 01:03:17 2022] POST /identity/v3/projects => generated 403 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 09 01:03:17.102209 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf74883-522e-4583-b367-3117f88181c3 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:03:17.116027 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf74883-522e-4583-b367-3117f88181c3 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:03:17.209590 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 01:03:17.260790 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a85ce0-1484-4c01-9088-045ae89fc9c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:03:17.261935 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a85ce0-1484-4c01-9088-045ae89fc9c8 admin admin] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:03:17.262418 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a85ce0-1484-4c01-9088-045ae89fc9c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:03:17.262905 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a85ce0-1484-4c01-9088-045ae89fc9c8 admin admin] PATH_INFO: `/v3/users` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:03:17.264459 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a85ce0-1484-4c01-9088-045ae89fc9c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:03:17.277713 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a85ce0-1484-4c01-9088-045ae89fc9c8 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:03:17.319399 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1270/2574] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Oct 9 01:03:17 2022] POST /identity/v3/users => generated 302 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 09 01:03:17.321962 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9605fe1-c72e-47b9-9eb1-809a1f1b5a92 admin admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:03:17.341184 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9605fe1-c72e-47b9-9eb1-809a1f1b5a92 admin admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:03:17.354996 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fe00d2-4530-43bb-af39-d70deb52c2db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:03:17.355682 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fe00d2-4530-43bb-af39-d70deb52c2db admin admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:03:17.355952 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fe00d2-4530-43bb-af39-d70deb52c2db admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:03:17.356217 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fe00d2-4530-43bb-af39-d70deb52c2db admin admin] PATH_INFO: `/v3/roles` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:03:17.356889 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fe00d2-4530-43bb-af39-d70deb52c2db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:03:17.358687 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fe00d2-4530-43bb-af39-d70deb52c2db admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:03:17.374079 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1305/2575] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Oct 9 01:03:17 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 09 01:03:17.379052 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a85ce0-1484-4c01-9088-045ae89fc9c8 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:03:17.390854 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a85ce0-1484-4c01-9088-045ae89fc9c8 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:03:17.396310 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cbae92-1c22-4b9e-a862-a79f9827aa13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:03:17.397259 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cbae92-1c22-4b9e-a862-a79f9827aa13 admin admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:03:17.397894 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cbae92-1c22-4b9e-a862-a79f9827aa13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:03:17.398160 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cbae92-1c22-4b9e-a862-a79f9827aa13 admin admin] PATH_INFO: `/v3/roles` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:03:17.398926 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cbae92-1c22-4b9e-a862-a79f9827aa13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:03:17.400999 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cbae92-1c22-4b9e-a862-a79f9827aa13 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:03:17.413168 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1271/2576] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Oct 9 01:03:17 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 09 01:03:17.419518 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fe00d2-4530-43bb-af39-d70deb52c2db admin admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:03:17.434186 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fe00d2-4530-43bb-af39-d70deb52c2db admin admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:03:17.439552 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed2df48-f92b-42e6-9a8d-308e3980b2f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:03:17.440323 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed2df48-f92b-42e6-9a8d-308e3980b2f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:03:17.440656 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed2df48-f92b-42e6-9a8d-308e3980b2f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:03:17.440990 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed2df48-f92b-42e6-9a8d-308e3980b2f3 admin admin] PATH_INFO: `/v3/projects/83f86a7212aa4801b58dc42a87d58d16/users/fa540de4e48846e7a378229e6c07c3ff/roles/afb0a01183d9497795eaa4fa1a4046ae` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:03:17.468181 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed2df48-f92b-42e6-9a8d-308e3980b2f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=83f86a7212aa4801b58dc42a87d58d16, user_id=fa540de4e48846e7a378229e6c07c3ff, role_id=afb0a01183d9497795eaa4fa1a4046ae)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:03:17.471566 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed2df48-f92b-42e6-9a8d-308e3980b2f3 admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:03:17.492686 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1306/2577] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Oct 9 01:03:17 2022] PUT /identity/v3/projects/83f86a7212aa4801b58dc42a87d58d16/users/fa540de4e48846e7a378229e6c07c3ff/roles/afb0a01183d9497795eaa4fa1a4046ae => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 01:03:17.499006 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9806c0b-7cf8-4021-88cb-5ce6c06db0bd None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:03:17.499480 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9806c0b-7cf8-4021-88cb-5ce6c06db0bd None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:03:17.499854 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9806c0b-7cf8-4021-88cb-5ce6c06db0bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:03:17.521983 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-a9806c0b-7cf8-4021-88cb-5ce6c06db0bd None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 01:03:17.524442 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-a9806c0b-7cf8-4021-88cb-5ce6c06db0bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:03:17.596704 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1272/2578] 10.222.0.15 () {58 vars in 958 bytes} [Sun Oct 9 01:03:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 09 01:03:17.608446 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed2df48-f92b-42e6-9a8d-308e3980b2f3 admin admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:03:17.610646 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-fed2df48-f92b-42e6-9a8d-308e3980b2f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:03:17.648449 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 01:03:17.691242 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed2df48-f92b-42e6-9a8d-308e3980b2f3 admin admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:03:17.695637 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982dae6f-bed7-493f-a411-090b1ed005cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4ef90d456d2483e8ddafbe2d4d4fb5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f148d39ced534860abfbe8fc3f98ace4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:03:17.696429 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982dae6f-bed7-493f-a411-090b1ed005cc service neutron] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:03:17.696735 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982dae6f-bed7-493f-a411-090b1ed005cc service neutron] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:03:17.697001 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982dae6f-bed7-493f-a411-090b1ed005cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:03:17.707687 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982dae6f-bed7-493f-a411-090b1ed005cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:03:17.709193 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982dae6f-bed7-493f-a411-090b1ed005cc service neutron] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:03:17.720597 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1307/2579] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Oct 9 01:03:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 09 01:03:18.309705 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9806c0b-7cf8-4021-88cb-5ce6c06db0bd None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:03:18.312378 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-a9806c0b-7cf8-4021-88cb-5ce6c06db0bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:03:18.338833 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9806c0b-7cf8-4021-88cb-5ce6c06db0bd None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:03:18.345406 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0fd70b-c6c5-4255-a584-3d9b4b062207 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:03:18.346079 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0fd70b-c6c5-4255-a584-3d9b4b062207 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:03:18.346356 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0fd70b-c6c5-4255-a584-3d9b4b062207 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:03:18.346623 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0fd70b-c6c5-4255-a584-3d9b4b062207 admin admin] PATH_INFO: `/v3/users/1a2755aa89ce41d3863d2baa5f7749ed` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:03:18.348028 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0fd70b-c6c5-4255-a584-3d9b4b062207 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1a2755aa89ce41d3863d2baa5f7749ed)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:03:18.350312 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0fd70b-c6c5-4255-a584-3d9b4b062207 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:03:18.424488 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-4c0fd70b-c6c5-4255-a584-3d9b4b062207 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1a2755aa89ce41d3863d2baa5f7749ed'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:03:18.439463 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-4c0fd70b-c6c5-4255-a584-3d9b4b062207 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1a2755aa89ce41d3863d2baa5f7749ed'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:03:18.441010 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-4c0fd70b-c6c5-4255-a584-3d9b4b062207 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1a2755aa89ce41d3863d2baa5f7749ed'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:03:18.442404 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-4c0fd70b-c6c5-4255-a584-3d9b4b062207 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1a2755aa89ce41d3863d2baa5f7749ed'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:03:18.468375 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-4c0fd70b-c6c5-4255-a584-3d9b4b062207 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1a2755aa89ce41d3863d2baa5f7749ed'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:03:18.535092 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1273/2580] 10.222.0.15 () {58 vars in 1224 bytes} [Sun Oct 9 01:03:18 2022] DELETE /identity/v3/users/1a2755aa89ce41d3863d2baa5f7749ed => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 01:03:18.544919 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f802f51-5d31-4304-8465-9dcac9477255 None None] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:03:18.545771 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f802f51-5d31-4304-8465-9dcac9477255 None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:03:18.545952 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f802f51-5d31-4304-8465-9dcac9477255 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:03:18.625303 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.auth.core [None req-3f802f51-5d31-4304-8465-9dcac9477255 None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 01:03:18.630071 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-3f802f51-5d31-4304-8465-9dcac9477255 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:03:18.737306 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9aded2-4278-41bf-b216-49c89a24a473 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:03:18.737888 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9aded2-4278-41bf-b216-49c89a24a473 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:03:18.738376 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9aded2-4278-41bf-b216-49c89a24a473 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:03:18.777420 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1308/2581] 10.222.0.15 () {58 vars in 958 bytes} [Sun Oct 9 01:03:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 01:03:18.798461 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f802f51-5d31-4304-8465-9dcac9477255 None None] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:03:18.800716 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-3f802f51-5d31-4304-8465-9dcac9477255 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:03:18.807213 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-2b9aded2-4278-41bf-b216-49c89a24a473 None None] MFA Rules not processed for user `fa540de4e48846e7a378229e6c07c3ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 01:03:18.809384 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-2b9aded2-4278-41bf-b216-49c89a24a473 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:03:18.854335 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 01:03:18.912809 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f802f51-5d31-4304-8465-9dcac9477255 None None] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:03:18.920726 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1f9524-c5bb-4e3c-86bb-85f08aa8334c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4ef90d456d2483e8ddafbe2d4d4fb5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f148d39ced534860abfbe8fc3f98ace4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:03:18.922009 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1f9524-c5bb-4e3c-86bb-85f08aa8334c service neutron] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:03:18.922591 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1f9524-c5bb-4e3c-86bb-85f08aa8334c service neutron] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:03:18.923121 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1f9524-c5bb-4e3c-86bb-85f08aa8334c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:03:18.944200 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1f9524-c5bb-4e3c-86bb-85f08aa8334c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:03:18.946964 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1f9524-c5bb-4e3c-86bb-85f08aa8334c service neutron] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:03:18.962894 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1274/2582] 10.222.0.15 () {58 vars in 958 bytes} [Sun Oct 9 01:03:18 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 01:03:18.970915 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9aded2-4278-41bf-b216-49c89a24a473 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:03:18.972150 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1309/2583] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Oct 9 01:03:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 09 01:03:18.980833 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-2b9aded2-4278-41bf-b216-49c89a24a473 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:03:19.013034 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9aded2-4278-41bf-b216-49c89a24a473 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:03:19.022785 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329198a0-8e26-426a-bcb6-bc1e375e12f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:03:19.024282 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329198a0-8e26-426a-bcb6-bc1e375e12f4 admin admin] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:03:19.024955 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329198a0-8e26-426a-bcb6-bc1e375e12f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:03:19.025919 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329198a0-8e26-426a-bcb6-bc1e375e12f4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:03:19.027177 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329198a0-8e26-426a-bcb6-bc1e375e12f4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:03:19.031489 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329198a0-8e26-426a-bcb6-bc1e375e12f4 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:03:19.109198 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1275/2584] 10.222.0.15 () {60 vars in 1153 bytes} [Sun Oct 9 01:03:18 2022] POST /identity/v3/projects => generated 405 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 09 01:03:19.116906 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1f9524-c5bb-4e3c-86bb-85f08aa8334c service neutron] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:03:19.136523 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1f9524-c5bb-4e3c-86bb-85f08aa8334c service neutron] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:03:19.302243 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39b24fc-2ab3-4178-8309-849acc57e123 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:03:19.303500 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39b24fc-2ab3-4178-8309-849acc57e123 admin admin] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:03:19.303972 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39b24fc-2ab3-4178-8309-849acc57e123 admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:03:19.304442 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39b24fc-2ab3-4178-8309-849acc57e123 admin admin] PATH_INFO: `/v3/users` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:03:19.305712 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39b24fc-2ab3-4178-8309-849acc57e123 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:03:19.309383 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39b24fc-2ab3-4178-8309-849acc57e123 admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:03:19.363466 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1310/2585] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Oct 9 01:03:19 2022] POST /identity/v3/users => generated 309 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 09 01:03:19.370176 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329198a0-8e26-426a-bcb6-bc1e375e12f4 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:03:19.389465 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329198a0-8e26-426a-bcb6-bc1e375e12f4 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:03:19.397722 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f696be97-ffc2-4ac3-ac75-e198b9d15687 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:03:19.398802 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f696be97-ffc2-4ac3-ac75-e198b9d15687 admin admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:03:19.399425 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f696be97-ffc2-4ac3-ac75-e198b9d15687 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:03:19.399876 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f696be97-ffc2-4ac3-ac75-e198b9d15687 admin admin] PATH_INFO: `/v3/roles` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:03:19.400856 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f696be97-ffc2-4ac3-ac75-e198b9d15687 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:03:19.404215 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f696be97-ffc2-4ac3-ac75-e198b9d15687 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:03:19.420491 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1276/2586] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Oct 9 01:03:19 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 09 01:03:19.428296 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39b24fc-2ab3-4178-8309-849acc57e123 admin admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:03:19.448188 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 01:03:19.471988 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39b24fc-2ab3-4178-8309-849acc57e123 admin admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:03:19.479330 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae1109e-aa2c-4437-a462-1f12cd25ab6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:03:19.480132 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae1109e-aa2c-4437-a462-1f12cd25ab6c admin admin] REQUEST_METHOD: `PUT` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:03:19.480408 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae1109e-aa2c-4437-a462-1f12cd25ab6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:03:19.480684 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae1109e-aa2c-4437-a462-1f12cd25ab6c admin admin] PATH_INFO: `/v3/projects/27d5d0069b24448cb25897fdc27b96a4/users/d3b5477b0d704ea9b788f8834b3ec0ca/roles/f69dddf26daf4dd79d4c962beb877af5` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:03:19.504860 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae1109e-aa2c-4437-a462-1f12cd25ab6c admin admin] RBAC: Authorizing `identity:create_grant(project_id=27d5d0069b24448cb25897fdc27b96a4, user_id=d3b5477b0d704ea9b788f8834b3ec0ca, role_id=f69dddf26daf4dd79d4c962beb877af5)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:03:19.507811 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae1109e-aa2c-4437-a462-1f12cd25ab6c admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:03:19.538626 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1311/2587] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Oct 9 01:03:19 2022] PUT /identity/v3/projects/27d5d0069b24448cb25897fdc27b96a4/users/d3b5477b0d704ea9b788f8834b3ec0ca/roles/f69dddf26daf4dd79d4c962beb877af5 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 01:03:19.551585 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f696be97-ffc2-4ac3-ac75-e198b9d15687 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:03:19.559902 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f696be97-ffc2-4ac3-ac75-e198b9d15687 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:03:19.569178 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae1109e-aa2c-4437-a462-1f12cd25ab6c admin admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:03:19.571816 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-4ae1109e-aa2c-4437-a462-1f12cd25ab6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:03:19.661331 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b524a7e-809a-4d75-bfa8-e8289e713303 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:03:19.662561 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b524a7e-809a-4d75-bfa8-e8289e713303 admin admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:03:19.663072 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b524a7e-809a-4d75-bfa8-e8289e713303 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:03:19.663626 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b524a7e-809a-4d75-bfa8-e8289e713303 admin admin] PATH_INFO: `/v3/roles` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:03:19.666698 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b524a7e-809a-4d75-bfa8-e8289e713303 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:03:19.670043 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b524a7e-809a-4d75-bfa8-e8289e713303 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:03:19.681702 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae1109e-aa2c-4437-a462-1f12cd25ab6c admin admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:03:19.690906 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1277/2588] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Oct 9 01:03:19 2022] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 09 01:03:19.691215 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbc5244-e2f7-47df-925f-0c33321685f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:03:19.691215 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbc5244-e2f7-47df-925f-0c33321685f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:03:19.691215 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbc5244-e2f7-47df-925f-0c33321685f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:03:19.691215 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbc5244-e2f7-47df-925f-0c33321685f6 admin admin] PATH_INFO: `/v3/projects/57a8f059fe044a8092a06485dd4940d0` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:03:19.691930 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbc5244-e2f7-47df-925f-0c33321685f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=57a8f059fe044a8092a06485dd4940d0)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:03:19.692203 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbc5244-e2f7-47df-925f-0c33321685f6 admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:03:19.692883 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b524a7e-809a-4d75-bfa8-e8289e713303 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:03:19.705112 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b524a7e-809a-4d75-bfa8-e8289e713303 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:03:19.713392 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed2a978-9333-4edc-b807-23b47699370b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:03:19.714407 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed2a978-9333-4edc-b807-23b47699370b admin admin] REQUEST_METHOD: `PUT` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:03:19.714844 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed2a978-9333-4edc-b807-23b47699370b admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:03:19.715311 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed2a978-9333-4edc-b807-23b47699370b admin admin] PATH_INFO: `/v3/projects/27d5d0069b24448cb25897fdc27b96a4/users/d3b5477b0d704ea9b788f8834b3ec0ca/roles/f69dddf26daf4dd79d4c962beb877af5` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:03:19.718110 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed2a978-9333-4edc-b807-23b47699370b admin admin] RBAC: Authorizing `identity:create_grant(project_id=27d5d0069b24448cb25897fdc27b96a4, user_id=d3b5477b0d704ea9b788f8834b3ec0ca, role_id=f69dddf26daf4dd79d4c962beb877af5)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:03:19.721088 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed2a978-9333-4edc-b807-23b47699370b admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:03:19.739810 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1278/2589] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Oct 9 01:03:19 2022] PUT /identity/v3/projects/27d5d0069b24448cb25897fdc27b96a4/users/d3b5477b0d704ea9b788f8834b3ec0ca/roles/f69dddf26daf4dd79d4c962beb877af5 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 09 01:03:19.777538 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-0bbc5244-e2f7-47df-925f-0c33321685f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '57a8f059fe044a8092a06485dd4940d0', 'request_id': 'req-0bbc5244-e2f7-47df-925f-0c33321685f6'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:03:19.790135 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-0bbc5244-e2f7-47df-925f-0c33321685f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '57a8f059fe044a8092a06485dd4940d0', 'request_id': 'req-0bbc5244-e2f7-47df-925f-0c33321685f6'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:03:19.799643 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-0bbc5244-e2f7-47df-925f-0c33321685f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '57a8f059fe044a8092a06485dd4940d0', 'request_id': 'req-0bbc5244-e2f7-47df-925f-0c33321685f6'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:03:19.822525 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-0bbc5244-e2f7-47df-925f-0c33321685f6 admin admin] The token cache is being invalidate because project 57a8f059fe044a8092a06485dd4940d0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81525) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 09 01:03:19.823292 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-0bbc5244-e2f7-47df-925f-0c33321685f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:03:19.825198 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-0bbc5244-e2f7-47df-925f-0c33321685f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:03:19.828232 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1312/2590] 10.222.0.15 () {58 vars in 1233 bytes} [Sun Oct 9 01:03:19 2022] DELETE /identity/v3/projects/57a8f059fe044a8092a06485dd4940d0 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 09 01:03:19.834230 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed2a978-9333-4edc-b807-23b47699370b admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:03:19.837969 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-eed2a978-9333-4edc-b807-23b47699370b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:03:19.948618 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed2a978-9333-4edc-b807-23b47699370b admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:03:19.981962 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 01:03:20.052169 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa581e54-d8af-46cd-8da3-b375223c45fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:03:20.053010 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa581e54-d8af-46cd-8da3-b375223c45fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:03:20.053562 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa581e54-d8af-46cd-8da3-b375223c45fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:03:20.053919 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa581e54-d8af-46cd-8da3-b375223c45fb admin admin] PATH_INFO: `/v3/users/a2a3daba376740149129775feaa5020b` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:03:20.055823 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa581e54-d8af-46cd-8da3-b375223c45fb admin admin] RBAC: Authorizing `identity:delete_user(user_id=a2a3daba376740149129775feaa5020b)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:03:20.058490 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa581e54-d8af-46cd-8da3-b375223c45fb admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:03:20.144354 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-fa581e54-d8af-46cd-8da3-b375223c45fb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a2a3daba376740149129775feaa5020b'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:03:20.155813 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-fa581e54-d8af-46cd-8da3-b375223c45fb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a2a3daba376740149129775feaa5020b'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:03:20.156609 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-fa581e54-d8af-46cd-8da3-b375223c45fb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a2a3daba376740149129775feaa5020b'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:03:20.157465 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-fa581e54-d8af-46cd-8da3-b375223c45fb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a2a3daba376740149129775feaa5020b'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:03:20.174844 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-fa581e54-d8af-46cd-8da3-b375223c45fb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a2a3daba376740149129775feaa5020b'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:03:20.197008 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1279/2591] 10.222.0.15 () {58 vars in 1224 bytes} [Sun Oct 9 01:03:19 2022] DELETE /identity/v3/users/a2a3daba376740149129775feaa5020b => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 01:03:20.600886 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbc5244-e2f7-47df-925f-0c33321685f6 admin admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:03:20.602854 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-0bbc5244-e2f7-47df-925f-0c33321685f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:03:20.632621 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbc5244-e2f7-47df-925f-0c33321685f6 admin admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:03:20.663622 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa581e54-d8af-46cd-8da3-b375223c45fb admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:03:20.666208 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-fa581e54-d8af-46cd-8da3-b375223c45fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:03:20.799174 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ee272e-428b-4efc-9e9c-e9d6fb0ec698 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:03:20.800584 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ee272e-428b-4efc-9e9c-e9d6fb0ec698 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:03:20.801211 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ee272e-428b-4efc-9e9c-e9d6fb0ec698 admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:03:20.801815 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ee272e-428b-4efc-9e9c-e9d6fb0ec698 admin admin] PATH_INFO: `/v3/users/b811527f41e04c139658c7b1a5fcbd66` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:03:20.804745 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ee272e-428b-4efc-9e9c-e9d6fb0ec698 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b811527f41e04c139658c7b1a5fcbd66)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:03:20.809724 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ee272e-428b-4efc-9e9c-e9d6fb0ec698 admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:03:20.822748 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa581e54-d8af-46cd-8da3-b375223c45fb admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:03:20.832144 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299a900a-d28b-4119-9e42-541b6aa8f7e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:03:20.833328 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299a900a-d28b-4119-9e42-541b6aa8f7e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:03:20.833905 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299a900a-d28b-4119-9e42-541b6aa8f7e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:03:20.834405 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299a900a-d28b-4119-9e42-541b6aa8f7e1 admin admin] PATH_INFO: `/v3/projects/b99db79f9b124491807df84a40df206e` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:03:20.836958 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299a900a-d28b-4119-9e42-541b6aa8f7e1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b99db79f9b124491807df84a40df206e)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:03:20.838185 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 01:03:20.840984 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299a900a-d28b-4119-9e42-541b6aa8f7e1 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:03:20.931945 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 01:03:20.934194 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-c4ee272e-428b-4efc-9e9c-e9d6fb0ec698 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b811527f41e04c139658c7b1a5fcbd66'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:03:20.948904 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-c4ee272e-428b-4efc-9e9c-e9d6fb0ec698 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b811527f41e04c139658c7b1a5fcbd66'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:03:20.950717 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-c4ee272e-428b-4efc-9e9c-e9d6fb0ec698 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b811527f41e04c139658c7b1a5fcbd66'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:03:20.951857 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-c4ee272e-428b-4efc-9e9c-e9d6fb0ec698 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b811527f41e04c139658c7b1a5fcbd66'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:03:20.960685 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-299a900a-d28b-4119-9e42-541b6aa8f7e1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b99db79f9b124491807df84a40df206e', 'request_id': 'req-299a900a-d28b-4119-9e42-541b6aa8f7e1'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:03:20.972794 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-c4ee272e-428b-4efc-9e9c-e9d6fb0ec698 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b811527f41e04c139658c7b1a5fcbd66'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:03:20.975610 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-299a900a-d28b-4119-9e42-541b6aa8f7e1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b99db79f9b124491807df84a40df206e', 'request_id': 'req-299a900a-d28b-4119-9e42-541b6aa8f7e1'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:03:20.986227 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-299a900a-d28b-4119-9e42-541b6aa8f7e1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b99db79f9b124491807df84a40df206e', 'request_id': 'req-299a900a-d28b-4119-9e42-541b6aa8f7e1'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:03:21.004424 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-299a900a-d28b-4119-9e42-541b6aa8f7e1 admin admin] The token cache is being invalidate because project b99db79f9b124491807df84a40df206e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81524) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 09 01:03:21.004999 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-299a900a-d28b-4119-9e42-541b6aa8f7e1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:03:21.006658 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-299a900a-d28b-4119-9e42-541b6aa8f7e1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:03:21.009438 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1313/2592] 10.222.0.15 () {58 vars in 1224 bytes} [Sun Oct 9 01:03:20 2022] DELETE /identity/v3/users/b811527f41e04c139658c7b1a5fcbd66 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 01:03:21.010503 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1280/2593] 10.222.0.15 () {58 vars in 1233 bytes} [Sun Oct 9 01:03:20 2022] DELETE /identity/v3/projects/b99db79f9b124491807df84a40df206e => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 01:03:21.016668 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b2566c-cab4-473e-b0cc-d123ed005e8e None None] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:03:21.017562 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8f8f59-1c84-44da-8e1c-bf2aa9a31376 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:03:21.017953 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b2566c-cab4-473e-b0cc-d123ed005e8e None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:03:21.018288 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8f8f59-1c84-44da-8e1c-bf2aa9a31376 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:03:21.018768 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8f8f59-1c84-44da-8e1c-bf2aa9a31376 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:03:21.019367 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b2566c-cab4-473e-b0cc-d123ed005e8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:03:21.051515 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-8f8f8f59-1c84-44da-8e1c-bf2aa9a31376 None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 01:03:21.053155 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-8f8f8f59-1c84-44da-8e1c-bf2aa9a31376 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:03:21.056508 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.auth.core [None req-51b2566c-cab4-473e-b0cc-d123ed005e8e None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 01:03:21.059119 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-51b2566c-cab4-473e-b0cc-d123ed005e8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:03:21.204844 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1281/2594] 10.222.0.15 () {58 vars in 958 bytes} [Sun Oct 9 01:03:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 09 01:03:21.207544 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45457fa-0ea8-4502-afa4-4ffddf75776a None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:03:21.208313 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45457fa-0ea8-4502-afa4-4ffddf75776a None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:03:21.208899 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45457fa-0ea8-4502-afa4-4ffddf75776a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:03:21.218069 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1314/2595] 10.222.0.15 () {58 vars in 958 bytes} [Sun Oct 9 01:03:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 01:03:21.223848 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67266952-3378-4c7f-99e3-ca34c5ee35df None None] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:03:21.224385 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67266952-3378-4c7f-99e3-ca34c5ee35df None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:03:21.224855 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67266952-3378-4c7f-99e3-ca34c5ee35df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:03:21.262181 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.auth.core [None req-67266952-3378-4c7f-99e3-ca34c5ee35df None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 01:03:21.264680 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-67266952-3378-4c7f-99e3-ca34c5ee35df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:03:21.272390 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-b45457fa-0ea8-4502-afa4-4ffddf75776a None None] MFA Rules not processed for user `d3b5477b0d704ea9b788f8834b3ec0ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 01:03:21.274514 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-b45457fa-0ea8-4502-afa4-4ffddf75776a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:03:21.283187 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1315/2596] 10.222.0.15 () {58 vars in 958 bytes} [Sun Oct 9 01:03:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 01:03:21.285010 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67266952-3378-4c7f-99e3-ca34c5ee35df None None] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:03:21.286828 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-67266952-3378-4c7f-99e3-ca34c5ee35df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:03:21.402555 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1282/2597] 10.222.0.15 () {58 vars in 958 bytes} [Sun Oct 9 01:03:21 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 01:03:21.403646 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45457fa-0ea8-4502-afa4-4ffddf75776a None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:03:21.432536 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45457fa-0ea8-4502-afa4-4ffddf75776a None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:03:21.434935 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67266952-3378-4c7f-99e3-ca34c5ee35df None None] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:03:21.447480 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bd0a45-7274-400b-9093-41fa32a5a1b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4ef90d456d2483e8ddafbe2d4d4fb5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f148d39ced534860abfbe8fc3f98ace4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:03:21.453910 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff134a0b-d802-406a-b322-d1b65213ed61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:03:21.454555 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff134a0b-d802-406a-b322-d1b65213ed61 admin admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:03:21.454814 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff134a0b-d802-406a-b322-d1b65213ed61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:03:21.455089 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff134a0b-d802-406a-b322-d1b65213ed61 admin admin] PATH_INFO: `/v3/domains` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:03:21.455692 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bd0a45-7274-400b-9093-41fa32a5a1b6 service neutron] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:03:21.455886 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff134a0b-d802-406a-b322-d1b65213ed61 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 01:03:21.456089 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff134a0b-d802-406a-b322-d1b65213ed61 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:03:21.456569 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bd0a45-7274-400b-9093-41fa32a5a1b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:03:21.457181 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bd0a45-7274-400b-9093-41fa32a5a1b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:03:21.457752 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff134a0b-d802-406a-b322-d1b65213ed61 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:03:21.489833 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bd0a45-7274-400b-9093-41fa32a5a1b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:03:21.490169 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1283/2598] 10.222.0.15 () {58 vars in 1153 bytes} [Sun Oct 9 01:03:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 01:03:21.497718 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff134a0b-d802-406a-b322-d1b65213ed61 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:03:21.500937 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bd0a45-7274-400b-9093-41fa32a5a1b6 service neutron] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:03:21.516303 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff134a0b-d802-406a-b322-d1b65213ed61 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:03:21.525711 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1316/2599] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Oct 9 01:03:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 09 01:03:21.537527 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0013e1-6c9d-40eb-b309-515876f500d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:03:21.538154 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0013e1-6c9d-40eb-b309-515876f500d7 admin admin] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:03:21.538440 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0013e1-6c9d-40eb-b309-515876f500d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:03:21.538716 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0013e1-6c9d-40eb-b309-515876f500d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:03:21.539519 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0013e1-6c9d-40eb-b309-515876f500d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:03:21.542131 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0013e1-6c9d-40eb-b309-515876f500d7 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:03:21.583410 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1284/2600] 10.222.0.15 () {60 vars in 1153 bytes} [Sun Oct 9 01:03:21 2022] POST /identity/v3/projects => generated 373 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 09 01:03:21.589109 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bd0a45-7274-400b-9093-41fa32a5a1b6 service neutron] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:03:21.599918 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bd0a45-7274-400b-9093-41fa32a5a1b6 service neutron] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:03:21.637826 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 01:03:21.734537 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a962742-d0d7-47a6-b498-01798cb6fced admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:03:21.735606 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a962742-d0d7-47a6-b498-01798cb6fced admin admin] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:03:21.735918 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a962742-d0d7-47a6-b498-01798cb6fced admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:03:21.736245 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a962742-d0d7-47a6-b498-01798cb6fced admin admin] PATH_INFO: `/v3/users` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:03:21.736888 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a962742-d0d7-47a6-b498-01798cb6fced admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:03:21.739557 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a962742-d0d7-47a6-b498-01798cb6fced admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:03:21.767823 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1317/2601] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Oct 9 01:03:21 2022] POST /identity/v3/users => generated 287 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 09 01:03:21.772110 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0013e1-6c9d-40eb-b309-515876f500d7 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:03:21.783862 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0013e1-6c9d-40eb-b309-515876f500d7 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:03:21.790521 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6ee0db-7aed-4ac2-bf33-ab9f82e906d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:03:21.791301 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6ee0db-7aed-4ac2-bf33-ab9f82e906d6 admin admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:03:21.791756 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6ee0db-7aed-4ac2-bf33-ab9f82e906d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:03:21.791947 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6ee0db-7aed-4ac2-bf33-ab9f82e906d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:03:21.792520 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6ee0db-7aed-4ac2-bf33-ab9f82e906d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:03:21.794460 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6ee0db-7aed-4ac2-bf33-ab9f82e906d6 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:03:21.809977 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1285/2602] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Oct 9 01:03:21 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 09 01:03:21.813704 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a962742-d0d7-47a6-b498-01798cb6fced admin admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:03:21.831186 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a962742-d0d7-47a6-b498-01798cb6fced admin admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:03:21.837369 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a673fc67-8412-47f1-a212-f4c00f02be45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:03:21.838268 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a673fc67-8412-47f1-a212-f4c00f02be45 admin admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:03:21.838614 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a673fc67-8412-47f1-a212-f4c00f02be45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:03:21.838899 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a673fc67-8412-47f1-a212-f4c00f02be45 admin admin] PATH_INFO: `/v3/roles` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:03:21.839842 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a673fc67-8412-47f1-a212-f4c00f02be45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:03:21.841657 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a673fc67-8412-47f1-a212-f4c00f02be45 admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:03:21.857495 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1318/2603] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Oct 9 01:03:21 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 09 01:03:21.861814 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6ee0db-7aed-4ac2-bf33-ab9f82e906d6 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:03:21.872922 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6ee0db-7aed-4ac2-bf33-ab9f82e906d6 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:03:21.878609 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2be1a25-125b-4d2f-9863-d0c3dcd528c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:03:21.879354 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2be1a25-125b-4d2f-9863-d0c3dcd528c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:03:21.879630 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2be1a25-125b-4d2f-9863-d0c3dcd528c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:03:21.879905 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2be1a25-125b-4d2f-9863-d0c3dcd528c8 admin admin] PATH_INFO: `/v3/projects/d71904851c0b43eb81791385487f19ef/users/caa8b6a94a1944318aa8987a2c6d2ca8/roles/afb0a01183d9497795eaa4fa1a4046ae` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:03:21.884962 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 01:03:21.902363 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2be1a25-125b-4d2f-9863-d0c3dcd528c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d71904851c0b43eb81791385487f19ef, user_id=caa8b6a94a1944318aa8987a2c6d2ca8, role_id=afb0a01183d9497795eaa4fa1a4046ae)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:03:21.905802 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2be1a25-125b-4d2f-9863-d0c3dcd528c8 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:03:21.925960 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1286/2604] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Oct 9 01:03:21 2022] PUT /identity/v3/projects/d71904851c0b43eb81791385487f19ef/users/caa8b6a94a1944318aa8987a2c6d2ca8/roles/afb0a01183d9497795eaa4fa1a4046ae => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 01:03:21.931780 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4415f0-1ddc-40e1-b22c-1b5a0ebb7655 None None] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:03:21.932161 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4415f0-1ddc-40e1-b22c-1b5a0ebb7655 None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:03:21.932506 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4415f0-1ddc-40e1-b22c-1b5a0ebb7655 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:03:21.957473 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.auth.core [None req-3c4415f0-1ddc-40e1-b22c-1b5a0ebb7655 None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 01:03:21.958939 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-3c4415f0-1ddc-40e1-b22c-1b5a0ebb7655 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:03:22.052414 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1319/2605] 10.222.0.15 () {58 vars in 958 bytes} [Sun Oct 9 01:03:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 09 01:03:22.079313 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2be1a25-125b-4d2f-9863-d0c3dcd528c8 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:03:22.082008 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-c2be1a25-125b-4d2f-9863-d0c3dcd528c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:03:22.184207 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2be1a25-125b-4d2f-9863-d0c3dcd528c8 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:03:22.190051 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e398e2ab-c23c-457a-b419-b564d7677689 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4ef90d456d2483e8ddafbe2d4d4fb5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f148d39ced534860abfbe8fc3f98ace4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:03:22.191445 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e398e2ab-c23c-457a-b419-b564d7677689 service neutron] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:03:22.191895 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e398e2ab-c23c-457a-b419-b564d7677689 service neutron] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:03:22.192233 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e398e2ab-c23c-457a-b419-b564d7677689 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:03:22.204680 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e398e2ab-c23c-457a-b419-b564d7677689 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:03:22.206368 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e398e2ab-c23c-457a-b419-b564d7677689 service neutron] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:03:22.225057 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1287/2606] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Oct 9 01:03:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 09 01:03:22.225335 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4415f0-1ddc-40e1-b22c-1b5a0ebb7655 None None] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:03:22.227112 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-3c4415f0-1ddc-40e1-b22c-1b5a0ebb7655 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:03:22.241053 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4415f0-1ddc-40e1-b22c-1b5a0ebb7655 None None] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:03:22.247216 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3792aa38-ff7e-4e95-bdac-048011d7867d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:03:22.248578 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3792aa38-ff7e-4e95-bdac-048011d7867d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:03:22.248872 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3792aa38-ff7e-4e95-bdac-048011d7867d admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:03:22.249142 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3792aa38-ff7e-4e95-bdac-048011d7867d admin admin] PATH_INFO: `/v3/projects/ae988c55c13041999c0bf8be763e5efd` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:03:22.251588 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3792aa38-ff7e-4e95-bdac-048011d7867d admin admin] RBAC: Authorizing `identity:delete_project(project_id=ae988c55c13041999c0bf8be763e5efd)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:03:22.254917 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3792aa38-ff7e-4e95-bdac-048011d7867d admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:03:22.379501 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-3792aa38-ff7e-4e95-bdac-048011d7867d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ae988c55c13041999c0bf8be763e5efd', 'request_id': 'req-3792aa38-ff7e-4e95-bdac-048011d7867d'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:03:22.391978 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-3792aa38-ff7e-4e95-bdac-048011d7867d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ae988c55c13041999c0bf8be763e5efd', 'request_id': 'req-3792aa38-ff7e-4e95-bdac-048011d7867d'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:03:22.402065 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-3792aa38-ff7e-4e95-bdac-048011d7867d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ae988c55c13041999c0bf8be763e5efd', 'request_id': 'req-3792aa38-ff7e-4e95-bdac-048011d7867d'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:03:22.419095 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-3792aa38-ff7e-4e95-bdac-048011d7867d admin admin] The token cache is being invalidate because project ae988c55c13041999c0bf8be763e5efd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81525) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 09 01:03:22.419095 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-3792aa38-ff7e-4e95-bdac-048011d7867d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:03:22.422215 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-3792aa38-ff7e-4e95-bdac-048011d7867d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:03:22.424505 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1320/2607] 10.222.0.15 () {58 vars in 1233 bytes} [Sun Oct 9 01:03:22 2022] DELETE /identity/v3/projects/ae988c55c13041999c0bf8be763e5efd => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 09 01:03:22.430791 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9a424c-158d-4a6e-86ed-18105bb9700e None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:03:22.431246 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9a424c-158d-4a6e-86ed-18105bb9700e None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:03:22.431744 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9a424c-158d-4a6e-86ed-18105bb9700e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:03:22.473497 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-1f9a424c-158d-4a6e-86ed-18105bb9700e None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 01:03:22.475555 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-1f9a424c-158d-4a6e-86ed-18105bb9700e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:03:22.617089 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1288/2608] 10.222.0.15 () {58 vars in 958 bytes} [Sun Oct 9 01:03:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 01:03:22.625636 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548c2743-73a8-4428-a358-8cecd7280928 None None] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:03:22.625901 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548c2743-73a8-4428-a358-8cecd7280928 None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:03:22.626208 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548c2743-73a8-4428-a358-8cecd7280928 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:03:22.650749 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.auth.core [None req-548c2743-73a8-4428-a358-8cecd7280928 None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 01:03:22.652262 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-548c2743-73a8-4428-a358-8cecd7280928 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:03:22.667434 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1321/2609] 10.222.0.15 () {58 vars in 958 bytes} [Sun Oct 9 01:03:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 01:03:22.668548 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9a424c-158d-4a6e-86ed-18105bb9700e None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:03:22.686551 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9a424c-158d-4a6e-86ed-18105bb9700e None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:03:22.695527 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a146bb6-56ac-4637-b2df-5a7041a0912c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:03:22.696586 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a146bb6-56ac-4637-b2df-5a7041a0912c admin admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:03:22.697137 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a146bb6-56ac-4637-b2df-5a7041a0912c admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:03:22.698078 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a146bb6-56ac-4637-b2df-5a7041a0912c admin admin] PATH_INFO: `/v3/domains` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:03:22.698758 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a146bb6-56ac-4637-b2df-5a7041a0912c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 01:03:22.699123 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a146bb6-56ac-4637-b2df-5a7041a0912c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:03:22.702327 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a146bb6-56ac-4637-b2df-5a7041a0912c admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:03:22.727315 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1289/2610] 10.222.0.15 () {58 vars in 1153 bytes} [Sun Oct 9 01:03:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 01:03:22.730712 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548c2743-73a8-4428-a358-8cecd7280928 None None] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:03:22.749905 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548c2743-73a8-4428-a358-8cecd7280928 None None] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:03:22.757125 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef5bab9-19c6-48f1-bd20-6a5a187ed1d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:03:22.758414 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef5bab9-19c6-48f1-bd20-6a5a187ed1d1 admin admin] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:03:22.758414 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef5bab9-19c6-48f1-bd20-6a5a187ed1d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:03:22.758796 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef5bab9-19c6-48f1-bd20-6a5a187ed1d1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:03:22.759336 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef5bab9-19c6-48f1-bd20-6a5a187ed1d1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:03:22.765110 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef5bab9-19c6-48f1-bd20-6a5a187ed1d1 admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:03:22.800641 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 01:03:22.822029 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1322/2611] 10.222.0.15 () {60 vars in 1153 bytes} [Sun Oct 9 01:03:22 2022] POST /identity/v3/projects => generated 387 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 09 01:03:22.827379 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a146bb6-56ac-4637-b2df-5a7041a0912c admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:03:22.841547 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a146bb6-56ac-4637-b2df-5a7041a0912c admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:03:22.933589 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66acfcc1-d6a7-4d2d-847f-7bf00e81a213 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:03:22.934241 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66acfcc1-d6a7-4d2d-847f-7bf00e81a213 admin admin] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:03:22.934515 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66acfcc1-d6a7-4d2d-847f-7bf00e81a213 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:03:22.934859 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66acfcc1-d6a7-4d2d-847f-7bf00e81a213 admin admin] PATH_INFO: `/v3/users` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:03:22.935570 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66acfcc1-d6a7-4d2d-847f-7bf00e81a213 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:03:22.937563 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66acfcc1-d6a7-4d2d-847f-7bf00e81a213 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:03:22.984688 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1290/2612] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Oct 9 01:03:22 2022] POST /identity/v3/users => generated 294 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 09 01:03:22.985410 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef5bab9-19c6-48f1-bd20-6a5a187ed1d1 admin admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:03:22.998652 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef5bab9-19c6-48f1-bd20-6a5a187ed1d1 admin admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:03:23.011517 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c4673c-7948-464a-be60-8070f496763d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:03:23.012624 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c4673c-7948-464a-be60-8070f496763d admin admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:03:23.013333 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c4673c-7948-464a-be60-8070f496763d admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:03:23.013825 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c4673c-7948-464a-be60-8070f496763d admin admin] PATH_INFO: `/v3/roles` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:03:23.015037 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c4673c-7948-464a-be60-8070f496763d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:03:23.019116 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c4673c-7948-464a-be60-8070f496763d admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:03:23.035032 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1323/2613] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Oct 9 01:03:22 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 09 01:03:23.040529 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66acfcc1-d6a7-4d2d-847f-7bf00e81a213 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:03:23.055380 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 01:03:23.067704 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66acfcc1-d6a7-4d2d-847f-7bf00e81a213 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:03:23.081381 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7ce26a-edc2-46db-86d0-f85ae959d2e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:03:23.082427 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7ce26a-edc2-46db-86d0-f85ae959d2e2 admin admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:03:23.082925 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7ce26a-edc2-46db-86d0-f85ae959d2e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:03:23.083474 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7ce26a-edc2-46db-86d0-f85ae959d2e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:03:23.085746 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7ce26a-edc2-46db-86d0-f85ae959d2e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:03:23.089163 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7ce26a-edc2-46db-86d0-f85ae959d2e2 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:03:23.111341 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1291/2614] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Oct 9 01:03:23 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 09 01:03:23.116260 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c4673c-7948-464a-be60-8070f496763d admin admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:03:23.129026 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c4673c-7948-464a-be60-8070f496763d admin admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:03:23.137738 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2370951-a12c-48d8-866e-a109d9a70dac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:03:23.140285 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2370951-a12c-48d8-866e-a109d9a70dac admin admin] REQUEST_METHOD: `PUT` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:03:23.140811 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2370951-a12c-48d8-866e-a109d9a70dac admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:03:23.141522 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2370951-a12c-48d8-866e-a109d9a70dac admin admin] PATH_INFO: `/v3/projects/523e5d2eec8d40ccb213a267ed785408/users/4ca184fc03ce49aea19f892a23213e9d/roles/afb0a01183d9497795eaa4fa1a4046ae` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:03:23.180863 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2370951-a12c-48d8-866e-a109d9a70dac admin admin] RBAC: Authorizing `identity:create_grant(project_id=523e5d2eec8d40ccb213a267ed785408, user_id=4ca184fc03ce49aea19f892a23213e9d, role_id=afb0a01183d9497795eaa4fa1a4046ae)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:03:23.184167 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2370951-a12c-48d8-866e-a109d9a70dac admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:03:23.209949 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1324/2615] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Oct 9 01:03:23 2022] PUT /identity/v3/projects/523e5d2eec8d40ccb213a267ed785408/users/4ca184fc03ce49aea19f892a23213e9d/roles/afb0a01183d9497795eaa4fa1a4046ae => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 01:03:23.225326 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4719e0b2-66e0-44b1-b0d0-46a65e2f01e3 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:03:23.225614 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4719e0b2-66e0-44b1-b0d0-46a65e2f01e3 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:03:23.225895 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4719e0b2-66e0-44b1-b0d0-46a65e2f01e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:03:23.264707 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-4719e0b2-66e0-44b1-b0d0-46a65e2f01e3 None None] MFA Rules not processed for user `4ca184fc03ce49aea19f892a23213e9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 01:03:23.267602 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-4719e0b2-66e0-44b1-b0d0-46a65e2f01e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:03:23.313036 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1ecbf3-0dc6-4bdf-b750-647e98910305 None None] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:03:23.313371 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1ecbf3-0dc6-4bdf-b750-647e98910305 None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:03:23.313567 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1ecbf3-0dc6-4bdf-b750-647e98910305 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:03:23.374692 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.auth.core [None req-9f1ecbf3-0dc6-4bdf-b750-647e98910305 None None] MFA Rules not processed for user `caa8b6a94a1944318aa8987a2c6d2ca8`. Rule list: `[]` (Enabled: `True`). {{(pid=81525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 01:03:23.376147 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-9f1ecbf3-0dc6-4bdf-b750-647e98910305 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:03:23.396175 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1292/2616] 10.222.0.15 () {58 vars in 958 bytes} [Sun Oct 9 01:03:23 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 01:03:23.398025 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4719e0b2-66e0-44b1-b0d0-46a65e2f01e3 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:03:23.546084 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4719e0b2-66e0-44b1-b0d0-46a65e2f01e3 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:03:23.553394 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4fffd1-e4d1-433d-8611-24dc9a5f1bb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:03:23.554035 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4fffd1-e4d1-433d-8611-24dc9a5f1bb9 admin admin] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:03:23.554308 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4fffd1-e4d1-433d-8611-24dc9a5f1bb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:03:23.555595 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4fffd1-e4d1-433d-8611-24dc9a5f1bb9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:03:23.556332 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4fffd1-e4d1-433d-8611-24dc9a5f1bb9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:03:23.558878 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4fffd1-e4d1-433d-8611-24dc9a5f1bb9 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:03:23.559368 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1325/2617] 10.222.0.15 () {58 vars in 958 bytes} [Sun Oct 9 01:03:23 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 01:03:23.560414 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1ecbf3-0dc6-4bdf-b750-647e98910305 None None] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:03:23.563309 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-9f1ecbf3-0dc6-4bdf-b750-647e98910305 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:03:23.586594 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1ecbf3-0dc6-4bdf-b750-647e98910305 None None] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:03:23.596089 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31e5c7c-d425-407f-a6cf-606496d6d288 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:03:23.597257 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31e5c7c-d425-407f-a6cf-606496d6d288 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:03:23.597688 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31e5c7c-d425-407f-a6cf-606496d6d288 admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:03:23.598215 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31e5c7c-d425-407f-a6cf-606496d6d288 admin admin] PATH_INFO: `/v3/users/fa540de4e48846e7a378229e6c07c3ff` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:03:23.600227 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31e5c7c-d425-407f-a6cf-606496d6d288 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa540de4e48846e7a378229e6c07c3ff)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:03:23.603869 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31e5c7c-d425-407f-a6cf-606496d6d288 admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:03:23.614048 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1293/2618] 10.222.0.15 () {60 vars in 1153 bytes} [Sun Oct 9 01:03:23 2022] POST /identity/v3/projects => generated 387 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 09 01:03:23.615088 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4fffd1-e4d1-433d-8611-24dc9a5f1bb9 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:03:23.617167 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-4e4fffd1-e4d1-433d-8611-24dc9a5f1bb9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:03:23.679141 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-f31e5c7c-d425-407f-a6cf-606496d6d288 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa540de4e48846e7a378229e6c07c3ff'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:03:23.692998 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-f31e5c7c-d425-407f-a6cf-606496d6d288 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa540de4e48846e7a378229e6c07c3ff'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:03:23.694486 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-f31e5c7c-d425-407f-a6cf-606496d6d288 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa540de4e48846e7a378229e6c07c3ff'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:03:23.695680 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-f31e5c7c-d425-407f-a6cf-606496d6d288 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa540de4e48846e7a378229e6c07c3ff'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:03:23.707080 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4fffd1-e4d1-433d-8611-24dc9a5f1bb9 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:03:23.710585 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-f31e5c7c-d425-407f-a6cf-606496d6d288 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa540de4e48846e7a378229e6c07c3ff'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:03:23.712770 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8046e9e5-7a47-4a64-859b-26875aa9094f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:03:23.713404 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8046e9e5-7a47-4a64-859b-26875aa9094f admin admin] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:03:23.713691 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8046e9e5-7a47-4a64-859b-26875aa9094f admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:03:23.713969 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8046e9e5-7a47-4a64-859b-26875aa9094f admin admin] PATH_INFO: `/v3/projects` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:03:23.714620 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8046e9e5-7a47-4a64-859b-26875aa9094f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:03:23.716621 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8046e9e5-7a47-4a64-859b-26875aa9094f admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:03:23.736542 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 01:03:23.751528 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1326/2619] 10.222.0.15 () {58 vars in 1224 bytes} [Sun Oct 9 01:03:23 2022] DELETE /identity/v3/users/fa540de4e48846e7a378229e6c07c3ff => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 01:03:23.753155 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31e5c7c-d425-407f-a6cf-606496d6d288 admin admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:03:23.755529 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-f31e5c7c-d425-407f-a6cf-606496d6d288 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:03:23.756260 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1294/2620] 10.222.0.15 () {60 vars in 1153 bytes} [Sun Oct 9 01:03:23 2022] POST /identity/v3/projects => generated 373 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 09 01:03:23.761536 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8046e9e5-7a47-4a64-859b-26875aa9094f admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:03:23.763738 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-8046e9e5-7a47-4a64-859b-26875aa9094f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:03:23.802095 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 01:03:23.871528 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31e5c7c-d425-407f-a6cf-606496d6d288 admin admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:03:23.900322 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8046e9e5-7a47-4a64-859b-26875aa9094f admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:03:23.910715 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d9c4c4-8ebd-4a3a-900b-9358fa7244cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:03:23.912458 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d9c4c4-8ebd-4a3a-900b-9358fa7244cf admin admin] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:03:23.912984 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d9c4c4-8ebd-4a3a-900b-9358fa7244cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:03:23.913513 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d9c4c4-8ebd-4a3a-900b-9358fa7244cf admin admin] PATH_INFO: `/v3/users` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:03:23.915096 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d9c4c4-8ebd-4a3a-900b-9358fa7244cf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:03:23.917678 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d9c4c4-8ebd-4a3a-900b-9358fa7244cf admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:03:23.955366 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1295/2621] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Oct 9 01:03:23 2022] POST /identity/v3/users => generated 293 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 09 01:03:23.961257 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d9c4c4-8ebd-4a3a-900b-9358fa7244cf admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:03:23.975397 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d9c4c4-8ebd-4a3a-900b-9358fa7244cf admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:03:23.982071 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84e0526-df7d-4294-b7a2-84cc9be56a3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:03:23.982930 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84e0526-df7d-4294-b7a2-84cc9be56a3d admin admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:03:23.983217 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84e0526-df7d-4294-b7a2-84cc9be56a3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:03:23.983548 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84e0526-df7d-4294-b7a2-84cc9be56a3d admin admin] PATH_INFO: `/v3/roles` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:03:23.984216 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84e0526-df7d-4294-b7a2-84cc9be56a3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:03:23.987131 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84e0526-df7d-4294-b7a2-84cc9be56a3d admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:03:24.005622 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1296/2622] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Oct 9 01:03:23 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 09 01:03:24.009770 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9963b647-ff4e-45ec-9070-e4e3ab34cbae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:03:24.011212 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9963b647-ff4e-45ec-9070-e4e3ab34cbae admin admin] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:03:24.011519 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9963b647-ff4e-45ec-9070-e4e3ab34cbae admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:03:24.013285 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84e0526-df7d-4294-b7a2-84cc9be56a3d admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:03:24.013806 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9963b647-ff4e-45ec-9070-e4e3ab34cbae admin admin] PATH_INFO: `/v3/users` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:03:24.020654 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9963b647-ff4e-45ec-9070-e4e3ab34cbae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:03:24.023100 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9963b647-ff4e-45ec-9070-e4e3ab34cbae admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:03:24.039737 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84e0526-df7d-4294-b7a2-84cc9be56a3d admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:03:24.048824 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d9a0e2-19aa-4ffd-82a2-60c92300a7b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:03:24.049745 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d9a0e2-19aa-4ffd-82a2-60c92300a7b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:03:24.050199 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d9a0e2-19aa-4ffd-82a2-60c92300a7b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:03:24.050483 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d9a0e2-19aa-4ffd-82a2-60c92300a7b0 admin admin] PATH_INFO: `/v3/projects/c4ec71ece5024ce788c79f9271f0aec4/users/87b0927538b84108b4031e363f638d99/roles/f69dddf26daf4dd79d4c962beb877af5` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:03:24.063928 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1327/2623] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Oct 9 01:03:23 2022] POST /identity/v3/users => generated 294 bytes in 312 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 09 01:03:24.067429 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9963b647-ff4e-45ec-9070-e4e3ab34cbae admin admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:03:24.080743 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9963b647-ff4e-45ec-9070-e4e3ab34cbae admin admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:03:24.086461 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a57ca2d-60fc-41f6-85e4-08781973bb04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:03:24.087151 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a57ca2d-60fc-41f6-85e4-08781973bb04 admin admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:03:24.087480 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a57ca2d-60fc-41f6-85e4-08781973bb04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:03:24.087753 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a57ca2d-60fc-41f6-85e4-08781973bb04 admin admin] PATH_INFO: `/v3/roles` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:03:24.088643 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a57ca2d-60fc-41f6-85e4-08781973bb04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:03:24.090569 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a57ca2d-60fc-41f6-85e4-08781973bb04 admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:03:24.105927 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1328/2624] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Oct 9 01:03:24 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 09 01:03:24.107772 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a57ca2d-60fc-41f6-85e4-08781973bb04 admin admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:03:24.110378 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-4a57ca2d-60fc-41f6-85e4-08781973bb04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:03:24.127808 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a57ca2d-60fc-41f6-85e4-08781973bb04 admin admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:03:24.134538 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a31894-e93a-4fc8-af7e-843ffee2df6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:03:24.135522 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a31894-e93a-4fc8-af7e-843ffee2df6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:03:24.135873 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a31894-e93a-4fc8-af7e-843ffee2df6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:03:24.136220 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a31894-e93a-4fc8-af7e-843ffee2df6c admin admin] PATH_INFO: `/v3/projects/83f86a7212aa4801b58dc42a87d58d16` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:03:24.137801 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a31894-e93a-4fc8-af7e-843ffee2df6c admin admin] RBAC: Authorizing `identity:delete_project(project_id=83f86a7212aa4801b58dc42a87d58d16)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:03:24.147483 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a31894-e93a-4fc8-af7e-843ffee2df6c admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:03:24.218759 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d9a0e2-19aa-4ffd-82a2-60c92300a7b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4ec71ece5024ce788c79f9271f0aec4, user_id=87b0927538b84108b4031e363f638d99, role_id=f69dddf26daf4dd79d4c962beb877af5)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:03:24.221570 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d9a0e2-19aa-4ffd-82a2-60c92300a7b0 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:03:24.246778 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1297/2625] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Oct 9 01:03:24 2022] PUT /identity/v3/projects/c4ec71ece5024ce788c79f9271f0aec4/users/87b0927538b84108b4031e363f638d99/roles/f69dddf26daf4dd79d4c962beb877af5 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 01:03:24.248077 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d9a0e2-19aa-4ffd-82a2-60c92300a7b0 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:03:24.259474 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-01a31894-e93a-4fc8-af7e-843ffee2df6c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '83f86a7212aa4801b58dc42a87d58d16', 'request_id': 'req-01a31894-e93a-4fc8-af7e-843ffee2df6c'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:03:24.276699 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-01a31894-e93a-4fc8-af7e-843ffee2df6c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '83f86a7212aa4801b58dc42a87d58d16', 'request_id': 'req-01a31894-e93a-4fc8-af7e-843ffee2df6c'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:03:24.286146 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-01a31894-e93a-4fc8-af7e-843ffee2df6c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '83f86a7212aa4801b58dc42a87d58d16', 'request_id': 'req-01a31894-e93a-4fc8-af7e-843ffee2df6c'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:03:24.300417 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-01a31894-e93a-4fc8-af7e-843ffee2df6c admin admin] The token cache is being invalidate because project 83f86a7212aa4801b58dc42a87d58d16 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81525) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 09 01:03:24.300687 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-01a31894-e93a-4fc8-af7e-843ffee2df6c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:03:24.302131 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-01a31894-e93a-4fc8-af7e-843ffee2df6c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:03:24.305901 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1329/2626] 10.222.0.15 () {58 vars in 1233 bytes} [Sun Oct 9 01:03:24 2022] DELETE /identity/v3/projects/83f86a7212aa4801b58dc42a87d58d16 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 01:03:24.307147 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a31894-e93a-4fc8-af7e-843ffee2df6c admin admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:03:24.308812 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-01a31894-e93a-4fc8-af7e-843ffee2df6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:03:24.365944 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d9a0e2-19aa-4ffd-82a2-60c92300a7b0 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:03:24.375584 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a814a7-fa82-47e6-b7e1-9836b8f7c5b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:03:24.376715 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a814a7-fa82-47e6-b7e1-9836b8f7c5b8 admin admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:03:24.377513 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a814a7-fa82-47e6-b7e1-9836b8f7c5b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:03:24.378407 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a814a7-fa82-47e6-b7e1-9836b8f7c5b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:03:24.390934 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a814a7-fa82-47e6-b7e1-9836b8f7c5b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:03:24.394952 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 01:03:24.396103 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a814a7-fa82-47e6-b7e1-9836b8f7c5b8 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:03:24.432584 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1298/2627] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Oct 9 01:03:24 2022] GET /identity/v3/roles => generated 1420 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 09 01:03:24.434242 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a814a7-fa82-47e6-b7e1-9836b8f7c5b8 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:03:24.455594 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-62a814a7-fa82-47e6-b7e1-9836b8f7c5b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:03:24.460044 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a31894-e93a-4fc8-af7e-843ffee2df6c admin admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:03:24.482445 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147e9599-e0bd-4bac-b534-98163697ad5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:03:24.483174 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147e9599-e0bd-4bac-b534-98163697ad5c admin admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:03:24.483518 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147e9599-e0bd-4bac-b534-98163697ad5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:03:24.483793 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147e9599-e0bd-4bac-b534-98163697ad5c admin admin] PATH_INFO: `/v3/roles` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:03:24.484471 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147e9599-e0bd-4bac-b534-98163697ad5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:03:24.489737 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147e9599-e0bd-4bac-b534-98163697ad5c admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:03:24.493100 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a814a7-fa82-47e6-b7e1-9836b8f7c5b8 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:03:24.514450 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1330/2628] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Oct 9 01:03:24 2022] GET /identity/v3/roles => generated 1420 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 09 01:03:24.515793 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147e9599-e0bd-4bac-b534-98163697ad5c admin admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:03:24.517947 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-147e9599-e0bd-4bac-b534-98163697ad5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:03:24.528335 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d0b8cc-c33d-4b77-9175-0ceaf5045a87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:03:24.529295 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d0b8cc-c33d-4b77-9175-0ceaf5045a87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:03:24.529706 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d0b8cc-c33d-4b77-9175-0ceaf5045a87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:03:24.530744 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d0b8cc-c33d-4b77-9175-0ceaf5045a87 admin admin] PATH_INFO: `/v3/users/d3b5477b0d704ea9b788f8834b3ec0ca` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:03:24.533257 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d0b8cc-c33d-4b77-9175-0ceaf5045a87 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d3b5477b0d704ea9b788f8834b3ec0ca)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:03:24.537019 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d0b8cc-c33d-4b77-9175-0ceaf5045a87 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:03:24.537495 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147e9599-e0bd-4bac-b534-98163697ad5c admin admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:03:24.545930 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689268fa-cea3-42ae-b76f-9252f31fb783 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:03:24.546739 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689268fa-cea3-42ae-b76f-9252f31fb783 admin admin] REQUEST_METHOD: `PUT` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:03:24.547021 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689268fa-cea3-42ae-b76f-9252f31fb783 admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:03:24.547340 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689268fa-cea3-42ae-b76f-9252f31fb783 admin admin] PATH_INFO: `/v3/projects/96280ad819f64ca1a5c409fbea6855bd/users/9c3ca4a85f124a68bbee89499901b683/roles/afb0a01183d9497795eaa4fa1a4046ae` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:03:24.576330 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689268fa-cea3-42ae-b76f-9252f31fb783 admin admin] RBAC: Authorizing `identity:create_grant(project_id=96280ad819f64ca1a5c409fbea6855bd, user_id=9c3ca4a85f124a68bbee89499901b683, role_id=afb0a01183d9497795eaa4fa1a4046ae)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:03:24.587759 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689268fa-cea3-42ae-b76f-9252f31fb783 admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:03:24.625750 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1331/2629] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Oct 9 01:03:24 2022] PUT /identity/v3/projects/96280ad819f64ca1a5c409fbea6855bd/users/9c3ca4a85f124a68bbee89499901b683/roles/afb0a01183d9497795eaa4fa1a4046ae => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 01:03:24.626628 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689268fa-cea3-42ae-b76f-9252f31fb783 admin admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:03:24.631687 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:INSERT=5,keystone:SELECT=90,keystone:DELETE=5 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 01:03:24.651316 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-d9d0b8cc-c33d-4b77-9175-0ceaf5045a87 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd3b5477b0d704ea9b788f8834b3ec0ca'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:03:24.666631 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-d9d0b8cc-c33d-4b77-9175-0ceaf5045a87 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd3b5477b0d704ea9b788f8834b3ec0ca'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:03:24.669219 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-d9d0b8cc-c33d-4b77-9175-0ceaf5045a87 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd3b5477b0d704ea9b788f8834b3ec0ca'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:03:24.672028 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-d9d0b8cc-c33d-4b77-9175-0ceaf5045a87 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd3b5477b0d704ea9b788f8834b3ec0ca'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:03:24.686737 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-d9d0b8cc-c33d-4b77-9175-0ceaf5045a87 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd3b5477b0d704ea9b788f8834b3ec0ca'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:03:24.747318 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1299/2630] 10.222.0.15 () {58 vars in 1224 bytes} [Sun Oct 9 01:03:24 2022] DELETE /identity/v3/users/d3b5477b0d704ea9b788f8834b3ec0ca => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 01:03:24.754049 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7859e05f-4a3b-4754-a340-8fc4669a6210 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:03:24.756438 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7859e05f-4a3b-4754-a340-8fc4669a6210 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:03:24.756930 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7859e05f-4a3b-4754-a340-8fc4669a6210 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:03:24.823894 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689268fa-cea3-42ae-b76f-9252f31fb783 admin admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:03:24.825004 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-7859e05f-4a3b-4754-a340-8fc4669a6210 None None] MFA Rules not processed for user `9c3ca4a85f124a68bbee89499901b683`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 01:03:24.827115 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-7859e05f-4a3b-4754-a340-8fc4669a6210 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:03:24.911044 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23cd841-bd62-4631-82de-7ebad4afcdf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:03:24.912616 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23cd841-bd62-4631-82de-7ebad4afcdf8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:03:24.913114 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23cd841-bd62-4631-82de-7ebad4afcdf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:03:24.913768 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23cd841-bd62-4631-82de-7ebad4afcdf8 admin admin] PATH_INFO: `/v3/projects/c4ec71ece5024ce788c79f9271f0aec4/users/87b0927538b84108b4031e363f638d99/roles/f69dddf26daf4dd79d4c962beb877af5` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:03:24.918955 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23cd841-bd62-4631-82de-7ebad4afcdf8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4ec71ece5024ce788c79f9271f0aec4, user_id=87b0927538b84108b4031e363f638d99, role_id=f69dddf26daf4dd79d4c962beb877af5)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:03:24.924539 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23cd841-bd62-4631-82de-7ebad4afcdf8 admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:03:24.938897 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1300/2631] 10.222.0.15 () {58 vars in 958 bytes} [Sun Oct 9 01:03:24 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 01:03:24.944492 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7859e05f-4a3b-4754-a340-8fc4669a6210 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:03:24.945960 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1332/2632] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Oct 9 01:03:24 2022] PUT /identity/v3/projects/c4ec71ece5024ce788c79f9271f0aec4/users/87b0927538b84108b4031e363f638d99/roles/f69dddf26daf4dd79d4c962beb877af5 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 01:03:24.947142 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-7859e05f-4a3b-4754-a340-8fc4669a6210 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:03:24.967135 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7859e05f-4a3b-4754-a340-8fc4669a6210 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:03:25.043296 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23cd841-bd62-4631-82de-7ebad4afcdf8 admin admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:03:25.045680 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-d23cd841-bd62-4631-82de-7ebad4afcdf8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:03:25.130897 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 01:03:25.156360 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8257a2-a3b0-46d6-ba94-e548f899afd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:03:25.157004 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8257a2-a3b0-46d6-ba94-e548f899afd1 admin admin] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:03:25.157326 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8257a2-a3b0-46d6-ba94-e548f899afd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:03:25.157602 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8257a2-a3b0-46d6-ba94-e548f899afd1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:03:25.158486 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8257a2-a3b0-46d6-ba94-e548f899afd1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:03:25.161508 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8257a2-a3b0-46d6-ba94-e548f899afd1 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:03:25.186558 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23cd841-bd62-4631-82de-7ebad4afcdf8 admin admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:03:25.196484 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3192cadc-43af-4ceb-8fc1-a73d7e1183d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:03:25.197207 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3192cadc-43af-4ceb-8fc1-a73d7e1183d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:03:25.197657 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3192cadc-43af-4ceb-8fc1-a73d7e1183d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:03:25.197927 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3192cadc-43af-4ceb-8fc1-a73d7e1183d5 admin admin] PATH_INFO: `/v3/projects/27d5d0069b24448cb25897fdc27b96a4` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:03:25.199232 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3192cadc-43af-4ceb-8fc1-a73d7e1183d5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=27d5d0069b24448cb25897fdc27b96a4)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:03:25.201372 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3192cadc-43af-4ceb-8fc1-a73d7e1183d5 admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:03:25.201582 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1301/2633] 10.222.0.15 () {60 vars in 1153 bytes} [Sun Oct 9 01:03:24 2022] POST /identity/v3/projects => generated 387 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 09 01:03:25.207090 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8257a2-a3b0-46d6-ba94-e548f899afd1 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:03:25.266691 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:DELETE=5,keystone:SELECT=93,keystone:INSERT=2 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 01:03:25.274014 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-3192cadc-43af-4ceb-8fc1-a73d7e1183d5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '27d5d0069b24448cb25897fdc27b96a4', 'request_id': 'req-3192cadc-43af-4ceb-8fc1-a73d7e1183d5'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:03:25.287130 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-3192cadc-43af-4ceb-8fc1-a73d7e1183d5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '27d5d0069b24448cb25897fdc27b96a4', 'request_id': 'req-3192cadc-43af-4ceb-8fc1-a73d7e1183d5'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:03:25.307577 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8257a2-a3b0-46d6-ba94-e548f899afd1 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:03:25.312772 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-3192cadc-43af-4ceb-8fc1-a73d7e1183d5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '27d5d0069b24448cb25897fdc27b96a4', 'request_id': 'req-3192cadc-43af-4ceb-8fc1-a73d7e1183d5'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:03:25.329543 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-3192cadc-43af-4ceb-8fc1-a73d7e1183d5 admin admin] The token cache is being invalidate because project 27d5d0069b24448cb25897fdc27b96a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81525) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 09 01:03:25.329919 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-3192cadc-43af-4ceb-8fc1-a73d7e1183d5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:03:25.330805 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-3192cadc-43af-4ceb-8fc1-a73d7e1183d5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:03:25.332735 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1333/2634] 10.222.0.15 () {58 vars in 1233 bytes} [Sun Oct 9 01:03:25 2022] DELETE /identity/v3/projects/27d5d0069b24448cb25897fdc27b96a4 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 09 01:03:25.338184 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b549d645-48ca-4da0-a835-dc4e1fff65f6 None None] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:03:25.338451 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b549d645-48ca-4da0-a835-dc4e1fff65f6 None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:03:25.338780 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b549d645-48ca-4da0-a835-dc4e1fff65f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:03:25.373407 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.auth.core [None req-b549d645-48ca-4da0-a835-dc4e1fff65f6 None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 01:03:25.376066 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-b549d645-48ca-4da0-a835-dc4e1fff65f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:03:25.387353 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3ddd08-2870-4136-92de-30d0201dbfc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:03:25.387950 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3ddd08-2870-4136-92de-30d0201dbfc9 admin admin] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:03:25.388225 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3ddd08-2870-4136-92de-30d0201dbfc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:03:25.389268 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3ddd08-2870-4136-92de-30d0201dbfc9 admin admin] PATH_INFO: `/v3/users` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:03:25.389268 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3ddd08-2870-4136-92de-30d0201dbfc9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:03:25.391387 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3ddd08-2870-4136-92de-30d0201dbfc9 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:03:25.420326 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1302/2635] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Oct 9 01:03:25 2022] POST /identity/v3/users => generated 300 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 09 01:03:25.424195 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3ddd08-2870-4136-92de-30d0201dbfc9 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:03:25.426609 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-ab3ddd08-2870-4136-92de-30d0201dbfc9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:03:25.453901 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3ddd08-2870-4136-92de-30d0201dbfc9 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:03:25.462922 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5487115e-51d7-4f3f-882c-aa4043d74368 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:03:25.464089 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5487115e-51d7-4f3f-882c-aa4043d74368 admin admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:03:25.464636 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5487115e-51d7-4f3f-882c-aa4043d74368 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:03:25.465112 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5487115e-51d7-4f3f-882c-aa4043d74368 admin admin] PATH_INFO: `/v3/roles` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:03:25.466351 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5487115e-51d7-4f3f-882c-aa4043d74368 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:03:25.469880 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5487115e-51d7-4f3f-882c-aa4043d74368 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:03:25.496967 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1334/2636] 10.222.0.15 () {58 vars in 958 bytes} [Sun Oct 9 01:03:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 09 01:03:25.497233 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1303/2637] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Oct 9 01:03:25 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 09 01:03:25.497352 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a222e571-e3df-4e55-8c24-9a663abebb61 None None] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:03:25.497352 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a222e571-e3df-4e55-8c24-9a663abebb61 None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:03:25.497352 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a222e571-e3df-4e55-8c24-9a663abebb61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:03:25.499530 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5487115e-51d7-4f3f-882c-aa4043d74368 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:03:25.513818 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5487115e-51d7-4f3f-882c-aa4043d74368 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:03:25.519995 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41949cd7-3bc8-4e92-a658-6547c982b56e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:03:25.520915 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41949cd7-3bc8-4e92-a658-6547c982b56e admin admin] REQUEST_METHOD: `PUT` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:03:25.521308 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41949cd7-3bc8-4e92-a658-6547c982b56e admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:03:25.521715 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41949cd7-3bc8-4e92-a658-6547c982b56e admin admin] PATH_INFO: `/v3/projects/186c1666cefd4d4398da481ce1a44b9e/users/427d2d75b01e43b7993630f6f0fd2149/roles/f69dddf26daf4dd79d4c962beb877af5` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:03:25.531211 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.auth.core [None req-a222e571-e3df-4e55-8c24-9a663abebb61 None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 01:03:25.532693 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-a222e571-e3df-4e55-8c24-9a663abebb61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:03:25.553687 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1335/2638] 10.222.0.15 () {58 vars in 958 bytes} [Sun Oct 9 01:03:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 09 01:03:25.554957 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41949cd7-3bc8-4e92-a658-6547c982b56e admin admin] RBAC: Authorizing `identity:create_grant(project_id=186c1666cefd4d4398da481ce1a44b9e, user_id=427d2d75b01e43b7993630f6f0fd2149, role_id=f69dddf26daf4dd79d4c962beb877af5)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:03:25.556444 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a222e571-e3df-4e55-8c24-9a663abebb61 None None] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:03:25.561720 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41949cd7-3bc8-4e92-a658-6547c982b56e admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:03:25.568054 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a222e571-e3df-4e55-8c24-9a663abebb61 None None] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:03:25.575437 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3148f2-41c4-4e76-9545-e6f3340f36d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:03:25.576082 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3148f2-41c4-4e76-9545-e6f3340f36d8 admin admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:03:25.576352 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3148f2-41c4-4e76-9545-e6f3340f36d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:03:25.576746 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3148f2-41c4-4e76-9545-e6f3340f36d8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:03:25.577485 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3148f2-41c4-4e76-9545-e6f3340f36d8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 01:03:25.577857 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3148f2-41c4-4e76-9545-e6f3340f36d8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:03:25.579648 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3148f2-41c4-4e76-9545-e6f3340f36d8 admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:03:25.595130 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1304/2639] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Oct 9 01:03:25 2022] PUT /identity/v3/projects/186c1666cefd4d4398da481ce1a44b9e/users/427d2d75b01e43b7993630f6f0fd2149/roles/f69dddf26daf4dd79d4c962beb877af5 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 09 01:03:25.598382 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1336/2640] 10.222.0.15 () {58 vars in 1153 bytes} [Sun Oct 9 01:03:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 01:03:25.601487 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3148f2-41c4-4e76-9545-e6f3340f36d8 admin admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:03:25.603182 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41949cd7-3bc8-4e92-a658-6547c982b56e admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:03:25.614211 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3148f2-41c4-4e76-9545-e6f3340f36d8 admin admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:03:25.692775 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 01:03:25.706065 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb30cb3-3ad7-4359-8d66-250212b84ec2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:03:25.707322 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb30cb3-3ad7-4359-8d66-250212b84ec2 admin admin] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:03:25.707767 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb30cb3-3ad7-4359-8d66-250212b84ec2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:03:25.708252 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb30cb3-3ad7-4359-8d66-250212b84ec2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:03:25.709498 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb30cb3-3ad7-4359-8d66-250212b84ec2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:03:25.713217 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb30cb3-3ad7-4359-8d66-250212b84ec2 admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:03:25.751612 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41949cd7-3bc8-4e92-a658-6547c982b56e admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:03:25.758878 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1337/2641] 10.222.0.15 () {60 vars in 1153 bytes} [Sun Oct 9 01:03:25 2022] POST /identity/v3/projects => generated 373 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 09 01:03:25.760495 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6f500b-b70a-4dbf-9604-a6f87e667c15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:03:25.761269 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6f500b-b70a-4dbf-9604-a6f87e667c15 admin admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:03:25.761751 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6f500b-b70a-4dbf-9604-a6f87e667c15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:03:25.762055 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6f500b-b70a-4dbf-9604-a6f87e667c15 admin admin] PATH_INFO: `/v3/roles` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:03:25.763562 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6f500b-b70a-4dbf-9604-a6f87e667c15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:03:25.763856 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb30cb3-3ad7-4359-8d66-250212b84ec2 admin admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:03:25.766805 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6f500b-b70a-4dbf-9604-a6f87e667c15 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:03:25.787667 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1305/2642] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Oct 9 01:03:25 2022] GET /identity/v3/roles => generated 1420 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 09 01:03:25.792511 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6f500b-b70a-4dbf-9604-a6f87e667c15 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:03:25.812412 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6f500b-b70a-4dbf-9604-a6f87e667c15 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:03:25.883103 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 01:03:25.889745 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb30cb3-3ad7-4359-8d66-250212b84ec2 admin admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:03:25.898920 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3179644-7401-4ffb-a4b3-bdc60e6d7e95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:03:25.899948 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3179644-7401-4ffb-a4b3-bdc60e6d7e95 admin admin] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:03:25.900393 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3179644-7401-4ffb-a4b3-bdc60e6d7e95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:03:25.900852 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3179644-7401-4ffb-a4b3-bdc60e6d7e95 admin admin] PATH_INFO: `/v3/users` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:03:25.902019 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3179644-7401-4ffb-a4b3-bdc60e6d7e95 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:03:25.905603 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3179644-7401-4ffb-a4b3-bdc60e6d7e95 admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:03:25.947881 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1338/2643] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Oct 9 01:03:25 2022] POST /identity/v3/users => generated 287 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 09 01:03:25.954011 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3179644-7401-4ffb-a4b3-bdc60e6d7e95 admin admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:03:25.977229 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3179644-7401-4ffb-a4b3-bdc60e6d7e95 admin admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:03:25.991230 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81221db-4353-47d7-8449-dfb686d64a83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:03:25.992509 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81221db-4353-47d7-8449-dfb686d64a83 admin admin] REQUEST_METHOD: `PUT` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:03:25.993095 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81221db-4353-47d7-8449-dfb686d64a83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:03:25.993515 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81221db-4353-47d7-8449-dfb686d64a83 admin admin] PATH_INFO: `/v3/projects/186c1666cefd4d4398da481ce1a44b9e/users/427d2d75b01e43b7993630f6f0fd2149/roles/f69dddf26daf4dd79d4c962beb877af5` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:03:25.999639 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81221db-4353-47d7-8449-dfb686d64a83 admin admin] RBAC: Authorizing `identity:create_grant(project_id=186c1666cefd4d4398da481ce1a44b9e, user_id=427d2d75b01e43b7993630f6f0fd2149, role_id=f69dddf26daf4dd79d4c962beb877af5)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:03:26.006950 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81221db-4353-47d7-8449-dfb686d64a83 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:03:26.011620 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73610b32-d9a1-41e3-b909-6623b10470e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:03:26.012272 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73610b32-d9a1-41e3-b909-6623b10470e2 admin admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:03:26.012547 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73610b32-d9a1-41e3-b909-6623b10470e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:03:26.012813 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73610b32-d9a1-41e3-b909-6623b10470e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:03:26.014122 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73610b32-d9a1-41e3-b909-6623b10470e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:03:26.016753 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73610b32-d9a1-41e3-b909-6623b10470e2 admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:03:26.031129 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1306/2644] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Oct 9 01:03:25 2022] PUT /identity/v3/projects/186c1666cefd4d4398da481ce1a44b9e/users/427d2d75b01e43b7993630f6f0fd2149/roles/f69dddf26daf4dd79d4c962beb877af5 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 01:03:26.032376 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1339/2645] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Oct 9 01:03:25 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 09 01:03:26.038465 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81221db-4353-47d7-8449-dfb686d64a83 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:03:26.046250 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833575ce-f6fe-4a9d-a7b7-f4b18d265644 None None] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:03:26.046709 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833575ce-f6fe-4a9d-a7b7-f4b18d265644 None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:03:26.047893 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833575ce-f6fe-4a9d-a7b7-f4b18d265644 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:03:26.094729 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.auth.core [None req-833575ce-f6fe-4a9d-a7b7-f4b18d265644 None None] MFA Rules not processed for user `427d2d75b01e43b7993630f6f0fd2149`. Rule list: `[]` (Enabled: `True`). {{(pid=81525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 01:03:26.096759 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-833575ce-f6fe-4a9d-a7b7-f4b18d265644 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:03:26.156171 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81221db-4353-47d7-8449-dfb686d64a83 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:03:26.164020 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78713a21-c608-4d9e-937d-4496a2cfbc08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:03:26.164913 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78713a21-c608-4d9e-937d-4496a2cfbc08 admin admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:03:26.165290 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78713a21-c608-4d9e-937d-4496a2cfbc08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:03:26.165746 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78713a21-c608-4d9e-937d-4496a2cfbc08 admin admin] PATH_INFO: `/v3/roles` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:03:26.166617 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78713a21-c608-4d9e-937d-4496a2cfbc08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:03:26.170032 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78713a21-c608-4d9e-937d-4496a2cfbc08 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:03:26.196598 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1340/2646] 10.222.0.15 () {58 vars in 958 bytes} [Sun Oct 9 01:03:26 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 01:03:26.199365 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1307/2647] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Oct 9 01:03:26 2022] GET /identity/v3/roles => generated 1420 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 09 01:03:26.201538 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fb9ad7-6a39-47c8-8215-367c5dd80611 None None] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:03:26.201821 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fb9ad7-6a39-47c8-8215-367c5dd80611 None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:03:26.202094 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fb9ad7-6a39-47c8-8215-367c5dd80611 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:03:26.202300 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fadbed1-feb4-4ac0-89a6-013e5aa0567a None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:03:26.202572 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fadbed1-feb4-4ac0-89a6-013e5aa0567a None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:03:26.203222 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fadbed1-feb4-4ac0-89a6-013e5aa0567a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:03:26.234932 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.auth.core [None req-60fb9ad7-6a39-47c8-8215-367c5dd80611 None None] MFA Rules not processed for user `87b0927538b84108b4031e363f638d99`. Rule list: `[]` (Enabled: `True`). {{(pid=81525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 01:03:26.236341 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-60fb9ad7-6a39-47c8-8215-367c5dd80611 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:03:26.240427 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-1fadbed1-feb4-4ac0-89a6-013e5aa0567a None None] MFA Rules not processed for user `3a6cfef106c84f759ce0874be77f7380`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 01:03:26.243341 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-1fadbed1-feb4-4ac0-89a6-013e5aa0567a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:03:26.293779 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 01:03:26.337107 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1308/2648] 10.222.0.15 () {58 vars in 1009 bytes} [Sun Oct 9 01:03:26 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 01:03:26.338592 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fadbed1-feb4-4ac0-89a6-013e5aa0567a None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:03:26.343568 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1341/2649] 10.222.0.15 () {58 vars in 958 bytes} [Sun Oct 9 01:03:26 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 01:03:26.348584 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fb9ad7-6a39-47c8-8215-367c5dd80611 None None] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:03:26.350931 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-60fb9ad7-6a39-47c8-8215-367c5dd80611 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:03:26.357031 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fadbed1-feb4-4ac0-89a6-013e5aa0567a None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:03:26.363781 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5b0ae4-67c5-4197-9f23-9fe001066940 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:03:26.364913 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5b0ae4-67c5-4197-9f23-9fe001066940 admin admin] REQUEST_METHOD: `PUT` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:03:26.365317 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5b0ae4-67c5-4197-9f23-9fe001066940 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:03:26.365770 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5b0ae4-67c5-4197-9f23-9fe001066940 admin admin] PATH_INFO: `/v3/projects/973a525157be4969a7f03b656d765c01/users/29b989d34f3e418eb40deb4e1a320d0d/roles/afb0a01183d9497795eaa4fa1a4046ae` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:03:26.384387 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5b0ae4-67c5-4197-9f23-9fe001066940 admin admin] RBAC: Authorizing `identity:create_grant(project_id=973a525157be4969a7f03b656d765c01, user_id=29b989d34f3e418eb40deb4e1a320d0d, role_id=afb0a01183d9497795eaa4fa1a4046ae)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:03:26.387823 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5b0ae4-67c5-4197-9f23-9fe001066940 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:03:26.404698 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1309/2650] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Oct 9 01:03:26 2022] PUT /identity/v3/projects/973a525157be4969a7f03b656d765c01/users/29b989d34f3e418eb40deb4e1a320d0d/roles/afb0a01183d9497795eaa4fa1a4046ae => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 01:03:26.406286 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed97ae22-19e7-4376-ab8f-6b5cc19484f8 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:03:26.406565 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed97ae22-19e7-4376-ab8f-6b5cc19484f8 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:03:26.406833 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed97ae22-19e7-4376-ab8f-6b5cc19484f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:03:26.427645 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-ed97ae22-19e7-4376-ab8f-6b5cc19484f8 None None] MFA Rules not processed for user `caa8b6a94a1944318aa8987a2c6d2ca8`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 01:03:26.428896 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-ed97ae22-19e7-4376-ab8f-6b5cc19484f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:03:26.434311 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fb9ad7-6a39-47c8-8215-367c5dd80611 None None] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:03:26.476251 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 01:03:26.505314 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce032f9-691f-42f5-bfec-76576a18f912 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff7cb78bcd91467abe5c2e2b48aedd1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f148d39ced534860abfbe8fc3f98ace4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:03:26.506066 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce032f9-691f-42f5-bfec-76576a18f912 service cinder] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:03:26.506383 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce032f9-691f-42f5-bfec-76576a18f912 service cinder] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:03:26.506767 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce032f9-691f-42f5-bfec-76576a18f912 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:03:26.508731 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1310/2651] 10.222.0.15 () {58 vars in 958 bytes} [Sun Oct 9 01:03:26 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 01:03:26.511176 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed97ae22-19e7-4376-ab8f-6b5cc19484f8 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:03:26.511176 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-ed97ae22-19e7-4376-ab8f-6b5cc19484f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:03:26.599837 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce032f9-691f-42f5-bfec-76576a18f912 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:03:26.601762 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce032f9-691f-42f5-bfec-76576a18f912 service cinder] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:03:26.604380 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed97ae22-19e7-4376-ab8f-6b5cc19484f8 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:03:26.610445 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1c3958-8d84-4776-884e-7dd06766911a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4c467943b8f4d31a2f067ca6ed3b25c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f148d39ced534860abfbe8fc3f98ace4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:03:26.611472 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1c3958-8d84-4776-884e-7dd06766911a service swift] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:03:26.611947 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1c3958-8d84-4776-884e-7dd06766911a service swift] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:03:26.612429 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1c3958-8d84-4776-884e-7dd06766911a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:03:26.612783 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1342/2652] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Oct 9 01:03:26 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 269 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 09 01:03:26.614437 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458423c7-7efc-43a0-bd7d-8f083eea5845 None None] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:03:26.614719 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458423c7-7efc-43a0-bd7d-8f083eea5845 None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:03:26.614995 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458423c7-7efc-43a0-bd7d-8f083eea5845 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:03:26.648731 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.auth.core [None req-458423c7-7efc-43a0-bd7d-8f083eea5845 None None] MFA Rules not processed for user `29b989d34f3e418eb40deb4e1a320d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 01:03:26.650238 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-458423c7-7efc-43a0-bd7d-8f083eea5845 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:03:26.689221 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 01:03:26.712762 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1c3958-8d84-4776-884e-7dd06766911a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:03:26.714475 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1c3958-8d84-4776-884e-7dd06766911a service swift] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:03:26.724909 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1311/2653] 10.222.0.15 () {60 vars in 1384 bytes} [Sun Oct 9 01:03:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 09 01:03:26.725933 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1c3958-8d84-4776-884e-7dd06766911a service swift] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:03:26.728069 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-5b1c3958-8d84-4776-884e-7dd06766911a service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:03:26.765779 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1343/2654] 10.222.0.15 () {58 vars in 958 bytes} [Sun Oct 9 01:03:26 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 01:03:26.773143 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458423c7-7efc-43a0-bd7d-8f083eea5845 None None] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:03:26.880362 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1c3958-8d84-4776-884e-7dd06766911a service swift] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:03:26.890834 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244e7946-f822-49bb-9181-7a2362eb72fb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ac83d57fba841e0a666710732249c49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f148d39ced534860abfbe8fc3f98ace4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:03:26.891872 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244e7946-f822-49bb-9181-7a2362eb72fb service nova] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:03:26.892341 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244e7946-f822-49bb-9181-7a2362eb72fb service nova] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:03:26.892808 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244e7946-f822-49bb-9181-7a2362eb72fb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:03:26.900144 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-244e7946-f822-49bb-9181-7a2362eb72fb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:03:26.900362 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458423c7-7efc-43a0-bd7d-8f083eea5845 None None] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:03:26.912627 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78643096-1541-4ee1-8a6d-9c4c92474a3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:03:26.914654 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78643096-1541-4ee1-8a6d-9c4c92474a3a admin admin] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:03:26.915226 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78643096-1541-4ee1-8a6d-9c4c92474a3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:03:26.915858 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78643096-1541-4ee1-8a6d-9c4c92474a3a admin admin] PATH_INFO: `/v3/projects` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:03:26.917291 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78643096-1541-4ee1-8a6d-9c4c92474a3a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:03:26.918627 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244e7946-f822-49bb-9181-7a2362eb72fb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:03:26.922073 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244e7946-f822-49bb-9181-7a2362eb72fb service nova] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:03:26.924416 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78643096-1541-4ee1-8a6d-9c4c92474a3a admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:03:26.942721 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1312/2655] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Oct 9 01:03:26 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 09 01:03:26.982933 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1344/2656] 10.222.0.15 () {60 vars in 1153 bytes} [Sun Oct 9 01:03:26 2022] POST /identity/v3/projects => generated 373 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 09 01:03:26.989569 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244e7946-f822-49bb-9181-7a2362eb72fb service nova] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:03:27.012347 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244e7946-f822-49bb-9181-7a2362eb72fb service nova] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:03:27.030688 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 01:03:27.154614 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702aeb3d-1e16-4fec-b872-92b4aaeef9a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:03:27.155723 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702aeb3d-1e16-4fec-b872-92b4aaeef9a0 admin admin] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:03:27.156319 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702aeb3d-1e16-4fec-b872-92b4aaeef9a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:03:27.156869 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702aeb3d-1e16-4fec-b872-92b4aaeef9a0 admin admin] PATH_INFO: `/v3/users` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:03:27.158093 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702aeb3d-1e16-4fec-b872-92b4aaeef9a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:03:27.162018 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702aeb3d-1e16-4fec-b872-92b4aaeef9a0 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:03:27.207365 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1313/2657] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Oct 9 01:03:26 2022] POST /identity/v3/users => generated 293 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 09 01:03:27.211875 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78643096-1541-4ee1-8a6d-9c4c92474a3a admin admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:03:27.238269 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78643096-1541-4ee1-8a6d-9c4c92474a3a admin admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:03:27.246946 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b46c9e-2909-4631-81c9-d66b21287981 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:03:27.247983 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b46c9e-2909-4631-81c9-d66b21287981 admin admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:03:27.248586 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b46c9e-2909-4631-81c9-d66b21287981 admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:03:27.249013 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b46c9e-2909-4631-81c9-d66b21287981 admin admin] PATH_INFO: `/v3/roles` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:03:27.250107 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b46c9e-2909-4631-81c9-d66b21287981 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:03:27.252982 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b46c9e-2909-4631-81c9-d66b21287981 admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:03:27.302632 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702aeb3d-1e16-4fec-b872-92b4aaeef9a0 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:03:27.306331 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1345/2658] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Oct 9 01:03:27 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 09 01:03:27.318339 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702aeb3d-1e16-4fec-b872-92b4aaeef9a0 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:03:27.328245 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87375579-48f1-4a49-b978-db8dd9b59524 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:03:27.329500 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87375579-48f1-4a49-b978-db8dd9b59524 admin admin] REQUEST_METHOD: `PUT` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:03:27.330071 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87375579-48f1-4a49-b978-db8dd9b59524 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:03:27.330847 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87375579-48f1-4a49-b978-db8dd9b59524 admin admin] PATH_INFO: `/v3/projects/b64de2524d5c481ba9619d31bdc38fd7/users/8caa5dbbbb9146d39bffdf44cf88fc12/roles/f69dddf26daf4dd79d4c962beb877af5` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:03:27.375739 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87375579-48f1-4a49-b978-db8dd9b59524 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b64de2524d5c481ba9619d31bdc38fd7, user_id=8caa5dbbbb9146d39bffdf44cf88fc12, role_id=f69dddf26daf4dd79d4c962beb877af5)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:03:27.381880 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87375579-48f1-4a49-b978-db8dd9b59524 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:03:27.416393 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1314/2659] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Oct 9 01:03:27 2022] PUT /identity/v3/projects/b64de2524d5c481ba9619d31bdc38fd7/users/8caa5dbbbb9146d39bffdf44cf88fc12/roles/f69dddf26daf4dd79d4c962beb877af5 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 09 01:03:27.421362 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b46c9e-2909-4631-81c9-d66b21287981 admin admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:03:27.434246 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b46c9e-2909-4631-81c9-d66b21287981 admin admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:03:27.570588 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c145c31a-b8c7-4c22-9904-a6aa86e801e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:03:27.571411 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c145c31a-b8c7-4c22-9904-a6aa86e801e8 admin admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:03:27.571925 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c145c31a-b8c7-4c22-9904-a6aa86e801e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:03:27.572525 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c145c31a-b8c7-4c22-9904-a6aa86e801e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:03:27.573770 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c145c31a-b8c7-4c22-9904-a6aa86e801e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:03:27.575780 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c145c31a-b8c7-4c22-9904-a6aa86e801e8 admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:03:27.591493 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1346/2660] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Oct 9 01:03:27 2022] GET /identity/v3/roles => generated 1420 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 09 01:03:27.598684 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87375579-48f1-4a49-b978-db8dd9b59524 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:03:27.618663 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c145c31a-b8c7-4c22-9904-a6aa86e801e8 admin admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:03:27.628367 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87375579-48f1-4a49-b978-db8dd9b59524 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:03:27.638397 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a07129a-df22-4613-91eb-ab3be95cc75c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:03:27.639671 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a07129a-df22-4613-91eb-ab3be95cc75c admin admin] REQUEST_METHOD: `PUT` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:03:27.640354 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a07129a-df22-4613-91eb-ab3be95cc75c admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:03:27.641070 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a07129a-df22-4613-91eb-ab3be95cc75c admin admin] PATH_INFO: `/v3/projects/b64de2524d5c481ba9619d31bdc38fd7/users/8caa5dbbbb9146d39bffdf44cf88fc12/roles/f69dddf26daf4dd79d4c962beb877af5` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:03:27.644909 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a07129a-df22-4613-91eb-ab3be95cc75c admin admin] RBAC: Authorizing `identity:create_grant(project_id=b64de2524d5c481ba9619d31bdc38fd7, user_id=8caa5dbbbb9146d39bffdf44cf88fc12, role_id=f69dddf26daf4dd79d4c962beb877af5)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:03:27.650808 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a07129a-df22-4613-91eb-ab3be95cc75c admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:03:27.674600 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1315/2661] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Oct 9 01:03:27 2022] PUT /identity/v3/projects/b64de2524d5c481ba9619d31bdc38fd7/users/8caa5dbbbb9146d39bffdf44cf88fc12/roles/f69dddf26daf4dd79d4c962beb877af5 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 01:03:27.686488 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d104a87-cc40-4530-84d9-3356d17f8a19 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:03:27.687299 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d104a87-cc40-4530-84d9-3356d17f8a19 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:03:27.687916 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d104a87-cc40-4530-84d9-3356d17f8a19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:03:27.697819 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 01:03:27.723613 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c145c31a-b8c7-4c22-9904-a6aa86e801e8 admin admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:03:27.724380 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-3d104a87-cc40-4530-84d9-3356d17f8a19 None None] MFA Rules not processed for user `3a6cfef106c84f759ce0874be77f7380`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 01:03:27.726517 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-3d104a87-cc40-4530-84d9-3356d17f8a19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:03:27.795375 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064bc988-3b48-40d1-a826-a3092a64f455 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff7cb78bcd91467abe5c2e2b48aedd1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f148d39ced534860abfbe8fc3f98ace4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:03:27.796368 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064bc988-3b48-40d1-a826-a3092a64f455 service cinder] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:03:27.796898 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064bc988-3b48-40d1-a826-a3092a64f455 service cinder] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:03:27.797283 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064bc988-3b48-40d1-a826-a3092a64f455 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:03:27.801068 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-064bc988-3b48-40d1-a826-a3092a64f455 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:03:27.841516 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1316/2662] 10.222.0.15 () {58 vars in 967 bytes} [Sun Oct 9 01:03:27 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 01:03:27.843164 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e2f140-0efa-4b87-bcbb-ed46f3d9ea15 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:03:27.843684 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e2f140-0efa-4b87-bcbb-ed46f3d9ea15 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:03:27.844196 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e2f140-0efa-4b87-bcbb-ed46f3d9ea15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:03:27.918656 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064bc988-3b48-40d1-a826-a3092a64f455 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:03:27.924766 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064bc988-3b48-40d1-a826-a3092a64f455 service cinder] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:03:27.925426 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-91e2f140-0efa-4b87-bcbb-ed46f3d9ea15 None None] MFA Rules not processed for user `8caa5dbbbb9146d39bffdf44cf88fc12`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 01:03:27.927623 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-91e2f140-0efa-4b87-bcbb-ed46f3d9ea15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:03:27.943304 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1347/2663] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Oct 9 01:03:27 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 09 01:03:27.945558 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064bc988-3b48-40d1-a826-a3092a64f455 service cinder] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:03:28.071119 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064bc988-3b48-40d1-a826-a3092a64f455 service cinder] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:03:28.080437 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d82e20d-309c-456c-8acb-9a2a68dab346 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4c467943b8f4d31a2f067ca6ed3b25c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f148d39ced534860abfbe8fc3f98ace4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:03:28.081451 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d82e20d-309c-456c-8acb-9a2a68dab346 service swift] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:03:28.081956 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d82e20d-309c-456c-8acb-9a2a68dab346 service swift] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:03:28.082352 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d82e20d-309c-456c-8acb-9a2a68dab346 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:03:28.088679 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 01:03:28.103410 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d82e20d-309c-456c-8acb-9a2a68dab346 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:03:28.106771 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d82e20d-309c-456c-8acb-9a2a68dab346 service swift] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:03:28.117910 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1348/2664] 10.222.0.15 () {60 vars in 1384 bytes} [Sun Oct 9 01:03:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 09 01:03:28.122998 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1317/2665] 10.222.0.15 () {58 vars in 958 bytes} [Sun Oct 9 01:03:27 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 01:03:28.142522 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d82e20d-309c-456c-8acb-9a2a68dab346 service swift] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:03:28.144291 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-8d82e20d-309c-456c-8acb-9a2a68dab346 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:03:28.162118 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d82e20d-309c-456c-8acb-9a2a68dab346 service swift] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:03:28.169357 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd08b42f-5e40-4b5b-b1c2-c50ef81ed5b2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff7cb78bcd91467abe5c2e2b48aedd1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f148d39ced534860abfbe8fc3f98ace4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:03:28.170133 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd08b42f-5e40-4b5b-b1c2-c50ef81ed5b2 service cinder] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:03:28.170488 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd08b42f-5e40-4b5b-b1c2-c50ef81ed5b2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:03:28.170766 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd08b42f-5e40-4b5b-b1c2-c50ef81ed5b2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:03:28.184687 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd08b42f-5e40-4b5b-b1c2-c50ef81ed5b2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:03:28.186831 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd08b42f-5e40-4b5b-b1c2-c50ef81ed5b2 service cinder] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:03:28.213412 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1349/2666] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Oct 9 01:03:28 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 09 01:03:28.690144 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7123513f-f376-463f-ae1f-1988529b19dc None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:03:28.690994 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7123513f-f376-463f-ae1f-1988529b19dc None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:03:28.692060 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7123513f-f376-463f-ae1f-1988529b19dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:03:28.729122 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-7123513f-f376-463f-ae1f-1988529b19dc None None] MFA Rules not processed for user `3a6cfef106c84f759ce0874be77f7380`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 01:03:28.731327 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-7123513f-f376-463f-ae1f-1988529b19dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:03:28.746143 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1318/2667] 10.222.0.15 () {58 vars in 1009 bytes} [Sun Oct 9 01:03:28 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 09 01:03:28.767142 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd08b42f-5e40-4b5b-b1c2-c50ef81ed5b2 service cinder] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:03:28.789681 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd08b42f-5e40-4b5b-b1c2-c50ef81ed5b2 service cinder] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:03:28.796053 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3198c57-999d-4015-8726-4942afa41aa1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4c467943b8f4d31a2f067ca6ed3b25c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f148d39ced534860abfbe8fc3f98ace4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:03:28.797337 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3198c57-999d-4015-8726-4942afa41aa1 service swift] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:03:28.797953 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3198c57-999d-4015-8726-4942afa41aa1 service swift] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:03:28.798374 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3198c57-999d-4015-8726-4942afa41aa1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:03:28.810314 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3198c57-999d-4015-8726-4942afa41aa1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:03:28.812701 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3198c57-999d-4015-8726-4942afa41aa1 service swift] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:03:28.824067 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1350/2668] 10.222.0.15 () {60 vars in 1384 bytes} [Sun Oct 9 01:03:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 09 01:03:28.935554 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7123513f-f376-463f-ae1f-1988529b19dc None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:03:29.097026 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7123513f-f376-463f-ae1f-1988529b19dc None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:03:29.105646 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873ff7cd-6cbb-4b08-94b2-9105a07b7ff4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:03:29.106604 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873ff7cd-6cbb-4b08-94b2-9105a07b7ff4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:03:29.106984 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873ff7cd-6cbb-4b08-94b2-9105a07b7ff4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:03:29.107521 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873ff7cd-6cbb-4b08-94b2-9105a07b7ff4 admin admin] PATH_INFO: `/v3/users/29b989d34f3e418eb40deb4e1a320d0d` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:03:29.109061 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873ff7cd-6cbb-4b08-94b2-9105a07b7ff4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=29b989d34f3e418eb40deb4e1a320d0d)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:03:29.111839 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873ff7cd-6cbb-4b08-94b2-9105a07b7ff4 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:03:29.179299 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-873ff7cd-6cbb-4b08-94b2-9105a07b7ff4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '29b989d34f3e418eb40deb4e1a320d0d'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:03:29.189982 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-873ff7cd-6cbb-4b08-94b2-9105a07b7ff4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '29b989d34f3e418eb40deb4e1a320d0d'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:03:29.191269 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-873ff7cd-6cbb-4b08-94b2-9105a07b7ff4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '29b989d34f3e418eb40deb4e1a320d0d'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:03:29.192680 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-873ff7cd-6cbb-4b08-94b2-9105a07b7ff4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '29b989d34f3e418eb40deb4e1a320d0d'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:03:29.208823 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-873ff7cd-6cbb-4b08-94b2-9105a07b7ff4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '29b989d34f3e418eb40deb4e1a320d0d'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:03:29.242179 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1319/2669] 10.222.0.15 () {58 vars in 1224 bytes} [Sun Oct 9 01:03:28 2022] DELETE /identity/v3/users/29b989d34f3e418eb40deb4e1a320d0d => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 01:03:29.242936 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a5c92a-968e-4d9e-ac84-38ae9c6fd8e5 None None] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:03:29.243768 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a5c92a-968e-4d9e-ac84-38ae9c6fd8e5 None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:03:29.243947 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a5c92a-968e-4d9e-ac84-38ae9c6fd8e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:03:29.272456 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.auth.core [None req-47a5c92a-968e-4d9e-ac84-38ae9c6fd8e5 None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 01:03:29.274865 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-47a5c92a-968e-4d9e-ac84-38ae9c6fd8e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:03:29.285491 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 01:03:29.368173 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1351/2670] 10.222.0.15 () {58 vars in 958 bytes} [Sun Oct 9 01:03:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 01:03:29.383357 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873ff7cd-6cbb-4b08-94b2-9105a07b7ff4 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:03:29.385078 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02805c8e-f9c9-4928-a4a9-894276e11e91 None None] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:03:29.385527 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02805c8e-f9c9-4928-a4a9-894276e11e91 None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:03:29.385703 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-873ff7cd-6cbb-4b08-94b2-9105a07b7ff4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:03:29.386143 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02805c8e-f9c9-4928-a4a9-894276e11e91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:03:29.419746 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.auth.core [None req-02805c8e-f9c9-4928-a4a9-894276e11e91 None None] MFA Rules not processed for user `3a6cfef106c84f759ce0874be77f7380`. Rule list: `[]` (Enabled: `True`). {{(pid=81525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 01:03:29.422323 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-02805c8e-f9c9-4928-a4a9-894276e11e91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:03:29.483226 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873ff7cd-6cbb-4b08-94b2-9105a07b7ff4 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:03:29.488807 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490e9d92-3a06-478a-84c4-7a83d9fb53cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4ef90d456d2483e8ddafbe2d4d4fb5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f148d39ced534860abfbe8fc3f98ace4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:03:29.489647 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490e9d92-3a06-478a-84c4-7a83d9fb53cb service neutron] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:03:29.490056 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490e9d92-3a06-478a-84c4-7a83d9fb53cb service neutron] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:03:29.490615 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490e9d92-3a06-478a-84c4-7a83d9fb53cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:03:29.503624 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490e9d92-3a06-478a-84c4-7a83d9fb53cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:03:29.506311 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490e9d92-3a06-478a-84c4-7a83d9fb53cb service neutron] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:03:29.521772 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1320/2671] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Oct 9 01:03:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 09 01:03:29.558856 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1352/2672] 10.222.0.15 () {58 vars in 967 bytes} [Sun Oct 9 01:03:29 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 09 01:03:29.582017 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490e9d92-3a06-478a-84c4-7a83d9fb53cb service neutron] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:03:29.584844 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-490e9d92-3a06-478a-84c4-7a83d9fb53cb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:03:29.612636 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 01:03:29.806413 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490e9d92-3a06-478a-84c4-7a83d9fb53cb service neutron] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:03:29.829187 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15723107-9fa1-4c33-bc63-ff8dc60d322f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4c467943b8f4d31a2f067ca6ed3b25c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f148d39ced534860abfbe8fc3f98ace4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:03:29.831125 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15723107-9fa1-4c33-bc63-ff8dc60d322f service swift] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:03:29.831889 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15723107-9fa1-4c33-bc63-ff8dc60d322f service swift] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:03:29.832558 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15723107-9fa1-4c33-bc63-ff8dc60d322f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:03:29.852609 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15723107-9fa1-4c33-bc63-ff8dc60d322f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:03:29.856105 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15723107-9fa1-4c33-bc63-ff8dc60d322f service swift] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:03:29.876301 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1321/2673] 10.222.0.15 () {60 vars in 1384 bytes} [Sun Oct 9 01:03:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 09 01:03:30.016702 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02805c8e-f9c9-4928-a4a9-894276e11e91 None None] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:03:30.018955 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-02805c8e-f9c9-4928-a4a9-894276e11e91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:03:30.052298 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02805c8e-f9c9-4928-a4a9-894276e11e91 None None] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:03:30.062621 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f5815b-9e7d-4b6d-add2-d5f1c589a10e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:03:30.064330 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f5815b-9e7d-4b6d-add2-d5f1c589a10e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:03:30.064858 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f5815b-9e7d-4b6d-add2-d5f1c589a10e admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:03:30.065265 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f5815b-9e7d-4b6d-add2-d5f1c589a10e admin admin] PATH_INFO: `/v3/projects/973a525157be4969a7f03b656d765c01` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:03:30.068029 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f5815b-9e7d-4b6d-add2-d5f1c589a10e admin admin] RBAC: Authorizing `identity:delete_project(project_id=973a525157be4969a7f03b656d765c01)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:03:30.072317 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f5815b-9e7d-4b6d-add2-d5f1c589a10e admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:03:30.196768 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-c0f5815b-9e7d-4b6d-add2-d5f1c589a10e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '973a525157be4969a7f03b656d765c01', 'request_id': 'req-c0f5815b-9e7d-4b6d-add2-d5f1c589a10e'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:03:30.234403 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-c0f5815b-9e7d-4b6d-add2-d5f1c589a10e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '973a525157be4969a7f03b656d765c01', 'request_id': 'req-c0f5815b-9e7d-4b6d-add2-d5f1c589a10e'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:03:30.265925 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-c0f5815b-9e7d-4b6d-add2-d5f1c589a10e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '973a525157be4969a7f03b656d765c01', 'request_id': 'req-c0f5815b-9e7d-4b6d-add2-d5f1c589a10e'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:03:30.305297 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-c0f5815b-9e7d-4b6d-add2-d5f1c589a10e admin admin] The token cache is being invalidate because project 973a525157be4969a7f03b656d765c01 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81525) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 09 01:03:30.306874 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-c0f5815b-9e7d-4b6d-add2-d5f1c589a10e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:03:30.307983 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-c0f5815b-9e7d-4b6d-add2-d5f1c589a10e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:03:30.317354 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1353/2674] 10.222.0.15 () {58 vars in 1233 bytes} [Sun Oct 9 01:03:30 2022] DELETE /identity/v3/projects/973a525157be4969a7f03b656d765c01 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 01:03:30.319094 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15723107-9fa1-4c33-bc63-ff8dc60d322f service swift] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:03:30.345604 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15723107-9fa1-4c33-bc63-ff8dc60d322f service swift] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:03:30.504155 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f094e06b-7ebf-4f3d-b178-cf89c01c222e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:03:30.505763 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f094e06b-7ebf-4f3d-b178-cf89c01c222e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:03:30.506095 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f094e06b-7ebf-4f3d-b178-cf89c01c222e admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:03:30.506747 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f094e06b-7ebf-4f3d-b178-cf89c01c222e admin admin] PATH_INFO: `/v3/users/8caa5dbbbb9146d39bffdf44cf88fc12` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:03:30.508372 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f094e06b-7ebf-4f3d-b178-cf89c01c222e admin admin] RBAC: Authorizing `identity:delete_user(user_id=8caa5dbbbb9146d39bffdf44cf88fc12)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:03:30.510399 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f094e06b-7ebf-4f3d-b178-cf89c01c222e admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:03:30.581405 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-f094e06b-7ebf-4f3d-b178-cf89c01c222e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8caa5dbbbb9146d39bffdf44cf88fc12'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:03:30.590933 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-f094e06b-7ebf-4f3d-b178-cf89c01c222e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8caa5dbbbb9146d39bffdf44cf88fc12'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:03:30.591729 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-f094e06b-7ebf-4f3d-b178-cf89c01c222e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8caa5dbbbb9146d39bffdf44cf88fc12'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:03:30.592526 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-f094e06b-7ebf-4f3d-b178-cf89c01c222e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8caa5dbbbb9146d39bffdf44cf88fc12'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:03:30.605060 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-f094e06b-7ebf-4f3d-b178-cf89c01c222e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8caa5dbbbb9146d39bffdf44cf88fc12'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:03:30.640044 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1322/2675] 10.222.0.15 () {58 vars in 1224 bytes} [Sun Oct 9 01:03:30 2022] DELETE /identity/v3/users/8caa5dbbbb9146d39bffdf44cf88fc12 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 01:03:31.120613 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f5815b-9e7d-4b6d-add2-d5f1c589a10e admin admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:03:31.122172 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-c0f5815b-9e7d-4b6d-add2-d5f1c589a10e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:03:31.147707 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f5815b-9e7d-4b6d-add2-d5f1c589a10e admin admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:03:31.243239 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 01:03:31.294627 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20514680-2a36-49f5-8a75-b307c735253f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:03:31.295645 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20514680-2a36-49f5-8a75-b307c735253f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:03:31.295831 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20514680-2a36-49f5-8a75-b307c735253f admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:03:31.296035 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20514680-2a36-49f5-8a75-b307c735253f admin admin] PATH_INFO: `/v3/projects/b64de2524d5c481ba9619d31bdc38fd7` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:03:31.297676 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20514680-2a36-49f5-8a75-b307c735253f admin admin] RBAC: Authorizing `identity:delete_project(project_id=b64de2524d5c481ba9619d31bdc38fd7)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:03:31.300097 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20514680-2a36-49f5-8a75-b307c735253f admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:03:31.372007 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-20514680-2a36-49f5-8a75-b307c735253f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b64de2524d5c481ba9619d31bdc38fd7', 'request_id': 'req-20514680-2a36-49f5-8a75-b307c735253f'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:03:31.384683 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-20514680-2a36-49f5-8a75-b307c735253f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b64de2524d5c481ba9619d31bdc38fd7', 'request_id': 'req-20514680-2a36-49f5-8a75-b307c735253f'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:03:31.395092 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-20514680-2a36-49f5-8a75-b307c735253f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b64de2524d5c481ba9619d31bdc38fd7', 'request_id': 'req-20514680-2a36-49f5-8a75-b307c735253f'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:03:31.412850 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-20514680-2a36-49f5-8a75-b307c735253f admin admin] The token cache is being invalidate because project b64de2524d5c481ba9619d31bdc38fd7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81525) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 09 01:03:31.413558 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-20514680-2a36-49f5-8a75-b307c735253f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:03:31.414962 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-20514680-2a36-49f5-8a75-b307c735253f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:03:31.418583 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1354/2676] 10.222.0.15 () {58 vars in 1233 bytes} [Sun Oct 9 01:03:31 2022] DELETE /identity/v3/projects/b64de2524d5c481ba9619d31bdc38fd7 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 09 01:03:31.425385 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f758f779-1fd8-4802-88af-cc5b167adc06 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:03:31.426829 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f758f779-1fd8-4802-88af-cc5b167adc06 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:03:31.427567 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f758f779-1fd8-4802-88af-cc5b167adc06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:03:31.475053 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-f758f779-1fd8-4802-88af-cc5b167adc06 None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 01:03:31.475053 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-f758f779-1fd8-4802-88af-cc5b167adc06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:03:31.502620 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 01:03:31.658245 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1323/2677] 10.222.0.15 () {58 vars in 958 bytes} [Sun Oct 9 01:03:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 01:03:31.659701 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b368100-ff7c-45d1-8c40-4a29d6eeb422 None None] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:03:31.660176 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b368100-ff7c-45d1-8c40-4a29d6eeb422 None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:03:31.660697 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b368100-ff7c-45d1-8c40-4a29d6eeb422 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:03:31.701822 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.auth.core [None req-4b368100-ff7c-45d1-8c40-4a29d6eeb422 None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 01:03:31.704066 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-4b368100-ff7c-45d1-8c40-4a29d6eeb422 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:03:31.730148 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1355/2678] 10.222.0.15 () {58 vars in 958 bytes} [Sun Oct 9 01:03:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 09 01:03:31.735189 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f758f779-1fd8-4802-88af-cc5b167adc06 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:03:31.773836 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f758f779-1fd8-4802-88af-cc5b167adc06 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:03:31.782409 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc3acbd-2467-4cf1-ba66-f0af3949ef16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:03:31.783677 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc3acbd-2467-4cf1-ba66-f0af3949ef16 admin admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:03:31.784332 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc3acbd-2467-4cf1-ba66-f0af3949ef16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:03:31.784930 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc3acbd-2467-4cf1-ba66-f0af3949ef16 admin admin] PATH_INFO: `/v3/domains` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:03:31.786226 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc3acbd-2467-4cf1-ba66-f0af3949ef16 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 01:03:31.786873 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc3acbd-2467-4cf1-ba66-f0af3949ef16 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:03:31.790558 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc3acbd-2467-4cf1-ba66-f0af3949ef16 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:03:31.815689 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1324/2679] 10.222.0.15 () {58 vars in 1153 bytes} [Sun Oct 9 01:03:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 01:03:31.820263 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b368100-ff7c-45d1-8c40-4a29d6eeb422 None None] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:03:31.843310 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b368100-ff7c-45d1-8c40-4a29d6eeb422 None None] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:03:31.858943 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180b7161-a690-4d02-953c-841f354ebff5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:03:31.860153 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180b7161-a690-4d02-953c-841f354ebff5 admin admin] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:03:31.861062 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180b7161-a690-4d02-953c-841f354ebff5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:03:31.861547 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180b7161-a690-4d02-953c-841f354ebff5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:03:31.863564 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180b7161-a690-4d02-953c-841f354ebff5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:03:31.867491 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180b7161-a690-4d02-953c-841f354ebff5 admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:03:31.971718 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1356/2680] 10.222.0.15 () {60 vars in 1153 bytes} [Sun Oct 9 01:03:31 2022] POST /identity/v3/projects => generated 387 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 09 01:03:31.973586 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc3acbd-2467-4cf1-ba66-f0af3949ef16 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:03:32.006472 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc3acbd-2467-4cf1-ba66-f0af3949ef16 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:03:32.117283 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24c4a63-bd65-4cc1-838a-fe2fb5ee69e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:03:32.118112 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24c4a63-bd65-4cc1-838a-fe2fb5ee69e2 admin admin] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:03:32.118465 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24c4a63-bd65-4cc1-838a-fe2fb5ee69e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:03:32.118842 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24c4a63-bd65-4cc1-838a-fe2fb5ee69e2 admin admin] PATH_INFO: `/v3/users` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:03:32.120019 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24c4a63-bd65-4cc1-838a-fe2fb5ee69e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:03:32.126489 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24c4a63-bd65-4cc1-838a-fe2fb5ee69e2 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:03:32.180456 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1325/2681] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Oct 9 01:03:31 2022] POST /identity/v3/users => generated 294 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 09 01:03:32.186467 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180b7161-a690-4d02-953c-841f354ebff5 admin admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:03:32.207094 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180b7161-a690-4d02-953c-841f354ebff5 admin admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:03:32.215605 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfd5139-d7b5-48d2-ab15-5a65be5c8d43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:03:32.216658 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfd5139-d7b5-48d2-ab15-5a65be5c8d43 admin admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:03:32.217141 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfd5139-d7b5-48d2-ab15-5a65be5c8d43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:03:32.217619 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfd5139-d7b5-48d2-ab15-5a65be5c8d43 admin admin] PATH_INFO: `/v3/roles` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:03:32.219090 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfd5139-d7b5-48d2-ab15-5a65be5c8d43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:03:32.222778 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfd5139-d7b5-48d2-ab15-5a65be5c8d43 admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:03:32.246537 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1357/2682] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Oct 9 01:03:32 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 09 01:03:32.253324 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24c4a63-bd65-4cc1-838a-fe2fb5ee69e2 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:03:32.277039 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24c4a63-bd65-4cc1-838a-fe2fb5ee69e2 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:03:32.286503 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70beac1f-39b5-4e25-8f33-a44839d333d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:03:32.297189 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70beac1f-39b5-4e25-8f33-a44839d333d8 admin admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:03:32.297189 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70beac1f-39b5-4e25-8f33-a44839d333d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:03:32.297189 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70beac1f-39b5-4e25-8f33-a44839d333d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:03:32.297189 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70beac1f-39b5-4e25-8f33-a44839d333d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:03:32.297189 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70beac1f-39b5-4e25-8f33-a44839d333d8 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:03:32.315851 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1326/2683] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Oct 9 01:03:32 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 09 01:03:32.322542 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfd5139-d7b5-48d2-ab15-5a65be5c8d43 admin admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:03:32.336494 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfd5139-d7b5-48d2-ab15-5a65be5c8d43 admin admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:03:32.342513 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3249b59-d46f-4b43-9caa-58cac2a10e93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:03:32.343402 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3249b59-d46f-4b43-9caa-58cac2a10e93 admin admin] REQUEST_METHOD: `PUT` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:03:32.343765 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3249b59-d46f-4b43-9caa-58cac2a10e93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:03:32.344123 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3249b59-d46f-4b43-9caa-58cac2a10e93 admin admin] PATH_INFO: `/v3/projects/d7048112c2634e9087531c96062ba326/users/cfdfd0e5374f45bd9ad0e48839b24877/roles/afb0a01183d9497795eaa4fa1a4046ae` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:03:32.374991 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3249b59-d46f-4b43-9caa-58cac2a10e93 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d7048112c2634e9087531c96062ba326, user_id=cfdfd0e5374f45bd9ad0e48839b24877, role_id=afb0a01183d9497795eaa4fa1a4046ae)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:03:32.379531 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3249b59-d46f-4b43-9caa-58cac2a10e93 admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:03:32.402868 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1358/2684] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Oct 9 01:03:32 2022] PUT /identity/v3/projects/d7048112c2634e9087531c96062ba326/users/cfdfd0e5374f45bd9ad0e48839b24877/roles/afb0a01183d9497795eaa4fa1a4046ae => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 01:03:32.420128 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5078e1c-9ee9-4a24-a358-5f27e156a0af None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:03:32.420570 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5078e1c-9ee9-4a24-a358-5f27e156a0af None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:03:32.420984 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5078e1c-9ee9-4a24-a358-5f27e156a0af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:03:32.473068 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-a5078e1c-9ee9-4a24-a358-5f27e156a0af None None] MFA Rules not processed for user `cfdfd0e5374f45bd9ad0e48839b24877`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 01:03:32.474447 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-a5078e1c-9ee9-4a24-a358-5f27e156a0af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:03:32.588612 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1327/2685] 10.222.0.15 () {58 vars in 958 bytes} [Sun Oct 9 01:03:32 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 01:03:32.590979 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3249b59-d46f-4b43-9caa-58cac2a10e93 admin admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:03:32.686047 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3249b59-d46f-4b43-9caa-58cac2a10e93 admin admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:03:32.694476 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678ac637-7f60-4edd-b53a-ae6b3463d087 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:03:32.695763 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678ac637-7f60-4edd-b53a-ae6b3463d087 admin admin] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:03:32.696255 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678ac637-7f60-4edd-b53a-ae6b3463d087 admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:03:32.696732 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678ac637-7f60-4edd-b53a-ae6b3463d087 admin admin] PATH_INFO: `/v3/projects` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:03:32.697926 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678ac637-7f60-4edd-b53a-ae6b3463d087 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:03:32.701833 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678ac637-7f60-4edd-b53a-ae6b3463d087 admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:03:32.723909 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 01:03:32.753221 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1359/2686] 10.222.0.15 () {60 vars in 1153 bytes} [Sun Oct 9 01:03:32 2022] POST /identity/v3/projects => generated 385 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 09 01:03:32.759191 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5078e1c-9ee9-4a24-a358-5f27e156a0af None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:03:32.777788 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5078e1c-9ee9-4a24-a358-5f27e156a0af None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:03:32.794862 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 01:03:32.857092 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70ab8af-679f-43e5-8555-3eac933c009b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:03:32.858089 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70ab8af-679f-43e5-8555-3eac933c009b admin admin] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:03:32.858569 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70ab8af-679f-43e5-8555-3eac933c009b admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:03:32.859016 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70ab8af-679f-43e5-8555-3eac933c009b admin admin] PATH_INFO: `/v3/users` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:03:32.860213 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70ab8af-679f-43e5-8555-3eac933c009b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:03:32.864219 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70ab8af-679f-43e5-8555-3eac933c009b admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:03:32.892512 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1328/2687] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Oct 9 01:03:32 2022] POST /identity/v3/users => generated 299 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 09 01:03:32.896856 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678ac637-7f60-4edd-b53a-ae6b3463d087 admin admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:03:32.908944 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678ac637-7f60-4edd-b53a-ae6b3463d087 admin admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:03:32.914323 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb76a52-4d1f-4e94-a2fe-352d5459303b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:03:32.915013 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb76a52-4d1f-4e94-a2fe-352d5459303b admin admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:03:32.915373 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb76a52-4d1f-4e94-a2fe-352d5459303b admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:03:32.915692 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb76a52-4d1f-4e94-a2fe-352d5459303b admin admin] PATH_INFO: `/v3/roles` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:03:32.916398 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb76a52-4d1f-4e94-a2fe-352d5459303b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:03:32.918100 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb76a52-4d1f-4e94-a2fe-352d5459303b admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:03:32.931019 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1360/2688] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Oct 9 01:03:32 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 09 01:03:32.935945 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70ab8af-679f-43e5-8555-3eac933c009b admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:03:32.946753 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70ab8af-679f-43e5-8555-3eac933c009b admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:03:32.952351 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e13e89d-1fa9-4204-a4da-131283508793 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:03:32.953208 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e13e89d-1fa9-4204-a4da-131283508793 admin admin] REQUEST_METHOD: `PUT` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:03:32.953487 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e13e89d-1fa9-4204-a4da-131283508793 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:03:32.953753 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e13e89d-1fa9-4204-a4da-131283508793 admin admin] PATH_INFO: `/v3/projects/754a33e6d92941618c50011703b720d1/users/127847f1b91c4f4ea8f4f24534b6a0a6/roles/f69dddf26daf4dd79d4c962beb877af5` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:03:32.973691 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e13e89d-1fa9-4204-a4da-131283508793 admin admin] RBAC: Authorizing `identity:create_grant(project_id=754a33e6d92941618c50011703b720d1, user_id=127847f1b91c4f4ea8f4f24534b6a0a6, role_id=f69dddf26daf4dd79d4c962beb877af5)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:03:32.976898 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e13e89d-1fa9-4204-a4da-131283508793 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:03:32.994690 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1329/2689] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Oct 9 01:03:32 2022] PUT /identity/v3/projects/754a33e6d92941618c50011703b720d1/users/127847f1b91c4f4ea8f4f24534b6a0a6/roles/f69dddf26daf4dd79d4c962beb877af5 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 01:03:33.000782 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb76a52-4d1f-4e94-a2fe-352d5459303b admin admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:03:33.013766 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb76a52-4d1f-4e94-a2fe-352d5459303b admin admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:03:33.087551 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a2e19b-0493-43b7-adc6-8c7b45773f25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:03:33.088341 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a2e19b-0493-43b7-adc6-8c7b45773f25 admin admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:03:33.088681 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a2e19b-0493-43b7-adc6-8c7b45773f25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:03:33.089013 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a2e19b-0493-43b7-adc6-8c7b45773f25 admin admin] PATH_INFO: `/v3/roles` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:03:33.089675 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a2e19b-0493-43b7-adc6-8c7b45773f25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:03:33.091451 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a2e19b-0493-43b7-adc6-8c7b45773f25 admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:03:33.104552 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1361/2690] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Oct 9 01:03:32 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 09 01:03:33.111435 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e13e89d-1fa9-4204-a4da-131283508793 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:03:33.131367 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e13e89d-1fa9-4204-a4da-131283508793 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:03:33.140176 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd8c77c-7e2b-4405-a567-55bb08abdb77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:03:33.141346 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd8c77c-7e2b-4405-a567-55bb08abdb77 admin admin] REQUEST_METHOD: `PUT` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:03:33.141826 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd8c77c-7e2b-4405-a567-55bb08abdb77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:03:33.142316 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd8c77c-7e2b-4405-a567-55bb08abdb77 admin admin] PATH_INFO: `/v3/projects/754a33e6d92941618c50011703b720d1/users/127847f1b91c4f4ea8f4f24534b6a0a6/roles/f69dddf26daf4dd79d4c962beb877af5` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:03:33.146131 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd8c77c-7e2b-4405-a567-55bb08abdb77 admin admin] RBAC: Authorizing `identity:create_grant(project_id=754a33e6d92941618c50011703b720d1, user_id=127847f1b91c4f4ea8f4f24534b6a0a6, role_id=f69dddf26daf4dd79d4c962beb877af5)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:03:33.153152 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd8c77c-7e2b-4405-a567-55bb08abdb77 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:03:33.171549 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1330/2691] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Oct 9 01:03:33 2022] PUT /identity/v3/projects/754a33e6d92941618c50011703b720d1/users/127847f1b91c4f4ea8f4f24534b6a0a6/roles/f69dddf26daf4dd79d4c962beb877af5 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 09 01:03:33.184144 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6481f9-e5f6-407b-af93-dd703759ebc8 None None] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:03:33.184626 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6481f9-e5f6-407b-af93-dd703759ebc8 None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:03:33.184992 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6481f9-e5f6-407b-af93-dd703759ebc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:03:33.242280 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.auth.core [None req-5c6481f9-e5f6-407b-af93-dd703759ebc8 None None] MFA Rules not processed for user `127847f1b91c4f4ea8f4f24534b6a0a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 01:03:33.244495 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-5c6481f9-e5f6-407b-af93-dd703759ebc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:03:33.281338 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd8c77c-7e2b-4405-a567-55bb08abdb77 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:03:33.283248 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-9dd8c77c-7e2b-4405-a567-55bb08abdb77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:03:33.374532 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd8c77c-7e2b-4405-a567-55bb08abdb77 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:03:33.378906 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1362/2692] 10.222.0.15 () {58 vars in 958 bytes} [Sun Oct 9 01:03:33 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 01:03:33.380442 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6481f9-e5f6-407b-af93-dd703759ebc8 None None] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:03:33.381065 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeee86a0-68c0-42d2-a069-8377c598d53e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff7cb78bcd91467abe5c2e2b48aedd1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f148d39ced534860abfbe8fc3f98ace4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:03:33.381923 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeee86a0-68c0-42d2-a069-8377c598d53e service cinder] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:03:33.382396 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeee86a0-68c0-42d2-a069-8377c598d53e service cinder] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:03:33.382850 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeee86a0-68c0-42d2-a069-8377c598d53e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:03:33.383150 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-5c6481f9-e5f6-407b-af93-dd703759ebc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:03:33.386482 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-eeee86a0-68c0-42d2-a069-8377c598d53e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:03:33.479467 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6481f9-e5f6-407b-af93-dd703759ebc8 None None] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:03:33.485532 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeee86a0-68c0-42d2-a069-8377c598d53e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:03:33.486972 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b231edb7-74e2-49d5-a1e4-ed2507dc5997 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:03:33.487174 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeee86a0-68c0-42d2-a069-8377c598d53e service cinder] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:03:33.487924 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b231edb7-74e2-49d5-a1e4-ed2507dc5997 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:03:33.488875 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b231edb7-74e2-49d5-a1e4-ed2507dc5997 admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:03:33.489398 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b231edb7-74e2-49d5-a1e4-ed2507dc5997 admin admin] PATH_INFO: `/v3/users/112d86f581d54523b8b001d2b8fea404` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:03:33.491102 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b231edb7-74e2-49d5-a1e4-ed2507dc5997 admin admin] RBAC: Authorizing `identity:delete_user(user_id=112d86f581d54523b8b001d2b8fea404)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:03:33.494579 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b231edb7-74e2-49d5-a1e4-ed2507dc5997 admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:03:33.497758 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 01:03:33.499237 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1331/2693] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Oct 9 01:03:33 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 09 01:03:33.500614 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeee86a0-68c0-42d2-a069-8377c598d53e service cinder] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:03:33.502800 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-eeee86a0-68c0-42d2-a069-8377c598d53e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:03:33.520931 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeee86a0-68c0-42d2-a069-8377c598d53e service cinder] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:03:33.526444 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f3872d-df16-49db-a60a-b5b0966fba1f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff7cb78bcd91467abe5c2e2b48aedd1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f148d39ced534860abfbe8fc3f98ace4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:03:33.527113 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f3872d-df16-49db-a60a-b5b0966fba1f service cinder] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:03:33.527436 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f3872d-df16-49db-a60a-b5b0966fba1f service cinder] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:03:33.528282 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f3872d-df16-49db-a60a-b5b0966fba1f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:03:33.546606 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f3872d-df16-49db-a60a-b5b0966fba1f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:03:33.549335 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f3872d-df16-49db-a60a-b5b0966fba1f service cinder] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:03:33.571139 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1332/2694] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Oct 9 01:03:33 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 09 01:03:33.587421 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-b231edb7-74e2-49d5-a1e4-ed2507dc5997 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '112d86f581d54523b8b001d2b8fea404'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:03:33.606154 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-b231edb7-74e2-49d5-a1e4-ed2507dc5997 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '112d86f581d54523b8b001d2b8fea404'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:03:33.606324 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-b231edb7-74e2-49d5-a1e4-ed2507dc5997 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '112d86f581d54523b8b001d2b8fea404'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:03:33.608023 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-b231edb7-74e2-49d5-a1e4-ed2507dc5997 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '112d86f581d54523b8b001d2b8fea404'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:03:33.634267 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-b231edb7-74e2-49d5-a1e4-ed2507dc5997 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '112d86f581d54523b8b001d2b8fea404'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:03:33.669785 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1363/2695] 10.222.0.15 () {58 vars in 1224 bytes} [Sun Oct 9 01:03:33 2022] DELETE /identity/v3/users/112d86f581d54523b8b001d2b8fea404 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 01:03:33.674624 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ec861a-2f43-4187-b58e-bda71257133d None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:03:33.674982 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ec861a-2f43-4187-b58e-bda71257133d None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:03:33.675347 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ec861a-2f43-4187-b58e-bda71257133d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:03:33.690415 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 01:03:33.698354 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-11ec861a-2f43-4187-b58e-bda71257133d None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 01:03:33.700799 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-11ec861a-2f43-4187-b58e-bda71257133d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:03:33.815014 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1333/2696] 10.222.0.15 () {58 vars in 958 bytes} [Sun Oct 9 01:03:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 09 01:03:33.826983 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b231edb7-74e2-49d5-a1e4-ed2507dc5997 admin admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:03:33.829139 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-b231edb7-74e2-49d5-a1e4-ed2507dc5997 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:03:33.961193 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b231edb7-74e2-49d5-a1e4-ed2507dc5997 admin admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:03:33.967847 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aefd4bb-6150-4eb8-ac87-b82c890e3320 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4ef90d456d2483e8ddafbe2d4d4fb5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f148d39ced534860abfbe8fc3f98ace4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:03:33.968487 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aefd4bb-6150-4eb8-ac87-b82c890e3320 service neutron] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:03:33.968763 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aefd4bb-6150-4eb8-ac87-b82c890e3320 service neutron] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:03:33.969033 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aefd4bb-6150-4eb8-ac87-b82c890e3320 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:03:33.988565 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aefd4bb-6150-4eb8-ac87-b82c890e3320 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:03:33.990293 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aefd4bb-6150-4eb8-ac87-b82c890e3320 service neutron] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:03:34.017689 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1364/2697] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Oct 9 01:03:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 09 01:03:34.310262 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ec861a-2f43-4187-b58e-bda71257133d None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:03:34.314387 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-11ec861a-2f43-4187-b58e-bda71257133d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:03:34.359340 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ec861a-2f43-4187-b58e-bda71257133d None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:03:34.383912 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e84d0b3-3297-45c6-93f1-6d70515dafa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:03:34.385395 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e84d0b3-3297-45c6-93f1-6d70515dafa2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:03:34.387803 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e84d0b3-3297-45c6-93f1-6d70515dafa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:03:34.388229 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e84d0b3-3297-45c6-93f1-6d70515dafa2 admin admin] PATH_INFO: `/v3/projects/5bc84fa6d13449be96f3fc98a0457a30` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:03:34.391349 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e84d0b3-3297-45c6-93f1-6d70515dafa2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5bc84fa6d13449be96f3fc98a0457a30)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:03:34.395486 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e84d0b3-3297-45c6-93f1-6d70515dafa2 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:03:34.524085 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-4e84d0b3-3297-45c6-93f1-6d70515dafa2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5bc84fa6d13449be96f3fc98a0457a30', 'request_id': 'req-4e84d0b3-3297-45c6-93f1-6d70515dafa2'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:03:34.544584 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-4e84d0b3-3297-45c6-93f1-6d70515dafa2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5bc84fa6d13449be96f3fc98a0457a30', 'request_id': 'req-4e84d0b3-3297-45c6-93f1-6d70515dafa2'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:03:34.568624 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-4e84d0b3-3297-45c6-93f1-6d70515dafa2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5bc84fa6d13449be96f3fc98a0457a30', 'request_id': 'req-4e84d0b3-3297-45c6-93f1-6d70515dafa2'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:03:34.588683 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aefd4bb-6150-4eb8-ac87-b82c890e3320 service neutron] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:03:34.592141 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-8aefd4bb-6150-4eb8-ac87-b82c890e3320 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:03:34.600425 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-4e84d0b3-3297-45c6-93f1-6d70515dafa2 admin admin] The token cache is being invalidate because project 5bc84fa6d13449be96f3fc98a0457a30 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81524) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 09 01:03:34.600955 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-4e84d0b3-3297-45c6-93f1-6d70515dafa2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:03:34.602521 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-4e84d0b3-3297-45c6-93f1-6d70515dafa2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:03:34.605028 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1334/2698] 10.222.0.15 () {58 vars in 1233 bytes} [Sun Oct 9 01:03:34 2022] DELETE /identity/v3/projects/5bc84fa6d13449be96f3fc98a0457a30 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 01:03:34.640707 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aefd4bb-6150-4eb8-ac87-b82c890e3320 service neutron] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:03:34.799790 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d952b0-4ae1-4541-a122-26bcc51bd884 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:03:34.800471 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d952b0-4ae1-4541-a122-26bcc51bd884 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:03:34.800745 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d952b0-4ae1-4541-a122-26bcc51bd884 admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:03:34.801014 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d952b0-4ae1-4541-a122-26bcc51bd884 admin admin] PATH_INFO: `/v3/users/cfdfd0e5374f45bd9ad0e48839b24877` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:03:34.802995 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d952b0-4ae1-4541-a122-26bcc51bd884 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cfdfd0e5374f45bd9ad0e48839b24877)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:03:34.811362 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d952b0-4ae1-4541-a122-26bcc51bd884 admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:03:34.878412 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 01:03:34.947706 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-42d952b0-4ae1-4541-a122-26bcc51bd884 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cfdfd0e5374f45bd9ad0e48839b24877'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:03:34.966259 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-42d952b0-4ae1-4541-a122-26bcc51bd884 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cfdfd0e5374f45bd9ad0e48839b24877'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:03:34.967963 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-42d952b0-4ae1-4541-a122-26bcc51bd884 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cfdfd0e5374f45bd9ad0e48839b24877'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:03:34.969087 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-42d952b0-4ae1-4541-a122-26bcc51bd884 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cfdfd0e5374f45bd9ad0e48839b24877'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:03:34.991499 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-42d952b0-4ae1-4541-a122-26bcc51bd884 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cfdfd0e5374f45bd9ad0e48839b24877'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:03:35.027771 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1365/2699] 10.222.0.15 () {58 vars in 1224 bytes} [Sun Oct 9 01:03:34 2022] DELETE /identity/v3/users/cfdfd0e5374f45bd9ad0e48839b24877 => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 09 01:03:35.034196 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5344015c-1db0-442e-a33a-73fa1991e5b6 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:03:35.034529 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5344015c-1db0-442e-a33a-73fa1991e5b6 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:03:35.034728 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5344015c-1db0-442e-a33a-73fa1991e5b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:03:35.058106 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-5344015c-1db0-442e-a33a-73fa1991e5b6 None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 01:03:35.060267 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-5344015c-1db0-442e-a33a-73fa1991e5b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:03:35.161182 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1335/2700] 10.222.0.15 () {58 vars in 958 bytes} [Sun Oct 9 01:03:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 01:03:35.172141 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d952b0-4ae1-4541-a122-26bcc51bd884 admin admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:03:35.173949 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-42d952b0-4ae1-4541-a122-26bcc51bd884 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:03:35.259971 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d952b0-4ae1-4541-a122-26bcc51bd884 admin admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:03:35.267668 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bd0f3a-07c7-42e6-ad36-478559074831 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4ef90d456d2483e8ddafbe2d4d4fb5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f148d39ced534860abfbe8fc3f98ace4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:03:35.268476 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bd0f3a-07c7-42e6-ad36-478559074831 service neutron] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:03:35.268783 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bd0f3a-07c7-42e6-ad36-478559074831 service neutron] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:03:35.269046 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bd0f3a-07c7-42e6-ad36-478559074831 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:03:35.284438 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bd0f3a-07c7-42e6-ad36-478559074831 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:03:35.286611 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bd0f3a-07c7-42e6-ad36-478559074831 service neutron] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:03:35.305047 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1366/2701] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Oct 9 01:03:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 09 01:03:35.687959 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5344015c-1db0-442e-a33a-73fa1991e5b6 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:03:35.690224 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-5344015c-1db0-442e-a33a-73fa1991e5b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:03:35.712369 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5344015c-1db0-442e-a33a-73fa1991e5b6 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:03:35.720441 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca80777-d4a2-419d-8cf4-240061df7946 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:03:35.721764 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca80777-d4a2-419d-8cf4-240061df7946 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:03:35.722292 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca80777-d4a2-419d-8cf4-240061df7946 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:03:35.722909 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca80777-d4a2-419d-8cf4-240061df7946 admin admin] PATH_INFO: `/v3/projects/d7048112c2634e9087531c96062ba326` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:03:35.726012 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca80777-d4a2-419d-8cf4-240061df7946 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d7048112c2634e9087531c96062ba326)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:03:35.730571 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca80777-d4a2-419d-8cf4-240061df7946 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:03:35.777432 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 01:03:35.806675 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-aca80777-d4a2-419d-8cf4-240061df7946 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd7048112c2634e9087531c96062ba326', 'request_id': 'req-aca80777-d4a2-419d-8cf4-240061df7946'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:03:35.818375 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-aca80777-d4a2-419d-8cf4-240061df7946 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd7048112c2634e9087531c96062ba326', 'request_id': 'req-aca80777-d4a2-419d-8cf4-240061df7946'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:03:35.828574 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-aca80777-d4a2-419d-8cf4-240061df7946 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd7048112c2634e9087531c96062ba326', 'request_id': 'req-aca80777-d4a2-419d-8cf4-240061df7946'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:03:35.844564 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-aca80777-d4a2-419d-8cf4-240061df7946 admin admin] The token cache is being invalidate because project d7048112c2634e9087531c96062ba326 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81524) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 09 01:03:35.844992 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-aca80777-d4a2-419d-8cf4-240061df7946 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:03:35.845882 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-aca80777-d4a2-419d-8cf4-240061df7946 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:03:35.847825 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1336/2702] 10.222.0.15 () {58 vars in 1233 bytes} [Sun Oct 9 01:03:35 2022] DELETE /identity/v3/projects/d7048112c2634e9087531c96062ba326 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 01:03:35.854105 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bd0f3a-07c7-42e6-ad36-478559074831 service neutron] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:03:35.869116 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bd0f3a-07c7-42e6-ad36-478559074831 service neutron] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:03:35.966452 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360d189d-6d28-4368-b30d-7c78173e4d0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:03:35.967754 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360d189d-6d28-4368-b30d-7c78173e4d0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:03:35.968303 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360d189d-6d28-4368-b30d-7c78173e4d0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:03:35.968903 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360d189d-6d28-4368-b30d-7c78173e4d0d admin admin] PATH_INFO: `/v3/users/127847f1b91c4f4ea8f4f24534b6a0a6` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:03:35.971247 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360d189d-6d28-4368-b30d-7c78173e4d0d admin admin] RBAC: Authorizing `identity:delete_user(user_id=127847f1b91c4f4ea8f4f24534b6a0a6)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:03:35.975250 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360d189d-6d28-4368-b30d-7c78173e4d0d admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:03:36.038115 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-360d189d-6d28-4368-b30d-7c78173e4d0d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '127847f1b91c4f4ea8f4f24534b6a0a6'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:03:36.039937 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 01:03:36.048653 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-360d189d-6d28-4368-b30d-7c78173e4d0d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '127847f1b91c4f4ea8f4f24534b6a0a6'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:03:36.049864 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-360d189d-6d28-4368-b30d-7c78173e4d0d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '127847f1b91c4f4ea8f4f24534b6a0a6'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:03:36.050586 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-360d189d-6d28-4368-b30d-7c78173e4d0d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '127847f1b91c4f4ea8f4f24534b6a0a6'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:03:36.063292 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-360d189d-6d28-4368-b30d-7c78173e4d0d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '127847f1b91c4f4ea8f4f24534b6a0a6'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:03:36.100769 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1367/2703] 10.222.0.15 () {58 vars in 1224 bytes} [Sun Oct 9 01:03:35 2022] DELETE /identity/v3/users/127847f1b91c4f4ea8f4f24534b6a0a6 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 01:03:36.517628 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca80777-d4a2-419d-8cf4-240061df7946 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:03:36.520228 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-aca80777-d4a2-419d-8cf4-240061df7946 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:03:36.542709 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca80777-d4a2-419d-8cf4-240061df7946 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:03:36.646320 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6712ae07-d4d2-4b23-b7f0-80bd3e63952a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:03:36.647133 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6712ae07-d4d2-4b23-b7f0-80bd3e63952a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:03:36.647430 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6712ae07-d4d2-4b23-b7f0-80bd3e63952a admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:03:36.647578 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6712ae07-d4d2-4b23-b7f0-80bd3e63952a admin admin] PATH_INFO: `/v3/projects/754a33e6d92941618c50011703b720d1` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:03:36.649205 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6712ae07-d4d2-4b23-b7f0-80bd3e63952a admin admin] RBAC: Authorizing `identity:delete_project(project_id=754a33e6d92941618c50011703b720d1)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:03:36.651103 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6712ae07-d4d2-4b23-b7f0-80bd3e63952a admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:03:36.739045 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360d189d-6d28-4368-b30d-7c78173e4d0d admin admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:03:36.741284 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-360d189d-6d28-4368-b30d-7c78173e4d0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:03:36.743070 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-6712ae07-d4d2-4b23-b7f0-80bd3e63952a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '754a33e6d92941618c50011703b720d1', 'request_id': 'req-6712ae07-d4d2-4b23-b7f0-80bd3e63952a'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:03:36.760690 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-6712ae07-d4d2-4b23-b7f0-80bd3e63952a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '754a33e6d92941618c50011703b720d1', 'request_id': 'req-6712ae07-d4d2-4b23-b7f0-80bd3e63952a'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:03:36.761884 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360d189d-6d28-4368-b30d-7c78173e4d0d admin admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:03:36.778018 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-6712ae07-d4d2-4b23-b7f0-80bd3e63952a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '754a33e6d92941618c50011703b720d1', 'request_id': 'req-6712ae07-d4d2-4b23-b7f0-80bd3e63952a'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:03:36.793125 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-6712ae07-d4d2-4b23-b7f0-80bd3e63952a admin admin] The token cache is being invalidate because project 754a33e6d92941618c50011703b720d1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81524) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 09 01:03:36.793726 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-6712ae07-d4d2-4b23-b7f0-80bd3e63952a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:03:36.794879 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-6712ae07-d4d2-4b23-b7f0-80bd3e63952a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:03:36.797628 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1337/2704] 10.222.0.15 () {58 vars in 1233 bytes} [Sun Oct 9 01:03:36 2022] DELETE /identity/v3/projects/754a33e6d92941618c50011703b720d1 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 01:03:36.804175 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e835e8e4-3e22-48a9-bc4b-3d7d11ba9f84 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:03:36.804966 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e835e8e4-3e22-48a9-bc4b-3d7d11ba9f84 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:03:36.805403 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e835e8e4-3e22-48a9-bc4b-3d7d11ba9f84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:03:36.865657 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-e835e8e4-3e22-48a9-bc4b-3d7d11ba9f84 None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 01:03:36.866067 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-e835e8e4-3e22-48a9-bc4b-3d7d11ba9f84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:03:36.893296 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06e7417-54bf-4702-9e8b-7035e8586f5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:03:36.894661 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06e7417-54bf-4702-9e8b-7035e8586f5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:03:36.895211 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06e7417-54bf-4702-9e8b-7035e8586f5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:03:36.895839 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06e7417-54bf-4702-9e8b-7035e8586f5b admin admin] PATH_INFO: `/v3/users/4ca184fc03ce49aea19f892a23213e9d` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:03:36.897990 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06e7417-54bf-4702-9e8b-7035e8586f5b admin admin] RBAC: Authorizing `identity:delete_user(user_id=4ca184fc03ce49aea19f892a23213e9d)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:03:36.901936 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06e7417-54bf-4702-9e8b-7035e8586f5b admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:03:36.978363 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 01:03:37.014929 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-e06e7417-54bf-4702-9e8b-7035e8586f5b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4ca184fc03ce49aea19f892a23213e9d'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:03:37.035302 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-e06e7417-54bf-4702-9e8b-7035e8586f5b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4ca184fc03ce49aea19f892a23213e9d'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:03:37.036709 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-e06e7417-54bf-4702-9e8b-7035e8586f5b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4ca184fc03ce49aea19f892a23213e9d'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:03:37.037780 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-e06e7417-54bf-4702-9e8b-7035e8586f5b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4ca184fc03ce49aea19f892a23213e9d'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:03:37.057328 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-e06e7417-54bf-4702-9e8b-7035e8586f5b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4ca184fc03ce49aea19f892a23213e9d'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:03:37.059923 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1338/2705] 10.222.0.15 () {58 vars in 958 bytes} [Sun Oct 9 01:03:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 01:03:37.072993 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90afb6bd-d06e-4cb3-9795-0505148110c7 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:03:37.075988 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90afb6bd-d06e-4cb3-9795-0505148110c7 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:03:37.078911 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90afb6bd-d06e-4cb3-9795-0505148110c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:03:37.118013 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1368/2706] 10.222.0.15 () {58 vars in 1224 bytes} [Sun Oct 9 01:03:36 2022] DELETE /identity/v3/users/4ca184fc03ce49aea19f892a23213e9d => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 09 01:03:37.125313 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e87299-b099-4569-a4a0-252c0ab197da None None] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:03:37.125744 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e87299-b099-4569-a4a0-252c0ab197da None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:03:37.126312 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e87299-b099-4569-a4a0-252c0ab197da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:03:37.138255 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-90afb6bd-d06e-4cb3-9795-0505148110c7 None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 01:03:37.140453 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-90afb6bd-d06e-4cb3-9795-0505148110c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:03:37.164658 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.auth.core [None req-95e87299-b099-4569-a4a0-252c0ab197da None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 01:03:37.166909 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-95e87299-b099-4569-a4a0-252c0ab197da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:03:37.251802 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=85,keystone:INSERT=2,keystone:DELETE=13 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 01:03:37.308121 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1369/2707] 10.222.0.15 () {58 vars in 958 bytes} [Sun Oct 9 01:03:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 01:03:37.308368 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1339/2708] 10.222.0.15 () {58 vars in 958 bytes} [Sun Oct 9 01:03:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 01:03:37.314391 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e87299-b099-4569-a4a0-252c0ab197da None None] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:03:37.326152 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90afb6bd-d06e-4cb3-9795-0505148110c7 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:03:37.332648 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e87299-b099-4569-a4a0-252c0ab197da None None] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:03:37.337259 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-90afb6bd-d06e-4cb3-9795-0505148110c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:03:37.343648 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ec3ebc-b8df-402a-9526-2bd7934b24e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:03:37.344716 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ec3ebc-b8df-402a-9526-2bd7934b24e2 admin admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:03:37.345183 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ec3ebc-b8df-402a-9526-2bd7934b24e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:03:37.345614 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ec3ebc-b8df-402a-9526-2bd7934b24e2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:03:37.346796 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ec3ebc-b8df-402a-9526-2bd7934b24e2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 01:03:37.347197 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ec3ebc-b8df-402a-9526-2bd7934b24e2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:03:37.350321 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ec3ebc-b8df-402a-9526-2bd7934b24e2 admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:03:37.372826 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1370/2709] 10.222.0.15 () {58 vars in 1153 bytes} [Sun Oct 9 01:03:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 01:03:37.378505 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ec3ebc-b8df-402a-9526-2bd7934b24e2 admin admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:03:37.391747 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ec3ebc-b8df-402a-9526-2bd7934b24e2 admin admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:03:37.398857 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fa1985-4981-4adc-96fd-d431b98586b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:03:37.399857 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fa1985-4981-4adc-96fd-d431b98586b4 admin admin] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:03:37.400344 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fa1985-4981-4adc-96fd-d431b98586b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:03:37.400757 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fa1985-4981-4adc-96fd-d431b98586b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:03:37.401491 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fa1985-4981-4adc-96fd-d431b98586b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:03:37.403979 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fa1985-4981-4adc-96fd-d431b98586b4 admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:03:37.431850 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90afb6bd-d06e-4cb3-9795-0505148110c7 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:03:37.437092 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02efa57c-0c01-4ace-824f-875127c57009 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4ef90d456d2483e8ddafbe2d4d4fb5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f148d39ced534860abfbe8fc3f98ace4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:03:37.438171 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02efa57c-0c01-4ace-824f-875127c57009 service neutron] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:03:37.438653 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02efa57c-0c01-4ace-824f-875127c57009 service neutron] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:03:37.439134 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02efa57c-0c01-4ace-824f-875127c57009 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:03:37.455522 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02efa57c-0c01-4ace-824f-875127c57009 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:03:37.457109 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1371/2710] 10.222.0.15 () {60 vars in 1153 bytes} [Sun Oct 9 01:03:37 2022] POST /identity/v3/projects => generated 381 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 09 01:03:37.461018 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02efa57c-0c01-4ace-824f-875127c57009 service neutron] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:03:37.462436 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fa1985-4981-4adc-96fd-d431b98586b4 admin admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:03:37.475154 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1340/2711] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Oct 9 01:03:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 09 01:03:37.549940 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fa1985-4981-4adc-96fd-d431b98586b4 admin admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:03:37.557385 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8380ce41-9663-4483-aadd-a696484b2bac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:03:37.558142 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8380ce41-9663-4483-aadd-a696484b2bac admin admin] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:03:37.558405 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8380ce41-9663-4483-aadd-a696484b2bac admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:03:37.558673 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8380ce41-9663-4483-aadd-a696484b2bac admin admin] PATH_INFO: `/v3/users` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:03:37.559685 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8380ce41-9663-4483-aadd-a696484b2bac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:03:37.561552 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8380ce41-9663-4483-aadd-a696484b2bac admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:03:37.592499 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1372/2712] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Oct 9 01:03:37 2022] POST /identity/v3/users => generated 291 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 09 01:03:37.598176 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02efa57c-0c01-4ace-824f-875127c57009 service neutron] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:03:37.609030 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02efa57c-0c01-4ace-824f-875127c57009 service neutron] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:03:37.614803 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2b23c2-e144-4653-a8e4-3db771a57ff4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:03:37.615469 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2b23c2-e144-4653-a8e4-3db771a57ff4 admin admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:03:37.615765 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2b23c2-e144-4653-a8e4-3db771a57ff4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:03:37.616004 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2b23c2-e144-4653-a8e4-3db771a57ff4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:03:37.616847 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2b23c2-e144-4653-a8e4-3db771a57ff4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:03:37.618846 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2b23c2-e144-4653-a8e4-3db771a57ff4 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:03:37.631597 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1341/2713] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Oct 9 01:03:37 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 09 01:03:37.636152 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8380ce41-9663-4483-aadd-a696484b2bac admin admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:03:37.647193 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8380ce41-9663-4483-aadd-a696484b2bac admin admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:03:37.652219 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1702020-a4b8-4623-beac-c26460ff6580 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:03:37.652854 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1702020-a4b8-4623-beac-c26460ff6580 admin admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:03:37.653126 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1702020-a4b8-4623-beac-c26460ff6580 admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:03:37.653397 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1702020-a4b8-4623-beac-c26460ff6580 admin admin] PATH_INFO: `/v3/roles` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:03:37.654043 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1702020-a4b8-4623-beac-c26460ff6580 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:03:37.655760 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1702020-a4b8-4623-beac-c26460ff6580 admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:03:37.667295 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1373/2714] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Oct 9 01:03:37 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 09 01:03:37.672397 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2b23c2-e144-4653-a8e4-3db771a57ff4 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:03:37.685488 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2b23c2-e144-4653-a8e4-3db771a57ff4 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:03:37.691013 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ef4d6d-02df-430f-b3b3-cde220ad3d34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:03:37.691948 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ef4d6d-02df-430f-b3b3-cde220ad3d34 admin admin] REQUEST_METHOD: `PUT` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:03:37.692234 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ef4d6d-02df-430f-b3b3-cde220ad3d34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:03:37.692515 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ef4d6d-02df-430f-b3b3-cde220ad3d34 admin admin] PATH_INFO: `/v3/projects/073cb2397fba4197a3ae9d10db93bf2b/users/4d5b4f0c97ca45ae99cd6dea00423324/roles/afb0a01183d9497795eaa4fa1a4046ae` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:03:37.717516 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ef4d6d-02df-430f-b3b3-cde220ad3d34 admin admin] RBAC: Authorizing `identity:create_grant(project_id=073cb2397fba4197a3ae9d10db93bf2b, user_id=4d5b4f0c97ca45ae99cd6dea00423324, role_id=afb0a01183d9497795eaa4fa1a4046ae)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:03:37.722955 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ef4d6d-02df-430f-b3b3-cde220ad3d34 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:03:37.746488 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1342/2715] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Oct 9 01:03:37 2022] PUT /identity/v3/projects/073cb2397fba4197a3ae9d10db93bf2b/users/4d5b4f0c97ca45ae99cd6dea00423324/roles/afb0a01183d9497795eaa4fa1a4046ae => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 01:03:37.758527 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d348f841-1093-46d3-87f8-d27242b8835c None None] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:03:37.758853 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d348f841-1093-46d3-87f8-d27242b8835c None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:03:37.759069 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d348f841-1093-46d3-87f8-d27242b8835c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:03:37.801723 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.auth.core [None req-d348f841-1093-46d3-87f8-d27242b8835c None None] MFA Rules not processed for user `4d5b4f0c97ca45ae99cd6dea00423324`. Rule list: `[]` (Enabled: `True`). {{(pid=81525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 01:03:37.803462 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-d348f841-1093-46d3-87f8-d27242b8835c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:03:37.885625 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1374/2716] 10.222.0.15 () {58 vars in 958 bytes} [Sun Oct 9 01:03:37 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 09 01:03:37.891939 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ef4d6d-02df-430f-b3b3-cde220ad3d34 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:03:37.906166 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d348f841-1093-46d3-87f8-d27242b8835c None None] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:03:37.909929 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-d348f841-1093-46d3-87f8-d27242b8835c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:03:37.954772 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 01:03:37.997232 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 01:03:38.013824 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ef4d6d-02df-430f-b3b3-cde220ad3d34 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:03:38.021865 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69de15f9-e94a-4c10-bc44-b6004a7c03d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:03:38.022948 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69de15f9-e94a-4c10-bc44-b6004a7c03d1 admin admin] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:03:38.023448 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69de15f9-e94a-4c10-bc44-b6004a7c03d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:03:38.023982 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69de15f9-e94a-4c10-bc44-b6004a7c03d1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:03:38.025062 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69de15f9-e94a-4c10-bc44-b6004a7c03d1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:03:38.028085 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69de15f9-e94a-4c10-bc44-b6004a7c03d1 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:03:38.034892 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d348f841-1093-46d3-87f8-d27242b8835c None None] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:03:38.041239 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71442a9e-02da-424f-84c9-0517c0c06951 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:03:38.043115 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71442a9e-02da-424f-84c9-0517c0c06951 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:03:38.043510 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71442a9e-02da-424f-84c9-0517c0c06951 admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:03:38.043945 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71442a9e-02da-424f-84c9-0517c0c06951 admin admin] PATH_INFO: `/v3/projects/523e5d2eec8d40ccb213a267ed785408` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:03:38.045877 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71442a9e-02da-424f-84c9-0517c0c06951 admin admin] RBAC: Authorizing `identity:delete_project(project_id=523e5d2eec8d40ccb213a267ed785408)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:03:38.048557 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71442a9e-02da-424f-84c9-0517c0c06951 admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:03:38.069389 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1343/2717] 10.222.0.15 () {60 vars in 1153 bytes} [Sun Oct 9 01:03:37 2022] POST /identity/v3/projects => generated 383 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 09 01:03:38.074226 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69de15f9-e94a-4c10-bc44-b6004a7c03d1 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:03:38.115245 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-71442a9e-02da-424f-84c9-0517c0c06951 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '523e5d2eec8d40ccb213a267ed785408', 'request_id': 'req-71442a9e-02da-424f-84c9-0517c0c06951'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:03:38.127702 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-71442a9e-02da-424f-84c9-0517c0c06951 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '523e5d2eec8d40ccb213a267ed785408', 'request_id': 'req-71442a9e-02da-424f-84c9-0517c0c06951'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:03:38.138006 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-71442a9e-02da-424f-84c9-0517c0c06951 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '523e5d2eec8d40ccb213a267ed785408', 'request_id': 'req-71442a9e-02da-424f-84c9-0517c0c06951'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:03:38.152487 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-71442a9e-02da-424f-84c9-0517c0c06951 admin admin] The token cache is being invalidate because project 523e5d2eec8d40ccb213a267ed785408 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81525) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 09 01:03:38.153005 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-71442a9e-02da-424f-84c9-0517c0c06951 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:03:38.153783 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-71442a9e-02da-424f-84c9-0517c0c06951 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:03:38.155685 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1375/2718] 10.222.0.15 () {58 vars in 1233 bytes} [Sun Oct 9 01:03:37 2022] DELETE /identity/v3/projects/523e5d2eec8d40ccb213a267ed785408 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 09 01:03:38.160909 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71442a9e-02da-424f-84c9-0517c0c06951 admin admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:03:38.162873 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-71442a9e-02da-424f-84c9-0517c0c06951 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:03:38.168025 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69de15f9-e94a-4c10-bc44-b6004a7c03d1 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:03:38.267876 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdcaea8-ba08-4d37-9ef9-0fe2abfffc7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:03:38.268737 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdcaea8-ba08-4d37-9ef9-0fe2abfffc7c admin admin] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:03:38.269168 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71442a9e-02da-424f-84c9-0517c0c06951 admin admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:03:38.269352 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdcaea8-ba08-4d37-9ef9-0fe2abfffc7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:03:38.269655 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdcaea8-ba08-4d37-9ef9-0fe2abfffc7c admin admin] PATH_INFO: `/v3/users` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:03:38.270670 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdcaea8-ba08-4d37-9ef9-0fe2abfffc7c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:03:38.274313 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdcaea8-ba08-4d37-9ef9-0fe2abfffc7c admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:03:38.276949 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6184f4fc-6310-4ae5-8b89-4b5a0b8693f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:03:38.277872 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6184f4fc-6310-4ae5-8b89-4b5a0b8693f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:03:38.278221 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6184f4fc-6310-4ae5-8b89-4b5a0b8693f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:03:38.278580 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6184f4fc-6310-4ae5-8b89-4b5a0b8693f5 admin admin] PATH_INFO: `/v3/users/9c3ca4a85f124a68bbee89499901b683` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:03:38.280045 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6184f4fc-6310-4ae5-8b89-4b5a0b8693f5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c3ca4a85f124a68bbee89499901b683)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:03:38.282524 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6184f4fc-6310-4ae5-8b89-4b5a0b8693f5 admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:03:38.308210 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1344/2719] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Oct 9 01:03:38 2022] POST /identity/v3/users => generated 298 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 09 01:03:38.310109 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdcaea8-ba08-4d37-9ef9-0fe2abfffc7c admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:03:38.313068 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-dfdcaea8-ba08-4d37-9ef9-0fe2abfffc7c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:03:38.329917 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdcaea8-ba08-4d37-9ef9-0fe2abfffc7c admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:03:38.337207 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c353f9-c1f9-45c8-853c-5b1de5aef19a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:03:38.338113 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c353f9-c1f9-45c8-853c-5b1de5aef19a admin admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:03:38.338493 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c353f9-c1f9-45c8-853c-5b1de5aef19a admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:03:38.338861 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c353f9-c1f9-45c8-853c-5b1de5aef19a admin admin] PATH_INFO: `/v3/roles` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:03:38.339777 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c353f9-c1f9-45c8-853c-5b1de5aef19a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:03:38.342288 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c353f9-c1f9-45c8-853c-5b1de5aef19a admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:03:38.355357 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-6184f4fc-6310-4ae5-8b89-4b5a0b8693f5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c3ca4a85f124a68bbee89499901b683'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:03:38.357619 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 01:03:38.367161 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1345/2720] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Oct 9 01:03:38 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 09 01:03:38.374727 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c353f9-c1f9-45c8-853c-5b1de5aef19a admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:03:38.377547 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-6184f4fc-6310-4ae5-8b89-4b5a0b8693f5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c3ca4a85f124a68bbee89499901b683'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:03:38.378960 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-6184f4fc-6310-4ae5-8b89-4b5a0b8693f5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c3ca4a85f124a68bbee89499901b683'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:03:38.380121 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-6184f4fc-6310-4ae5-8b89-4b5a0b8693f5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c3ca4a85f124a68bbee89499901b683'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:03:38.386330 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c353f9-c1f9-45c8-853c-5b1de5aef19a admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:03:38.393267 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff18bdeb-de76-49d0-96cf-e1377a5b3029 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:03:38.394054 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff18bdeb-de76-49d0-96cf-e1377a5b3029 admin admin] REQUEST_METHOD: `PUT` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:03:38.394278 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff18bdeb-de76-49d0-96cf-e1377a5b3029 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:03:38.394533 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff18bdeb-de76-49d0-96cf-e1377a5b3029 admin admin] PATH_INFO: `/v3/projects/71c35cc6257e46b9a62125bf59137296/users/0463b519957248ec91b4a5b797eadda3/roles/f69dddf26daf4dd79d4c962beb877af5` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:03:38.399498 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-6184f4fc-6310-4ae5-8b89-4b5a0b8693f5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c3ca4a85f124a68bbee89499901b683'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:03:38.417636 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff18bdeb-de76-49d0-96cf-e1377a5b3029 admin admin] RBAC: Authorizing `identity:create_grant(project_id=71c35cc6257e46b9a62125bf59137296, user_id=0463b519957248ec91b4a5b797eadda3, role_id=f69dddf26daf4dd79d4c962beb877af5)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:03:38.420548 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff18bdeb-de76-49d0-96cf-e1377a5b3029 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:03:38.441572 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1346/2721] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Oct 9 01:03:38 2022] PUT /identity/v3/projects/71c35cc6257e46b9a62125bf59137296/users/0463b519957248ec91b4a5b797eadda3/roles/f69dddf26daf4dd79d4c962beb877af5 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 09 01:03:38.445820 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff18bdeb-de76-49d0-96cf-e1377a5b3029 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:03:38.448028 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-ff18bdeb-de76-49d0-96cf-e1377a5b3029 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:03:38.457349 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1376/2722] 10.222.0.15 () {58 vars in 1224 bytes} [Sun Oct 9 01:03:38 2022] DELETE /identity/v3/users/9c3ca4a85f124a68bbee89499901b683 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 09 01:03:38.550107 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 01:03:38.598209 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff18bdeb-de76-49d0-96cf-e1377a5b3029 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:03:38.687245 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa36cd1-4360-4f62-a4e9-eda9bdcf6d37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:03:38.687936 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa36cd1-4360-4f62-a4e9-eda9bdcf6d37 admin admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:03:38.688215 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa36cd1-4360-4f62-a4e9-eda9bdcf6d37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:03:38.688487 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa36cd1-4360-4f62-a4e9-eda9bdcf6d37 admin admin] PATH_INFO: `/v3/roles` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:03:38.689197 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa36cd1-4360-4f62-a4e9-eda9bdcf6d37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:03:38.690868 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa36cd1-4360-4f62-a4e9-eda9bdcf6d37 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:03:38.707331 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1347/2723] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Oct 9 01:03:38 2022] GET /identity/v3/roles => generated 1420 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 09 01:03:38.718004 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6184f4fc-6310-4ae5-8b89-4b5a0b8693f5 admin admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:03:38.732566 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6184f4fc-6310-4ae5-8b89-4b5a0b8693f5 admin admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:03:38.739695 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19c42fc-fd3f-42b5-b633-38fb42024596 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:03:38.740679 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19c42fc-fd3f-42b5-b633-38fb42024596 admin admin] REQUEST_METHOD: `PUT` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:03:38.741170 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19c42fc-fd3f-42b5-b633-38fb42024596 admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:03:38.741449 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19c42fc-fd3f-42b5-b633-38fb42024596 admin admin] PATH_INFO: `/v3/projects/71c35cc6257e46b9a62125bf59137296/users/0463b519957248ec91b4a5b797eadda3/roles/f69dddf26daf4dd79d4c962beb877af5` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:03:38.744003 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19c42fc-fd3f-42b5-b633-38fb42024596 admin admin] RBAC: Authorizing `identity:create_grant(project_id=71c35cc6257e46b9a62125bf59137296, user_id=0463b519957248ec91b4a5b797eadda3, role_id=f69dddf26daf4dd79d4c962beb877af5)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:03:38.747363 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19c42fc-fd3f-42b5-b633-38fb42024596 admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:03:38.761090 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1377/2724] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Oct 9 01:03:38 2022] PUT /identity/v3/projects/71c35cc6257e46b9a62125bf59137296/users/0463b519957248ec91b4a5b797eadda3/roles/f69dddf26daf4dd79d4c962beb877af5 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 01:03:38.772615 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3c4dd0-051f-4d6d-93dc-fb07a75d70d8 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:03:38.773562 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3c4dd0-051f-4d6d-93dc-fb07a75d70d8 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:03:38.773562 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3c4dd0-051f-4d6d-93dc-fb07a75d70d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:03:38.818083 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-ba3c4dd0-051f-4d6d-93dc-fb07a75d70d8 None None] MFA Rules not processed for user `0463b519957248ec91b4a5b797eadda3`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 01:03:38.820389 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-ba3c4dd0-051f-4d6d-93dc-fb07a75d70d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:03:38.923250 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19c42fc-fd3f-42b5-b633-38fb42024596 admin admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:03:38.927045 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-e19c42fc-fd3f-42b5-b633-38fb42024596 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:03:38.946866 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1348/2725] 10.222.0.15 () {58 vars in 958 bytes} [Sun Oct 9 01:03:38 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 01:03:38.969663 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3c4dd0-051f-4d6d-93dc-fb07a75d70d8 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:03:38.973461 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-ba3c4dd0-051f-4d6d-93dc-fb07a75d70d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:03:39.045807 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19c42fc-fd3f-42b5-b633-38fb42024596 admin admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:03:39.052826 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d440d245-e1de-4dc9-ae95-25499da93790 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:03:39.053635 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d440d245-e1de-4dc9-ae95-25499da93790 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:03:39.054077 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d440d245-e1de-4dc9-ae95-25499da93790 admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:03:39.054447 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d440d245-e1de-4dc9-ae95-25499da93790 admin admin] PATH_INFO: `/v3/projects/96280ad819f64ca1a5c409fbea6855bd` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:03:39.055873 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d440d245-e1de-4dc9-ae95-25499da93790 admin admin] RBAC: Authorizing `identity:delete_project(project_id=96280ad819f64ca1a5c409fbea6855bd)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:03:39.058083 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d440d245-e1de-4dc9-ae95-25499da93790 admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:03:39.061320 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3c4dd0-051f-4d6d-93dc-fb07a75d70d8 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:03:39.065768 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362c2b37-bf97-43e0-88d1-e96c46807d92 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff7cb78bcd91467abe5c2e2b48aedd1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f148d39ced534860abfbe8fc3f98ace4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:03:39.066459 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362c2b37-bf97-43e0-88d1-e96c46807d92 service cinder] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:03:39.066851 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362c2b37-bf97-43e0-88d1-e96c46807d92 service cinder] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:03:39.067291 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362c2b37-bf97-43e0-88d1-e96c46807d92 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:03:39.079626 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362c2b37-bf97-43e0-88d1-e96c46807d92 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:03:39.081748 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362c2b37-bf97-43e0-88d1-e96c46807d92 service cinder] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:03:39.096397 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1349/2726] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Oct 9 01:03:38 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 09 01:03:39.133581 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-d440d245-e1de-4dc9-ae95-25499da93790 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '96280ad819f64ca1a5c409fbea6855bd', 'request_id': 'req-d440d245-e1de-4dc9-ae95-25499da93790'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:03:39.148938 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-d440d245-e1de-4dc9-ae95-25499da93790 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '96280ad819f64ca1a5c409fbea6855bd', 'request_id': 'req-d440d245-e1de-4dc9-ae95-25499da93790'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:03:39.157450 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-d440d245-e1de-4dc9-ae95-25499da93790 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '96280ad819f64ca1a5c409fbea6855bd', 'request_id': 'req-d440d245-e1de-4dc9-ae95-25499da93790'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:03:39.176199 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-d440d245-e1de-4dc9-ae95-25499da93790 admin admin] The token cache is being invalidate because project 96280ad819f64ca1a5c409fbea6855bd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81525) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 09 01:03:39.176649 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-d440d245-e1de-4dc9-ae95-25499da93790 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:03:39.177531 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-d440d245-e1de-4dc9-ae95-25499da93790 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:03:39.179614 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1378/2727] 10.222.0.15 () {58 vars in 1233 bytes} [Sun Oct 9 01:03:38 2022] DELETE /identity/v3/projects/96280ad819f64ca1a5c409fbea6855bd => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 09 01:03:39.185030 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362c2b37-bf97-43e0-88d1-e96c46807d92 service cinder] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:03:39.200577 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362c2b37-bf97-43e0-88d1-e96c46807d92 service cinder] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:03:39.212236 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d440d245-e1de-4dc9-ae95-25499da93790 admin admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:03:39.212502 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=100 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 01:03:39.214389 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-d440d245-e1de-4dc9-ae95-25499da93790 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:03:39.283043 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 01:03:39.299474 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0915b158-3a32-454d-8294-976af6a1e5d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:03:39.299838 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d440d245-e1de-4dc9-ae95-25499da93790 admin admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:03:39.300221 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0915b158-3a32-454d-8294-976af6a1e5d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:03:39.300502 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0915b158-3a32-454d-8294-976af6a1e5d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:03:39.300773 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0915b158-3a32-454d-8294-976af6a1e5d8 admin admin] PATH_INFO: `/v3/users/427d2d75b01e43b7993630f6f0fd2149` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:03:39.302283 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0915b158-3a32-454d-8294-976af6a1e5d8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=427d2d75b01e43b7993630f6f0fd2149)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:03:39.304369 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0915b158-3a32-454d-8294-976af6a1e5d8 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:03:39.306520 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d58d21c-da3b-4039-8527-3ffd6ef4081d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff7cb78bcd91467abe5c2e2b48aedd1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f148d39ced534860abfbe8fc3f98ace4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:03:39.307543 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d58d21c-da3b-4039-8527-3ffd6ef4081d service cinder] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:03:39.307963 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d58d21c-da3b-4039-8527-3ffd6ef4081d service cinder] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:03:39.308573 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d58d21c-da3b-4039-8527-3ffd6ef4081d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:03:39.310938 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-1d58d21c-da3b-4039-8527-3ffd6ef4081d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:03:39.376496 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-0915b158-3a32-454d-8294-976af6a1e5d8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '427d2d75b01e43b7993630f6f0fd2149'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:03:39.385970 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-0915b158-3a32-454d-8294-976af6a1e5d8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '427d2d75b01e43b7993630f6f0fd2149'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:03:39.386874 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-0915b158-3a32-454d-8294-976af6a1e5d8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '427d2d75b01e43b7993630f6f0fd2149'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:03:39.387648 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-0915b158-3a32-454d-8294-976af6a1e5d8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '427d2d75b01e43b7993630f6f0fd2149'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:03:39.399141 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-0915b158-3a32-454d-8294-976af6a1e5d8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '427d2d75b01e43b7993630f6f0fd2149'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:03:39.404624 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d58d21c-da3b-4039-8527-3ffd6ef4081d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:03:39.406717 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d58d21c-da3b-4039-8527-3ffd6ef4081d service cinder] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:03:39.418985 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1379/2728] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Oct 9 01:03:39 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 09 01:03:39.428940 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1350/2729] 10.222.0.15 () {58 vars in 1224 bytes} [Sun Oct 9 01:03:39 2022] DELETE /identity/v3/users/427d2d75b01e43b7993630f6f0fd2149 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 01:03:39.851408 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d58d21c-da3b-4039-8527-3ffd6ef4081d service cinder] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:03:39.853880 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-1d58d21c-da3b-4039-8527-3ffd6ef4081d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:03:39.881947 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d58d21c-da3b-4039-8527-3ffd6ef4081d service cinder] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:03:39.936632 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0915b158-3a32-454d-8294-976af6a1e5d8 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:03:39.940375 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-0915b158-3a32-454d-8294-976af6a1e5d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:03:39.995096 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150626e1-9381-4314-91e8-e9af0131d0f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:03:39.996162 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150626e1-9381-4314-91e8-e9af0131d0f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:03:39.997334 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150626e1-9381-4314-91e8-e9af0131d0f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:03:39.997828 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150626e1-9381-4314-91e8-e9af0131d0f1 admin admin] PATH_INFO: `/v3/users/4d5b4f0c97ca45ae99cd6dea00423324` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:03:40.000330 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150626e1-9381-4314-91e8-e9af0131d0f1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4d5b4f0c97ca45ae99cd6dea00423324)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:03:40.004265 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150626e1-9381-4314-91e8-e9af0131d0f1 admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:03:40.068401 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0915b158-3a32-454d-8294-976af6a1e5d8 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:03:40.075672 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db654203-05d9-4f17-b696-b683729c96fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:03:40.076641 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db654203-05d9-4f17-b696-b683729c96fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:03:40.077014 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db654203-05d9-4f17-b696-b683729c96fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:03:40.077369 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db654203-05d9-4f17-b696-b683729c96fb admin admin] PATH_INFO: `/v3/projects/186c1666cefd4d4398da481ce1a44b9e` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:03:40.079224 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db654203-05d9-4f17-b696-b683729c96fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=186c1666cefd4d4398da481ce1a44b9e)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:03:40.081547 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db654203-05d9-4f17-b696-b683729c96fb admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:03:40.089752 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-150626e1-9381-4314-91e8-e9af0131d0f1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4d5b4f0c97ca45ae99cd6dea00423324'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:03:40.104803 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-150626e1-9381-4314-91e8-e9af0131d0f1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4d5b4f0c97ca45ae99cd6dea00423324'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:03:40.106028 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-150626e1-9381-4314-91e8-e9af0131d0f1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4d5b4f0c97ca45ae99cd6dea00423324'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:03:40.107054 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-150626e1-9381-4314-91e8-e9af0131d0f1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4d5b4f0c97ca45ae99cd6dea00423324'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:03:40.121959 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-150626e1-9381-4314-91e8-e9af0131d0f1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4d5b4f0c97ca45ae99cd6dea00423324'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:03:40.130519 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 01:03:40.146670 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1380/2730] 10.222.0.15 () {58 vars in 1224 bytes} [Sun Oct 9 01:03:39 2022] DELETE /identity/v3/users/4d5b4f0c97ca45ae99cd6dea00423324 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 09 01:03:40.151720 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadccff6-e6f4-4289-a6f5-36d646176ae0 None None] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:03:40.152226 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadccff6-e6f4-4289-a6f5-36d646176ae0 None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:03:40.152575 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadccff6-e6f4-4289-a6f5-36d646176ae0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:03:40.153925 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-db654203-05d9-4f17-b696-b683729c96fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '186c1666cefd4d4398da481ce1a44b9e', 'request_id': 'req-db654203-05d9-4f17-b696-b683729c96fb'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:03:40.166489 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-db654203-05d9-4f17-b696-b683729c96fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '186c1666cefd4d4398da481ce1a44b9e', 'request_id': 'req-db654203-05d9-4f17-b696-b683729c96fb'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:03:40.177030 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-db654203-05d9-4f17-b696-b683729c96fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '186c1666cefd4d4398da481ce1a44b9e', 'request_id': 'req-db654203-05d9-4f17-b696-b683729c96fb'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:03:40.177342 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.auth.core [None req-fadccff6-e6f4-4289-a6f5-36d646176ae0 None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 01:03:40.178471 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-fadccff6-e6f4-4289-a6f5-36d646176ae0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:03:40.195805 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-db654203-05d9-4f17-b696-b683729c96fb admin admin] The token cache is being invalidate because project 186c1666cefd4d4398da481ce1a44b9e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81524) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 09 01:03:40.196101 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-db654203-05d9-4f17-b696-b683729c96fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:03:40.197003 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-db654203-05d9-4f17-b696-b683729c96fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:03:40.197147 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 01:03:40.199365 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1351/2731] 10.222.0.15 () {58 vars in 1233 bytes} [Sun Oct 9 01:03:39 2022] DELETE /identity/v3/projects/186c1666cefd4d4398da481ce1a44b9e => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 01:03:40.206731 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7b782d-06de-420d-93c6-ef84cec1cb30 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:03:40.207415 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7b782d-06de-420d-93c6-ef84cec1cb30 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:03:40.207973 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7b782d-06de-420d-93c6-ef84cec1cb30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:03:40.240229 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-1d7b782d-06de-420d-93c6-ef84cec1cb30 None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 01:03:40.241887 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-1d7b782d-06de-420d-93c6-ef84cec1cb30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:03:40.274942 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1381/2732] 10.222.0.15 () {58 vars in 958 bytes} [Sun Oct 9 01:03:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 01:03:40.285222 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadccff6-e6f4-4289-a6f5-36d646176ae0 None None] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:03:40.286908 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-fadccff6-e6f4-4289-a6f5-36d646176ae0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:03:40.363298 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1352/2733] 10.222.0.15 () {58 vars in 958 bytes} [Sun Oct 9 01:03:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 09 01:03:40.380861 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475fa15c-c42d-4abb-96df-104e30da504e None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:03:40.382275 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475fa15c-c42d-4abb-96df-104e30da504e None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:03:40.382467 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475fa15c-c42d-4abb-96df-104e30da504e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:03:40.384187 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadccff6-e6f4-4289-a6f5-36d646176ae0 None None] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:03:40.392176 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a019a0d-6365-4e48-944d-a4793ca67a3d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4ef90d456d2483e8ddafbe2d4d4fb5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f148d39ced534860abfbe8fc3f98ace4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:03:40.393689 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a019a0d-6365-4e48-944d-a4793ca67a3d service neutron] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:03:40.394244 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a019a0d-6365-4e48-944d-a4793ca67a3d service neutron] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:03:40.394810 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a019a0d-6365-4e48-944d-a4793ca67a3d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:03:40.413989 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a019a0d-6365-4e48-944d-a4793ca67a3d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:03:40.416662 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a019a0d-6365-4e48-944d-a4793ca67a3d service neutron] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:03:40.432287 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-475fa15c-c42d-4abb-96df-104e30da504e None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 01:03:40.435228 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-475fa15c-c42d-4abb-96df-104e30da504e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:03:40.440093 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1382/2734] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Oct 9 01:03:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 09 01:03:40.475252 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1353/2735] 10.222.0.15 () {58 vars in 958 bytes} [Sun Oct 9 01:03:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 01:03:40.480086 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a019a0d-6365-4e48-944d-a4793ca67a3d service neutron] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:03:40.492442 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a019a0d-6365-4e48-944d-a4793ca67a3d service neutron] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:03:40.498115 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2658574-2ee8-4d46-bbb3-96ac390be03d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:03:40.498883 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2658574-2ee8-4d46-bbb3-96ac390be03d admin admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:03:40.500858 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2658574-2ee8-4d46-bbb3-96ac390be03d admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:03:40.500858 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2658574-2ee8-4d46-bbb3-96ac390be03d admin admin] PATH_INFO: `/v3/domains` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:03:40.500858 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2658574-2ee8-4d46-bbb3-96ac390be03d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 01:03:40.500858 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2658574-2ee8-4d46-bbb3-96ac390be03d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:03:40.502695 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2658574-2ee8-4d46-bbb3-96ac390be03d admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:03:40.521383 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1383/2736] 10.222.0.15 () {58 vars in 1153 bytes} [Sun Oct 9 01:03:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 01:03:40.523755 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475fa15c-c42d-4abb-96df-104e30da504e None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:03:40.539384 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475fa15c-c42d-4abb-96df-104e30da504e None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:03:40.548098 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ddf794-bb3c-4718-b6b3-bcc480fe1dae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:03:40.549219 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ddf794-bb3c-4718-b6b3-bcc480fe1dae admin admin] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:03:40.549523 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ddf794-bb3c-4718-b6b3-bcc480fe1dae admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:03:40.549896 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ddf794-bb3c-4718-b6b3-bcc480fe1dae admin admin] PATH_INFO: `/v3/projects` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:03:40.550826 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ddf794-bb3c-4718-b6b3-bcc480fe1dae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:03:40.552828 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ddf794-bb3c-4718-b6b3-bcc480fe1dae admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:03:40.592799 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1354/2737] 10.222.0.15 () {60 vars in 1153 bytes} [Sun Oct 9 01:03:40 2022] POST /identity/v3/projects => generated 375 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 09 01:03:40.597744 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2658574-2ee8-4d46-bbb3-96ac390be03d admin admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:03:40.610865 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2658574-2ee8-4d46-bbb3-96ac390be03d admin admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:03:40.695585 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd46be9a-d518-42f5-99a1-0bc48290cca3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:03:40.696209 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd46be9a-d518-42f5-99a1-0bc48290cca3 admin admin] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:03:40.696482 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd46be9a-d518-42f5-99a1-0bc48290cca3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:03:40.696782 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd46be9a-d518-42f5-99a1-0bc48290cca3 admin admin] PATH_INFO: `/v3/users` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:03:40.697499 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd46be9a-d518-42f5-99a1-0bc48290cca3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:03:40.699628 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd46be9a-d518-42f5-99a1-0bc48290cca3 admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:03:40.725412 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1384/2738] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Oct 9 01:03:40 2022] POST /identity/v3/users => generated 288 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 09 01:03:40.730388 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ddf794-bb3c-4718-b6b3-bcc480fe1dae admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:03:40.744538 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ddf794-bb3c-4718-b6b3-bcc480fe1dae admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:03:40.750421 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e60ce85-8f36-4570-bd14-d460b646f933 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:03:40.751072 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e60ce85-8f36-4570-bd14-d460b646f933 admin admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:03:40.751384 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e60ce85-8f36-4570-bd14-d460b646f933 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:03:40.751660 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e60ce85-8f36-4570-bd14-d460b646f933 admin admin] PATH_INFO: `/v3/roles` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:03:40.752333 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e60ce85-8f36-4570-bd14-d460b646f933 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:03:40.754019 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e60ce85-8f36-4570-bd14-d460b646f933 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:03:40.766231 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1355/2739] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Oct 9 01:03:40 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 09 01:03:40.771916 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd46be9a-d518-42f5-99a1-0bc48290cca3 admin admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:03:40.784221 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd46be9a-d518-42f5-99a1-0bc48290cca3 admin admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:03:40.789540 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75104549-e089-4171-9720-448b95a43c2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:03:40.790180 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75104549-e089-4171-9720-448b95a43c2d admin admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:03:40.790455 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75104549-e089-4171-9720-448b95a43c2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:03:40.790726 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75104549-e089-4171-9720-448b95a43c2d admin admin] PATH_INFO: `/v3/roles` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:03:40.791435 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75104549-e089-4171-9720-448b95a43c2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:03:40.793083 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75104549-e089-4171-9720-448b95a43c2d admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:03:40.808106 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1385/2740] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Oct 9 01:03:40 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 09 01:03:40.814123 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e60ce85-8f36-4570-bd14-d460b646f933 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:03:40.828894 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e60ce85-8f36-4570-bd14-d460b646f933 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:03:40.833019 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75104549-e089-4171-9720-448b95a43c2d admin admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:03:40.836117 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-75104549-e089-4171-9720-448b95a43c2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:03:40.838900 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4082a968-34f6-454c-8b19-db2cf5b556f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:03:40.840260 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4082a968-34f6-454c-8b19-db2cf5b556f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:03:40.840965 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4082a968-34f6-454c-8b19-db2cf5b556f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:03:40.841148 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4082a968-34f6-454c-8b19-db2cf5b556f0 admin admin] PATH_INFO: `/v3/projects/ae003bb73c334ae5b301661278ed1145/users/e04a81a9706a40c591944a330b49b317/roles/afb0a01183d9497795eaa4fa1a4046ae` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:03:40.860011 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75104549-e089-4171-9720-448b95a43c2d admin admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:03:40.866404 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886c53a1-4904-4fe1-b036-140ee461de1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:03:40.867622 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886c53a1-4904-4fe1-b036-140ee461de1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:03:40.868184 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886c53a1-4904-4fe1-b036-140ee461de1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:03:40.868466 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886c53a1-4904-4fe1-b036-140ee461de1a admin admin] PATH_INFO: `/v3/projects/073cb2397fba4197a3ae9d10db93bf2b` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:03:40.870288 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886c53a1-4904-4fe1-b036-140ee461de1a admin admin] RBAC: Authorizing `identity:delete_project(project_id=073cb2397fba4197a3ae9d10db93bf2b)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:03:40.871985 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4082a968-34f6-454c-8b19-db2cf5b556f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae003bb73c334ae5b301661278ed1145, user_id=e04a81a9706a40c591944a330b49b317, role_id=afb0a01183d9497795eaa4fa1a4046ae)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:03:40.873668 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886c53a1-4904-4fe1-b036-140ee461de1a admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:03:40.878785 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4082a968-34f6-454c-8b19-db2cf5b556f0 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:03:40.908248 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1356/2741] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Oct 9 01:03:40 2022] PUT /identity/v3/projects/ae003bb73c334ae5b301661278ed1145/users/e04a81a9706a40c591944a330b49b317/roles/afb0a01183d9497795eaa4fa1a4046ae => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 01:03:40.915812 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 01:03:40.923965 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c23bc8-0646-4ea4-b90c-8c75b1757be3 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:03:40.924652 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c23bc8-0646-4ea4-b90c-8c75b1757be3 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:03:40.924824 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c23bc8-0646-4ea4-b90c-8c75b1757be3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:03:40.955576 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-886c53a1-4904-4fe1-b036-140ee461de1a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '073cb2397fba4197a3ae9d10db93bf2b', 'request_id': 'req-886c53a1-4904-4fe1-b036-140ee461de1a'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:03:40.960712 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-76c23bc8-0646-4ea4-b90c-8c75b1757be3 None None] MFA Rules not processed for user `e04a81a9706a40c591944a330b49b317`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 01:03:40.962641 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-76c23bc8-0646-4ea4-b90c-8c75b1757be3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:03:40.968636 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-886c53a1-4904-4fe1-b036-140ee461de1a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '073cb2397fba4197a3ae9d10db93bf2b', 'request_id': 'req-886c53a1-4904-4fe1-b036-140ee461de1a'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:03:40.981990 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-886c53a1-4904-4fe1-b036-140ee461de1a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '073cb2397fba4197a3ae9d10db93bf2b', 'request_id': 'req-886c53a1-4904-4fe1-b036-140ee461de1a'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:03:41.002758 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-886c53a1-4904-4fe1-b036-140ee461de1a admin admin] The token cache is being invalidate because project 073cb2397fba4197a3ae9d10db93bf2b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81525) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 09 01:03:41.003855 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-886c53a1-4904-4fe1-b036-140ee461de1a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:03:41.004532 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-886c53a1-4904-4fe1-b036-140ee461de1a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:03:41.007446 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1386/2742] 10.222.0.15 () {58 vars in 1233 bytes} [Sun Oct 9 01:03:40 2022] DELETE /identity/v3/projects/073cb2397fba4197a3ae9d10db93bf2b => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 09 01:03:41.013518 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886c53a1-4904-4fe1-b036-140ee461de1a admin admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:03:41.015813 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-886c53a1-4904-4fe1-b036-140ee461de1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:03:41.031660 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 01:03:41.062011 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1357/2743] 10.222.0.15 () {58 vars in 958 bytes} [Sun Oct 9 01:03:40 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 09 01:03:41.069259 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c23bc8-0646-4ea4-b90c-8c75b1757be3 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:03:41.071483 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-76c23bc8-0646-4ea4-b90c-8c75b1757be3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:03:41.116818 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886c53a1-4904-4fe1-b036-140ee461de1a admin admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:03:41.122386 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784db89b-a455-4059-a8ee-4297cced8919 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:03:41.123058 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784db89b-a455-4059-a8ee-4297cced8919 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:03:41.123371 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784db89b-a455-4059-a8ee-4297cced8919 admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:03:41.123647 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784db89b-a455-4059-a8ee-4297cced8919 admin admin] PATH_INFO: `/v3/users/0463b519957248ec91b4a5b797eadda3` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:03:41.124964 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784db89b-a455-4059-a8ee-4297cced8919 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0463b519957248ec91b4a5b797eadda3)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:03:41.127027 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784db89b-a455-4059-a8ee-4297cced8919 admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:03:41.161244 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c23bc8-0646-4ea4-b90c-8c75b1757be3 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:03:41.168692 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c35f58-a0c7-45eb-ba01-fb921e957226 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:03:41.169542 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c35f58-a0c7-45eb-ba01-fb921e957226 admin admin] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:03:41.170024 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c35f58-a0c7-45eb-ba01-fb921e957226 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:03:41.170379 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c35f58-a0c7-45eb-ba01-fb921e957226 admin admin] PATH_INFO: `/v3/projects` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:03:41.171184 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c35f58-a0c7-45eb-ba01-fb921e957226 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:03:41.173846 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c35f58-a0c7-45eb-ba01-fb921e957226 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:03:41.202945 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-784db89b-a455-4059-a8ee-4297cced8919 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0463b519957248ec91b4a5b797eadda3'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:03:41.213212 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1358/2744] 10.222.0.15 () {60 vars in 1153 bytes} [Sun Oct 9 01:03:41 2022] POST /identity/v3/projects => generated 375 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 09 01:03:41.215063 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c35f58-a0c7-45eb-ba01-fb921e957226 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:03:41.217655 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-784db89b-a455-4059-a8ee-4297cced8919 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0463b519957248ec91b4a5b797eadda3'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:03:41.218550 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-784db89b-a455-4059-a8ee-4297cced8919 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0463b519957248ec91b4a5b797eadda3'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:03:41.219489 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-784db89b-a455-4059-a8ee-4297cced8919 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0463b519957248ec91b4a5b797eadda3'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:03:41.230062 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-784db89b-a455-4059-a8ee-4297cced8919 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0463b519957248ec91b4a5b797eadda3'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:03:41.258543 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1387/2745] 10.222.0.15 () {58 vars in 1224 bytes} [Sun Oct 9 01:03:41 2022] DELETE /identity/v3/users/0463b519957248ec91b4a5b797eadda3 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 09 01:03:41.318060 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c35f58-a0c7-45eb-ba01-fb921e957226 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:03:41.403849 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f831811-e610-41fa-885d-4b73146ac0ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:03:41.404716 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f831811-e610-41fa-885d-4b73146ac0ac admin admin] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:03:41.405184 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f831811-e610-41fa-885d-4b73146ac0ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:03:41.405651 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f831811-e610-41fa-885d-4b73146ac0ac admin admin] PATH_INFO: `/v3/users` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:03:41.406660 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f831811-e610-41fa-885d-4b73146ac0ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:03:41.410370 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f831811-e610-41fa-885d-4b73146ac0ac admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:03:41.450178 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1359/2746] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Oct 9 01:03:41 2022] POST /identity/v3/users => generated 294 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 09 01:03:41.456259 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784db89b-a455-4059-a8ee-4297cced8919 admin admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:03:41.459588 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-784db89b-a455-4059-a8ee-4297cced8919 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:03:41.490592 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784db89b-a455-4059-a8ee-4297cced8919 admin admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:03:41.500835 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3389666e-5967-411a-b091-d8ee563d528f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:03:41.502121 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3389666e-5967-411a-b091-d8ee563d528f admin admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:03:41.502738 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3389666e-5967-411a-b091-d8ee563d528f admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:03:41.503380 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3389666e-5967-411a-b091-d8ee563d528f admin admin] PATH_INFO: `/v3/roles` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:03:41.504737 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3389666e-5967-411a-b091-d8ee563d528f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:03:41.510716 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3389666e-5967-411a-b091-d8ee563d528f admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:03:41.531539 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1388/2747] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Oct 9 01:03:41 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 09 01:03:41.537791 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f831811-e610-41fa-885d-4b73146ac0ac admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:03:41.557976 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f831811-e610-41fa-885d-4b73146ac0ac admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:03:41.566382 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c69aa6-e755-4529-95e6-62ae3957ce68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:03:41.567318 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c69aa6-e755-4529-95e6-62ae3957ce68 admin admin] REQUEST_METHOD: `PUT` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:03:41.567775 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c69aa6-e755-4529-95e6-62ae3957ce68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:03:41.568414 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c69aa6-e755-4529-95e6-62ae3957ce68 admin admin] PATH_INFO: `/v3/projects/7965432abb73409c8bf8161da888ba43/users/5823ac9b75a44d1487fd14db18bb8f13/roles/f69dddf26daf4dd79d4c962beb877af5` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:03:41.574057 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 01:03:41.605061 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c69aa6-e755-4529-95e6-62ae3957ce68 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7965432abb73409c8bf8161da888ba43, user_id=5823ac9b75a44d1487fd14db18bb8f13, role_id=f69dddf26daf4dd79d4c962beb877af5)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:03:41.611397 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c69aa6-e755-4529-95e6-62ae3957ce68 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:03:41.637720 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1360/2748] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Oct 9 01:03:41 2022] PUT /identity/v3/projects/7965432abb73409c8bf8161da888ba43/users/5823ac9b75a44d1487fd14db18bb8f13/roles/f69dddf26daf4dd79d4c962beb877af5 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 01:03:41.644789 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3389666e-5967-411a-b091-d8ee563d528f admin admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:03:41.659199 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3389666e-5967-411a-b091-d8ee563d528f admin admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:03:41.685891 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 01:03:41.731429 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c69aa6-e755-4529-95e6-62ae3957ce68 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:03:41.733966 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-16c69aa6-e755-4529-95e6-62ae3957ce68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:03:41.788025 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eece50ca-5a87-4b22-a3ba-13707e997639 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:03:41.788988 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eece50ca-5a87-4b22-a3ba-13707e997639 admin admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:03:41.789563 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eece50ca-5a87-4b22-a3ba-13707e997639 admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:03:41.790123 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eece50ca-5a87-4b22-a3ba-13707e997639 admin admin] PATH_INFO: `/v3/roles` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:03:41.790943 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eece50ca-5a87-4b22-a3ba-13707e997639 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:03:41.792783 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eece50ca-5a87-4b22-a3ba-13707e997639 admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:03:41.807326 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1389/2749] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Oct 9 01:03:41 2022] GET /identity/v3/roles => generated 1420 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 09 01:03:41.813905 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eece50ca-5a87-4b22-a3ba-13707e997639 admin admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:03:41.839453 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eece50ca-5a87-4b22-a3ba-13707e997639 admin admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:03:41.850410 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db0bc8a-8166-4944-a1f4-b0512ca31387 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:03:41.851696 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db0bc8a-8166-4944-a1f4-b0512ca31387 admin admin] REQUEST_METHOD: `PUT` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:03:41.852122 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db0bc8a-8166-4944-a1f4-b0512ca31387 admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:03:41.852576 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db0bc8a-8166-4944-a1f4-b0512ca31387 admin admin] PATH_INFO: `/v3/projects/7965432abb73409c8bf8161da888ba43/users/5823ac9b75a44d1487fd14db18bb8f13/roles/f69dddf26daf4dd79d4c962beb877af5` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:03:41.856944 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db0bc8a-8166-4944-a1f4-b0512ca31387 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7965432abb73409c8bf8161da888ba43, user_id=5823ac9b75a44d1487fd14db18bb8f13, role_id=f69dddf26daf4dd79d4c962beb877af5)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:03:41.861538 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db0bc8a-8166-4944-a1f4-b0512ca31387 admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:03:41.885362 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1390/2750] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Oct 9 01:03:41 2022] PUT /identity/v3/projects/7965432abb73409c8bf8161da888ba43/users/5823ac9b75a44d1487fd14db18bb8f13/roles/f69dddf26daf4dd79d4c962beb877af5 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 09 01:03:41.893993 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c69aa6-e755-4529-95e6-62ae3957ce68 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:03:41.901959 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250c12fe-4dcb-4e70-a7bc-c6e9272dc249 None None] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:03:41.902428 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250c12fe-4dcb-4e70-a7bc-c6e9272dc249 None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:03:41.902891 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250c12fe-4dcb-4e70-a7bc-c6e9272dc249 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:03:41.952244 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.auth.core [None req-250c12fe-4dcb-4e70-a7bc-c6e9272dc249 None None] MFA Rules not processed for user `5823ac9b75a44d1487fd14db18bb8f13`. Rule list: `[]` (Enabled: `True`). {{(pid=81525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 01:03:41.954200 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-250c12fe-4dcb-4e70-a7bc-c6e9272dc249 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:03:41.987606 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8906c64-c138-40e7-bd58-5d9f58c111fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:03:41.988800 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8906c64-c138-40e7-bd58-5d9f58c111fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:03:41.989229 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8906c64-c138-40e7-bd58-5d9f58c111fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:03:41.989635 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8906c64-c138-40e7-bd58-5d9f58c111fb admin admin] PATH_INFO: `/v3/projects/71c35cc6257e46b9a62125bf59137296` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:03:41.992003 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8906c64-c138-40e7-bd58-5d9f58c111fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=71c35cc6257e46b9a62125bf59137296)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:03:41.994515 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8906c64-c138-40e7-bd58-5d9f58c111fb admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:03:42.062269 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1391/2751] 10.222.0.15 () {58 vars in 958 bytes} [Sun Oct 9 01:03:41 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 01:03:42.063738 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250c12fe-4dcb-4e70-a7bc-c6e9272dc249 None None] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:03:42.065516 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-250c12fe-4dcb-4e70-a7bc-c6e9272dc249 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:03:42.067421 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-b8906c64-c138-40e7-bd58-5d9f58c111fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '71c35cc6257e46b9a62125bf59137296', 'request_id': 'req-b8906c64-c138-40e7-bd58-5d9f58c111fb'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:03:42.084807 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-b8906c64-c138-40e7-bd58-5d9f58c111fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '71c35cc6257e46b9a62125bf59137296', 'request_id': 'req-b8906c64-c138-40e7-bd58-5d9f58c111fb'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:03:42.096421 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-b8906c64-c138-40e7-bd58-5d9f58c111fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '71c35cc6257e46b9a62125bf59137296', 'request_id': 'req-b8906c64-c138-40e7-bd58-5d9f58c111fb'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:03:42.116725 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-b8906c64-c138-40e7-bd58-5d9f58c111fb admin admin] The token cache is being invalidate because project 71c35cc6257e46b9a62125bf59137296 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81524) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 09 01:03:42.117193 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-b8906c64-c138-40e7-bd58-5d9f58c111fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:03:42.118749 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-b8906c64-c138-40e7-bd58-5d9f58c111fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:03:42.120878 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1361/2752] 10.222.0.15 () {58 vars in 1233 bytes} [Sun Oct 9 01:03:41 2022] DELETE /identity/v3/projects/71c35cc6257e46b9a62125bf59137296 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 09 01:03:42.129845 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8906c64-c138-40e7-bd58-5d9f58c111fb admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:03:42.129845 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-b8906c64-c138-40e7-bd58-5d9f58c111fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:03:42.161332 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 01:03:42.166999 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250c12fe-4dcb-4e70-a7bc-c6e9272dc249 None None] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:03:42.210924 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8906c64-c138-40e7-bd58-5d9f58c111fb admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:03:42.216042 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2506974b-a56c-4bc7-b985-4cd2352c7e69 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff7cb78bcd91467abe5c2e2b48aedd1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f148d39ced534860abfbe8fc3f98ace4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:03:42.216967 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2506974b-a56c-4bc7-b985-4cd2352c7e69 service cinder] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:03:42.217419 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2506974b-a56c-4bc7-b985-4cd2352c7e69 service cinder] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:03:42.217850 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2506974b-a56c-4bc7-b985-4cd2352c7e69 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:03:42.219927 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-2506974b-a56c-4bc7-b985-4cd2352c7e69 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:03:42.230938 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 01:03:42.245537 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac338200-c0bf-449f-8887-6b4802830a82 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff7cb78bcd91467abe5c2e2b48aedd1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f148d39ced534860abfbe8fc3f98ace4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:03:42.246253 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac338200-c0bf-449f-8887-6b4802830a82 service cinder] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:03:42.246909 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac338200-c0bf-449f-8887-6b4802830a82 service cinder] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:03:42.247507 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac338200-c0bf-449f-8887-6b4802830a82 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:03:42.249696 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-ac338200-c0bf-449f-8887-6b4802830a82 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:03:42.306329 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2506974b-a56c-4bc7-b985-4cd2352c7e69 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:03:42.308130 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2506974b-a56c-4bc7-b985-4cd2352c7e69 service cinder] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:03:42.320246 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1362/2753] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Oct 9 01:03:42 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 09 01:03:42.321828 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c56ef39-5070-444f-8403-74965675fc71 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:03:42.322252 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c56ef39-5070-444f-8403-74965675fc71 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:03:42.322695 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c56ef39-5070-444f-8403-74965675fc71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:03:42.352006 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac338200-c0bf-449f-8887-6b4802830a82 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:03:42.353651 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac338200-c0bf-449f-8887-6b4802830a82 service cinder] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:03:42.360594 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-0c56ef39-5070-444f-8403-74965675fc71 None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 01:03:42.363601 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-0c56ef39-5070-444f-8403-74965675fc71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:03:42.376550 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1392/2754] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Oct 9 01:03:42 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 09 01:03:42.496072 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1363/2755] 10.222.0.15 () {58 vars in 958 bytes} [Sun Oct 9 01:03:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 01:03:42.511584 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7a9bed-3eb7-4ca4-92d5-14377b2452ee None None] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:03:42.512035 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7a9bed-3eb7-4ca4-92d5-14377b2452ee None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:03:42.512553 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7a9bed-3eb7-4ca4-92d5-14377b2452ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:03:42.541725 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.auth.core [None req-2b7a9bed-3eb7-4ca4-92d5-14377b2452ee None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 01:03:42.543531 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-2b7a9bed-3eb7-4ca4-92d5-14377b2452ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:03:42.560509 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1393/2756] 10.222.0.15 () {58 vars in 958 bytes} [Sun Oct 9 01:03:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 09 01:03:42.566633 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c56ef39-5070-444f-8403-74965675fc71 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:03:42.583855 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c56ef39-5070-444f-8403-74965675fc71 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:03:42.593159 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838a0d3c-c176-46a6-81a2-1d566af95a84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:03:42.594122 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838a0d3c-c176-46a6-81a2-1d566af95a84 admin admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:03:42.594560 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838a0d3c-c176-46a6-81a2-1d566af95a84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:03:42.594998 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838a0d3c-c176-46a6-81a2-1d566af95a84 admin admin] PATH_INFO: `/v3/domains` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:03:42.596272 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838a0d3c-c176-46a6-81a2-1d566af95a84 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 01:03:42.596759 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838a0d3c-c176-46a6-81a2-1d566af95a84 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:03:42.599915 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838a0d3c-c176-46a6-81a2-1d566af95a84 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:03:42.624907 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1364/2757] 10.222.0.15 () {58 vars in 1153 bytes} [Sun Oct 9 01:03:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 01:03:42.632278 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7a9bed-3eb7-4ca4-92d5-14377b2452ee None None] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:03:42.652488 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7a9bed-3eb7-4ca4-92d5-14377b2452ee None None] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:03:42.660610 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f277b232-a735-4b2c-894f-34eeaca3ae0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:03:42.661106 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f277b232-a735-4b2c-894f-34eeaca3ae0b admin admin] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:03:42.661437 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f277b232-a735-4b2c-894f-34eeaca3ae0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:03:42.661905 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f277b232-a735-4b2c-894f-34eeaca3ae0b admin admin] PATH_INFO: `/v3/projects` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:03:42.663021 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f277b232-a735-4b2c-894f-34eeaca3ae0b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:03:42.666680 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f277b232-a735-4b2c-894f-34eeaca3ae0b admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:03:42.715195 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1394/2758] 10.222.0.15 () {60 vars in 1153 bytes} [Sun Oct 9 01:03:42 2022] POST /identity/v3/projects => generated 371 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 09 01:03:42.719361 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838a0d3c-c176-46a6-81a2-1d566af95a84 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:03:42.735522 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838a0d3c-c176-46a6-81a2-1d566af95a84 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:03:42.821971 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8ea5e3-3576-4fe4-a8c6-9e2b6fa363e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:03:42.823614 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8ea5e3-3576-4fe4-a8c6-9e2b6fa363e3 admin admin] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:03:42.823614 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8ea5e3-3576-4fe4-a8c6-9e2b6fa363e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:03:42.823614 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8ea5e3-3576-4fe4-a8c6-9e2b6fa363e3 admin admin] PATH_INFO: `/v3/users` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:03:42.824440 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8ea5e3-3576-4fe4-a8c6-9e2b6fa363e3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:03:42.826786 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8ea5e3-3576-4fe4-a8c6-9e2b6fa363e3 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:03:42.840837 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 01:03:42.882615 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1365/2759] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Oct 9 01:03:42 2022] POST /identity/v3/users => generated 286 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 09 01:03:42.883898 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f277b232-a735-4b2c-894f-34eeaca3ae0b admin admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:03:42.902313 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f277b232-a735-4b2c-894f-34eeaca3ae0b admin admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:03:42.909895 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7303d68-6bd7-4a7b-a980-c120203597c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:03:42.910617 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7303d68-6bd7-4a7b-a980-c120203597c3 admin admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:03:42.911013 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7303d68-6bd7-4a7b-a980-c120203597c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:03:42.911654 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7303d68-6bd7-4a7b-a980-c120203597c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:03:42.912434 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7303d68-6bd7-4a7b-a980-c120203597c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:03:42.914935 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7303d68-6bd7-4a7b-a980-c120203597c3 admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:03:42.931560 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1395/2760] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Oct 9 01:03:42 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 09 01:03:42.936352 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8ea5e3-3576-4fe4-a8c6-9e2b6fa363e3 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:03:42.950480 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8ea5e3-3576-4fe4-a8c6-9e2b6fa363e3 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:03:42.957049 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf5e38d-3fca-4dfd-8a12-5bae802daef2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:03:42.957996 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf5e38d-3fca-4dfd-8a12-5bae802daef2 admin admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:03:42.958413 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf5e38d-3fca-4dfd-8a12-5bae802daef2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:03:42.958800 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf5e38d-3fca-4dfd-8a12-5bae802daef2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:03:42.959769 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf5e38d-3fca-4dfd-8a12-5bae802daef2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:03:42.962135 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf5e38d-3fca-4dfd-8a12-5bae802daef2 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:03:42.979026 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1366/2761] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Oct 9 01:03:42 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 09 01:03:42.984072 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7303d68-6bd7-4a7b-a980-c120203597c3 admin admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:03:42.997272 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7303d68-6bd7-4a7b-a980-c120203597c3 admin admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:03:43.003850 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32297eea-53f0-4d7f-bc83-21e92e3efddd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:03:43.004598 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32297eea-53f0-4d7f-bc83-21e92e3efddd admin admin] REQUEST_METHOD: `PUT` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:03:43.004965 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32297eea-53f0-4d7f-bc83-21e92e3efddd admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:03:43.005365 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32297eea-53f0-4d7f-bc83-21e92e3efddd admin admin] PATH_INFO: `/v3/projects/bd654d4996f64022b9460f3b3076ee6d/users/f9cd4dfbcaa143c1a3f9c93b31129a22/roles/afb0a01183d9497795eaa4fa1a4046ae` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:03:43.025689 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32297eea-53f0-4d7f-bc83-21e92e3efddd admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd654d4996f64022b9460f3b3076ee6d, user_id=f9cd4dfbcaa143c1a3f9c93b31129a22, role_id=afb0a01183d9497795eaa4fa1a4046ae)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:03:43.028968 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32297eea-53f0-4d7f-bc83-21e92e3efddd admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:03:43.046424 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1396/2762] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Oct 9 01:03:42 2022] PUT /identity/v3/projects/bd654d4996f64022b9460f3b3076ee6d/users/f9cd4dfbcaa143c1a3f9c93b31129a22/roles/afb0a01183d9497795eaa4fa1a4046ae => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 01:03:43.052791 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea11d42a-33e0-47fc-8c07-4dc215c40fd3 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:03:43.053616 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea11d42a-33e0-47fc-8c07-4dc215c40fd3 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:03:43.053616 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea11d42a-33e0-47fc-8c07-4dc215c40fd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:03:43.080162 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-ea11d42a-33e0-47fc-8c07-4dc215c40fd3 None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 01:03:43.081809 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-ea11d42a-33e0-47fc-8c07-4dc215c40fd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:03:43.165134 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1367/2763] 10.222.0.15 () {58 vars in 958 bytes} [Sun Oct 9 01:03:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 01:03:43.176463 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32297eea-53f0-4d7f-bc83-21e92e3efddd admin admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:03:43.179746 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-32297eea-53f0-4d7f-bc83-21e92e3efddd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:03:43.286074 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32297eea-53f0-4d7f-bc83-21e92e3efddd admin admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:03:43.290804 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad125c0-5b1c-4e0a-bc5f-e5d5aabafc71 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4ef90d456d2483e8ddafbe2d4d4fb5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f148d39ced534860abfbe8fc3f98ace4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:03:43.291605 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad125c0-5b1c-4e0a-bc5f-e5d5aabafc71 service neutron] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:03:43.292057 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad125c0-5b1c-4e0a-bc5f-e5d5aabafc71 service neutron] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:03:43.292521 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad125c0-5b1c-4e0a-bc5f-e5d5aabafc71 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:03:43.308303 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad125c0-5b1c-4e0a-bc5f-e5d5aabafc71 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:03:43.310857 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad125c0-5b1c-4e0a-bc5f-e5d5aabafc71 service neutron] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:03:43.326462 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1397/2764] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Oct 9 01:03:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 09 01:03:44.555698 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602d764a-8283-4b6a-a2e0-f9fbcec874ce None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:03:44.556558 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602d764a-8283-4b6a-a2e0-f9fbcec874ce None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:03:44.556558 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602d764a-8283-4b6a-a2e0-f9fbcec874ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:03:44.589123 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-602d764a-8283-4b6a-a2e0-f9fbcec874ce None None] MFA Rules not processed for user `f9cd4dfbcaa143c1a3f9c93b31129a22`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 01:03:44.590589 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-602d764a-8283-4b6a-a2e0-f9fbcec874ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:03:44.681385 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1368/2765] 10.222.0.15 () {58 vars in 958 bytes} [Sun Oct 9 01:03:44 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 01:03:44.698890 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad125c0-5b1c-4e0a-bc5f-e5d5aabafc71 service neutron] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:03:44.701982 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-dad125c0-5b1c-4e0a-bc5f-e5d5aabafc71 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:03:44.771427 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 01:03:44.813373 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad125c0-5b1c-4e0a-bc5f-e5d5aabafc71 service neutron] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:03:44.817418 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f03be12-5cb9-4168-886f-2884a5d4946d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff7cb78bcd91467abe5c2e2b48aedd1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f148d39ced534860abfbe8fc3f98ace4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:03:44.818047 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f03be12-5cb9-4168-886f-2884a5d4946d service cinder] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:03:44.818327 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f03be12-5cb9-4168-886f-2884a5d4946d service cinder] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:03:44.818600 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f03be12-5cb9-4168-886f-2884a5d4946d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:03:44.828481 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f03be12-5cb9-4168-886f-2884a5d4946d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:03:44.830161 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f03be12-5cb9-4168-886f-2884a5d4946d service cinder] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:03:44.843792 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1398/2766] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Oct 9 01:03:44 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 09 01:03:45.318469 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602d764a-8283-4b6a-a2e0-f9fbcec874ce None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:03:45.320786 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-602d764a-8283-4b6a-a2e0-f9fbcec874ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:03:45.341160 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602d764a-8283-4b6a-a2e0-f9fbcec874ce None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:03:45.350283 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c726480-9a83-4d4a-a5fc-0883e9b6f6e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:03:45.352090 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c726480-9a83-4d4a-a5fc-0883e9b6f6e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:03:45.352090 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c726480-9a83-4d4a-a5fc-0883e9b6f6e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:03:45.352432 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c726480-9a83-4d4a-a5fc-0883e9b6f6e6 admin admin] PATH_INFO: `/v3/users/e04a81a9706a40c591944a330b49b317` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:03:45.353835 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c726480-9a83-4d4a-a5fc-0883e9b6f6e6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e04a81a9706a40c591944a330b49b317)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:03:45.357623 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c726480-9a83-4d4a-a5fc-0883e9b6f6e6 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:03:45.419566 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-3c726480-9a83-4d4a-a5fc-0883e9b6f6e6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e04a81a9706a40c591944a330b49b317'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:03:45.429390 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-3c726480-9a83-4d4a-a5fc-0883e9b6f6e6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e04a81a9706a40c591944a330b49b317'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:03:45.430409 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-3c726480-9a83-4d4a-a5fc-0883e9b6f6e6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e04a81a9706a40c591944a330b49b317'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:03:45.431156 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-3c726480-9a83-4d4a-a5fc-0883e9b6f6e6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e04a81a9706a40c591944a330b49b317'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:03:45.443864 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-3c726480-9a83-4d4a-a5fc-0883e9b6f6e6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e04a81a9706a40c591944a330b49b317'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:03:45.453445 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:INSERT=2,keystone:SELECT=90,keystone:DELETE=8 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 01:03:45.477276 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1369/2767] 10.222.0.15 () {58 vars in 1224 bytes} [Sun Oct 9 01:03:45 2022] DELETE /identity/v3/users/e04a81a9706a40c591944a330b49b317 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 01:03:45.482912 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b48b694-0733-4071-a11c-8ed84bd6d1e7 None None] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:03:45.484056 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b48b694-0733-4071-a11c-8ed84bd6d1e7 None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:03:45.484473 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b48b694-0733-4071-a11c-8ed84bd6d1e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:03:45.511473 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.auth.core [None req-9b48b694-0733-4071-a11c-8ed84bd6d1e7 None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 01:03:45.513512 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-9b48b694-0733-4071-a11c-8ed84bd6d1e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:03:45.619349 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1399/2768] 10.222.0.15 () {58 vars in 958 bytes} [Sun Oct 9 01:03:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 01:03:45.635036 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c726480-9a83-4d4a-a5fc-0883e9b6f6e6 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:03:45.637825 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-3c726480-9a83-4d4a-a5fc-0883e9b6f6e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:03:45.757854 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c726480-9a83-4d4a-a5fc-0883e9b6f6e6 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:03:45.765546 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b20efc-c0d2-43a4-a653-efc08c3db758 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4ef90d456d2483e8ddafbe2d4d4fb5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f148d39ced534860abfbe8fc3f98ace4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:03:45.766684 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b20efc-c0d2-43a4-a653-efc08c3db758 service neutron] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:03:45.767160 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b20efc-c0d2-43a4-a653-efc08c3db758 service neutron] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:03:45.767674 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b20efc-c0d2-43a4-a653-efc08c3db758 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:03:45.782905 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b20efc-c0d2-43a4-a653-efc08c3db758 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:03:45.784883 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b20efc-c0d2-43a4-a653-efc08c3db758 service neutron] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:03:45.803124 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1370/2769] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Oct 9 01:03:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 09 01:03:46.231372 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b48b694-0733-4071-a11c-8ed84bd6d1e7 None None] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:03:46.233435 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-9b48b694-0733-4071-a11c-8ed84bd6d1e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:03:46.277638 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b48b694-0733-4071-a11c-8ed84bd6d1e7 None None] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:03:46.284856 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07618a97-e3a4-4de3-a407-286eb0d7b868 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:03:46.285847 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07618a97-e3a4-4de3-a407-286eb0d7b868 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:03:46.286294 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07618a97-e3a4-4de3-a407-286eb0d7b868 admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:03:46.287056 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07618a97-e3a4-4de3-a407-286eb0d7b868 admin admin] PATH_INFO: `/v3/projects/ae003bb73c334ae5b301661278ed1145` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:03:46.288841 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07618a97-e3a4-4de3-a407-286eb0d7b868 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ae003bb73c334ae5b301661278ed1145)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:03:46.291666 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07618a97-e3a4-4de3-a407-286eb0d7b868 admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:03:46.343315 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eda359f-76e0-410c-8b05-9cc3395d3e92 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:03:46.343739 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eda359f-76e0-410c-8b05-9cc3395d3e92 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:03:46.344475 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eda359f-76e0-410c-8b05-9cc3395d3e92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:03:46.378602 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-9eda359f-76e0-410c-8b05-9cc3395d3e92 None None] MFA Rules not processed for user `f9cd4dfbcaa143c1a3f9c93b31129a22`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 01:03:46.380659 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-9eda359f-76e0-410c-8b05-9cc3395d3e92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:03:46.386434 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-07618a97-e3a4-4de3-a407-286eb0d7b868 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ae003bb73c334ae5b301661278ed1145', 'request_id': 'req-07618a97-e3a4-4de3-a407-286eb0d7b868'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:03:46.405053 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-07618a97-e3a4-4de3-a407-286eb0d7b868 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ae003bb73c334ae5b301661278ed1145', 'request_id': 'req-07618a97-e3a4-4de3-a407-286eb0d7b868'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:03:46.419655 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-07618a97-e3a4-4de3-a407-286eb0d7b868 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ae003bb73c334ae5b301661278ed1145', 'request_id': 'req-07618a97-e3a4-4de3-a407-286eb0d7b868'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:03:46.442266 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-07618a97-e3a4-4de3-a407-286eb0d7b868 admin admin] The token cache is being invalidate because project ae003bb73c334ae5b301661278ed1145 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81525) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 09 01:03:46.442776 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-07618a97-e3a4-4de3-a407-286eb0d7b868 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:03:46.444281 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-07618a97-e3a4-4de3-a407-286eb0d7b868 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:03:46.451199 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1400/2770] 10.222.0.15 () {58 vars in 1233 bytes} [Sun Oct 9 01:03:46 2022] DELETE /identity/v3/projects/ae003bb73c334ae5b301661278ed1145 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 01:03:46.453833 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07618a97-e3a4-4de3-a407-286eb0d7b868 admin admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:03:46.456397 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-07618a97-e3a4-4de3-a407-286eb0d7b868 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:03:46.499543 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1371/2771] 10.222.0.15 () {58 vars in 958 bytes} [Sun Oct 9 01:03:46 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 09 01:03:46.557600 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 01:03:46.564898 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07618a97-e3a4-4de3-a407-286eb0d7b868 admin admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:03:46.573945 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2e7342-1506-4920-b7ef-c8e59161d15b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:03:46.575119 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2e7342-1506-4920-b7ef-c8e59161d15b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:03:46.576147 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2e7342-1506-4920-b7ef-c8e59161d15b admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:03:46.576731 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2e7342-1506-4920-b7ef-c8e59161d15b admin admin] PATH_INFO: `/v3/users/5823ac9b75a44d1487fd14db18bb8f13` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:03:46.579117 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2e7342-1506-4920-b7ef-c8e59161d15b admin admin] RBAC: Authorizing `identity:delete_user(user_id=5823ac9b75a44d1487fd14db18bb8f13)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:03:46.585048 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2e7342-1506-4920-b7ef-c8e59161d15b admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:03:46.673203 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-6d2e7342-1506-4920-b7ef-c8e59161d15b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5823ac9b75a44d1487fd14db18bb8f13'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:03:46.687476 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-6d2e7342-1506-4920-b7ef-c8e59161d15b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5823ac9b75a44d1487fd14db18bb8f13'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:03:46.688717 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-6d2e7342-1506-4920-b7ef-c8e59161d15b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5823ac9b75a44d1487fd14db18bb8f13'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:03:46.689745 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-6d2e7342-1506-4920-b7ef-c8e59161d15b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5823ac9b75a44d1487fd14db18bb8f13'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:03:46.704197 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-6d2e7342-1506-4920-b7ef-c8e59161d15b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5823ac9b75a44d1487fd14db18bb8f13'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:03:46.739297 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1401/2772] 10.222.0.15 () {58 vars in 1224 bytes} [Sun Oct 9 01:03:46 2022] DELETE /identity/v3/users/5823ac9b75a44d1487fd14db18bb8f13 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 01:03:47.352351 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eda359f-76e0-410c-8b05-9cc3395d3e92 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:03:47.377397 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eda359f-76e0-410c-8b05-9cc3395d3e92 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:03:47.549942 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28895d2-37f6-4307-a9a7-4ca3ea3f6c5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:03:47.552011 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28895d2-37f6-4307-a9a7-4ca3ea3f6c5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:03:47.552504 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28895d2-37f6-4307-a9a7-4ca3ea3f6c5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:03:47.553024 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28895d2-37f6-4307-a9a7-4ca3ea3f6c5f admin admin] PATH_INFO: `/v3/projects/7965432abb73409c8bf8161da888ba43` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:03:47.555876 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28895d2-37f6-4307-a9a7-4ca3ea3f6c5f admin admin] RBAC: Authorizing `identity:delete_project(project_id=7965432abb73409c8bf8161da888ba43)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:03:47.560236 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28895d2-37f6-4307-a9a7-4ca3ea3f6c5f admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:03:47.638764 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:DELETE=4,keystone:SELECT=96 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 01:03:47.668963 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-f28895d2-37f6-4307-a9a7-4ca3ea3f6c5f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7965432abb73409c8bf8161da888ba43', 'request_id': 'req-f28895d2-37f6-4307-a9a7-4ca3ea3f6c5f'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:03:47.690211 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-f28895d2-37f6-4307-a9a7-4ca3ea3f6c5f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7965432abb73409c8bf8161da888ba43', 'request_id': 'req-f28895d2-37f6-4307-a9a7-4ca3ea3f6c5f'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:03:47.712381 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-f28895d2-37f6-4307-a9a7-4ca3ea3f6c5f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7965432abb73409c8bf8161da888ba43', 'request_id': 'req-f28895d2-37f6-4307-a9a7-4ca3ea3f6c5f'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:03:47.737442 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-f28895d2-37f6-4307-a9a7-4ca3ea3f6c5f admin admin] The token cache is being invalidate because project 7965432abb73409c8bf8161da888ba43 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81524) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 09 01:03:47.738674 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-f28895d2-37f6-4307-a9a7-4ca3ea3f6c5f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:03:47.740400 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-f28895d2-37f6-4307-a9a7-4ca3ea3f6c5f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:03:47.745211 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1372/2773] 10.222.0.15 () {58 vars in 1233 bytes} [Sun Oct 9 01:03:47 2022] DELETE /identity/v3/projects/7965432abb73409c8bf8161da888ba43 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 09 01:03:47.751222 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4eaa90-f70a-4312-82db-4b35faa51e10 None None] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:03:47.752661 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4eaa90-f70a-4312-82db-4b35faa51e10 None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:03:47.753396 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4eaa90-f70a-4312-82db-4b35faa51e10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:03:47.790104 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.auth.core [None req-fa4eaa90-f70a-4312-82db-4b35faa51e10 None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 01:03:47.792269 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-fa4eaa90-f70a-4312-82db-4b35faa51e10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:03:47.895164 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1402/2774] 10.222.0.15 () {58 vars in 958 bytes} [Sun Oct 9 01:03:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 09 01:03:47.908490 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92ea010-0321-429b-babf-3ad1dce11535 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:03:47.910354 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92ea010-0321-429b-babf-3ad1dce11535 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:03:47.910875 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92ea010-0321-429b-babf-3ad1dce11535 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:03:47.940048 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-e92ea010-0321-429b-babf-3ad1dce11535 None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 01:03:47.941575 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-e92ea010-0321-429b-babf-3ad1dce11535 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:03:47.951822 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1373/2775] 10.222.0.15 () {58 vars in 958 bytes} [Sun Oct 9 01:03:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 01:03:47.957407 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4eaa90-f70a-4312-82db-4b35faa51e10 None None] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:03:47.974479 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4eaa90-f70a-4312-82db-4b35faa51e10 None None] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:03:47.981756 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58023d29-81e8-4f1c-bbb1-bd3e24f6425d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:03:47.982676 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58023d29-81e8-4f1c-bbb1-bd3e24f6425d admin admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:03:47.983089 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58023d29-81e8-4f1c-bbb1-bd3e24f6425d admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:03:47.983535 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58023d29-81e8-4f1c-bbb1-bd3e24f6425d admin admin] PATH_INFO: `/v3/domains` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:03:47.984568 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58023d29-81e8-4f1c-bbb1-bd3e24f6425d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 01:03:47.985017 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58023d29-81e8-4f1c-bbb1-bd3e24f6425d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:03:47.988078 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58023d29-81e8-4f1c-bbb1-bd3e24f6425d admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:03:48.009709 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1403/2776] 10.222.0.15 () {58 vars in 1153 bytes} [Sun Oct 9 01:03:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 01:03:48.015411 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92ea010-0321-429b-babf-3ad1dce11535 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:03:48.031568 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92ea010-0321-429b-babf-3ad1dce11535 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:03:48.039665 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865790a1-03fe-4121-aebd-93ff7a2ddd0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:03:48.040603 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865790a1-03fe-4121-aebd-93ff7a2ddd0a admin admin] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:03:48.041021 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865790a1-03fe-4121-aebd-93ff7a2ddd0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:03:48.041447 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865790a1-03fe-4121-aebd-93ff7a2ddd0a admin admin] PATH_INFO: `/v3/projects` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:03:48.042621 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865790a1-03fe-4121-aebd-93ff7a2ddd0a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:03:48.046458 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865790a1-03fe-4121-aebd-93ff7a2ddd0a admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:03:48.101690 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1374/2777] 10.222.0.15 () {60 vars in 1153 bytes} [Sun Oct 9 01:03:48 2022] POST /identity/v3/projects => generated 385 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 09 01:03:48.103449 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58023d29-81e8-4f1c-bbb1-bd3e24f6425d admin admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:03:48.120433 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58023d29-81e8-4f1c-bbb1-bd3e24f6425d admin admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:03:48.214079 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca92d4c8-496e-4fde-a8af-88bcbc9d8833 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:03:48.214719 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca92d4c8-496e-4fde-a8af-88bcbc9d8833 admin admin] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:03:48.214995 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca92d4c8-496e-4fde-a8af-88bcbc9d8833 admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:03:48.215246 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca92d4c8-496e-4fde-a8af-88bcbc9d8833 admin admin] PATH_INFO: `/v3/users` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:03:48.215939 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca92d4c8-496e-4fde-a8af-88bcbc9d8833 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:03:48.217955 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca92d4c8-496e-4fde-a8af-88bcbc9d8833 admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:03:48.230058 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 01:03:48.249205 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1404/2778] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Oct 9 01:03:48 2022] POST /identity/v3/users => generated 293 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 09 01:03:48.253707 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865790a1-03fe-4121-aebd-93ff7a2ddd0a admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:03:48.266947 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865790a1-03fe-4121-aebd-93ff7a2ddd0a admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:03:48.273660 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb3738a-3421-442a-8fe1-d2c14107feee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:03:48.274252 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb3738a-3421-442a-8fe1-d2c14107feee admin admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:03:48.274490 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb3738a-3421-442a-8fe1-d2c14107feee admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:03:48.274756 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb3738a-3421-442a-8fe1-d2c14107feee admin admin] PATH_INFO: `/v3/roles` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:03:48.275448 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb3738a-3421-442a-8fe1-d2c14107feee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:03:48.277112 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb3738a-3421-442a-8fe1-d2c14107feee admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:03:48.290200 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1375/2779] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Oct 9 01:03:48 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 09 01:03:48.296635 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca92d4c8-496e-4fde-a8af-88bcbc9d8833 admin admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:03:48.313631 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca92d4c8-496e-4fde-a8af-88bcbc9d8833 admin admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:03:48.321297 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5707c9-4332-4ed8-a7a7-2f5cd4c6eb58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:03:48.322307 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5707c9-4332-4ed8-a7a7-2f5cd4c6eb58 admin admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:03:48.322806 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5707c9-4332-4ed8-a7a7-2f5cd4c6eb58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:03:48.323294 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5707c9-4332-4ed8-a7a7-2f5cd4c6eb58 admin admin] PATH_INFO: `/v3/roles` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:03:48.324717 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5707c9-4332-4ed8-a7a7-2f5cd4c6eb58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:03:48.328232 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5707c9-4332-4ed8-a7a7-2f5cd4c6eb58 admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:03:48.344225 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1405/2780] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Oct 9 01:03:48 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 09 01:03:48.351461 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb3738a-3421-442a-8fe1-d2c14107feee admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:03:48.369884 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb3738a-3421-442a-8fe1-d2c14107feee admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:03:48.377669 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d8aaa8-b583-4ca6-a6be-8df3532f19da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:03:48.378773 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d8aaa8-b583-4ca6-a6be-8df3532f19da admin admin] REQUEST_METHOD: `PUT` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:03:48.379249 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d8aaa8-b583-4ca6-a6be-8df3532f19da admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:03:48.379726 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d8aaa8-b583-4ca6-a6be-8df3532f19da admin admin] PATH_INFO: `/v3/projects/546d76bf6b4b48d8ada49caac24c4084/users/b252aaff80ea498baaa1ad83e6c4fc1a/roles/afb0a01183d9497795eaa4fa1a4046ae` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:03:48.407475 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d8aaa8-b583-4ca6-a6be-8df3532f19da admin admin] RBAC: Authorizing `identity:create_grant(project_id=546d76bf6b4b48d8ada49caac24c4084, user_id=b252aaff80ea498baaa1ad83e6c4fc1a, role_id=afb0a01183d9497795eaa4fa1a4046ae)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:03:48.412666 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d8aaa8-b583-4ca6-a6be-8df3532f19da admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:03:48.437199 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1376/2781] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Oct 9 01:03:48 2022] PUT /identity/v3/projects/546d76bf6b4b48d8ada49caac24c4084/users/b252aaff80ea498baaa1ad83e6c4fc1a/roles/afb0a01183d9497795eaa4fa1a4046ae => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 09 01:03:48.451619 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49aee5b-6d8e-45ec-9dee-44063ec2967b None None] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:03:48.452117 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49aee5b-6d8e-45ec-9dee-44063ec2967b None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:03:48.452586 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49aee5b-6d8e-45ec-9dee-44063ec2967b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:03:48.495840 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.auth.core [None req-e49aee5b-6d8e-45ec-9dee-44063ec2967b None None] MFA Rules not processed for user `b252aaff80ea498baaa1ad83e6c4fc1a`. Rule list: `[]` (Enabled: `True`). {{(pid=81525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 01:03:48.497524 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-e49aee5b-6d8e-45ec-9dee-44063ec2967b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:03:48.595033 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1406/2782] 10.222.0.15 () {58 vars in 958 bytes} [Sun Oct 9 01:03:48 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 01:03:48.602198 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d8aaa8-b583-4ca6-a6be-8df3532f19da admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:03:48.717407 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d8aaa8-b583-4ca6-a6be-8df3532f19da admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:03:48.728742 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a630f6f8-96e0-4a82-bde2-c7694ac0e0df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:03:48.729464 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a630f6f8-96e0-4a82-bde2-c7694ac0e0df admin admin] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:03:48.729874 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a630f6f8-96e0-4a82-bde2-c7694ac0e0df admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:03:48.730272 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a630f6f8-96e0-4a82-bde2-c7694ac0e0df admin admin] PATH_INFO: `/v3/projects` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:03:48.731034 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a630f6f8-96e0-4a82-bde2-c7694ac0e0df admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:03:48.733179 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a630f6f8-96e0-4a82-bde2-c7694ac0e0df admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:03:48.765411 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1377/2783] 10.222.0.15 () {60 vars in 1153 bytes} [Sun Oct 9 01:03:48 2022] POST /identity/v3/projects => generated 385 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 09 01:03:48.769969 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49aee5b-6d8e-45ec-9dee-44063ec2967b None None] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:03:48.782725 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49aee5b-6d8e-45ec-9dee-44063ec2967b None None] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:03:48.859792 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf4cfde-ed38-4ef9-9456-c8d2be5cbcd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:03:48.860464 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf4cfde-ed38-4ef9-9456-c8d2be5cbcd9 admin admin] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:03:48.860713 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf4cfde-ed38-4ef9-9456-c8d2be5cbcd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:03:48.860981 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf4cfde-ed38-4ef9-9456-c8d2be5cbcd9 admin admin] PATH_INFO: `/v3/users` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:03:48.861655 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf4cfde-ed38-4ef9-9456-c8d2be5cbcd9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:03:48.864470 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf4cfde-ed38-4ef9-9456-c8d2be5cbcd9 admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:03:48.893765 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1407/2784] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Oct 9 01:03:48 2022] POST /identity/v3/users => generated 293 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 09 01:03:48.899992 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a630f6f8-96e0-4a82-bde2-c7694ac0e0df admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:03:48.921787 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a630f6f8-96e0-4a82-bde2-c7694ac0e0df admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:03:48.929932 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842702ef-2103-433f-9b3a-2738d54eea85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:03:48.931689 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842702ef-2103-433f-9b3a-2738d54eea85 admin admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:03:48.932377 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842702ef-2103-433f-9b3a-2738d54eea85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:03:48.933059 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842702ef-2103-433f-9b3a-2738d54eea85 admin admin] PATH_INFO: `/v3/roles` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:03:48.934014 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842702ef-2103-433f-9b3a-2738d54eea85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:03:48.936520 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842702ef-2103-433f-9b3a-2738d54eea85 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:03:48.958886 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1378/2785] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Oct 9 01:03:48 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 09 01:03:48.963866 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf4cfde-ed38-4ef9-9456-c8d2be5cbcd9 admin admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:03:48.989639 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf4cfde-ed38-4ef9-9456-c8d2be5cbcd9 admin admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:03:49.006798 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc30bd1-f581-49fa-814a-b7e6bf022943 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:03:49.008514 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc30bd1-f581-49fa-814a-b7e6bf022943 admin admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:03:49.009875 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc30bd1-f581-49fa-814a-b7e6bf022943 admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:03:49.011217 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc30bd1-f581-49fa-814a-b7e6bf022943 admin admin] PATH_INFO: `/v3/roles` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:03:49.013680 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc30bd1-f581-49fa-814a-b7e6bf022943 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:03:49.018027 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc30bd1-f581-49fa-814a-b7e6bf022943 admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:03:49.049867 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1408/2786] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Oct 9 01:03:48 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 09 01:03:49.055936 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842702ef-2103-433f-9b3a-2738d54eea85 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:03:49.087750 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842702ef-2103-433f-9b3a-2738d54eea85 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:03:49.097824 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48671bb-31e5-4417-aff8-c32432ec2a1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:03:49.099423 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48671bb-31e5-4417-aff8-c32432ec2a1f admin admin] REQUEST_METHOD: `PUT` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:03:49.099996 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48671bb-31e5-4417-aff8-c32432ec2a1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:03:49.100746 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48671bb-31e5-4417-aff8-c32432ec2a1f admin admin] PATH_INFO: `/v3/projects/9aca8362908d444c847205c603e49f9a/users/d2f00aafe22240d8a12f441031500744/roles/afb0a01183d9497795eaa4fa1a4046ae` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:03:49.136423 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48671bb-31e5-4417-aff8-c32432ec2a1f admin admin] RBAC: Authorizing `identity:create_grant(project_id=9aca8362908d444c847205c603e49f9a, user_id=d2f00aafe22240d8a12f441031500744, role_id=afb0a01183d9497795eaa4fa1a4046ae)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:03:49.142219 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48671bb-31e5-4417-aff8-c32432ec2a1f admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:03:49.180893 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1379/2787] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Oct 9 01:03:49 2022] PUT /identity/v3/projects/9aca8362908d444c847205c603e49f9a/users/d2f00aafe22240d8a12f441031500744/roles/afb0a01183d9497795eaa4fa1a4046ae => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 01:03:49.200145 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83ecb9a-86b4-43ff-b216-1e63aa9ff9c4 None None] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:03:49.200586 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83ecb9a-86b4-43ff-b216-1e63aa9ff9c4 None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:03:49.201072 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83ecb9a-86b4-43ff-b216-1e63aa9ff9c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:03:49.261464 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.auth.core [None req-b83ecb9a-86b4-43ff-b216-1e63aa9ff9c4 None None] MFA Rules not processed for user `d2f00aafe22240d8a12f441031500744`. Rule list: `[]` (Enabled: `True`). {{(pid=81525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 01:03:49.264354 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-b83ecb9a-86b4-43ff-b216-1e63aa9ff9c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:03:49.332259 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 01:03:49.367708 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1409/2788] 10.222.0.15 () {58 vars in 958 bytes} [Sun Oct 9 01:03:49 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 01:03:49.374781 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48671bb-31e5-4417-aff8-c32432ec2a1f admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:03:49.388590 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:DELETE=5,keystone:SELECT=90,keystone:INSERT=5 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 01:03:49.493523 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48671bb-31e5-4417-aff8-c32432ec2a1f admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:03:49.500934 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4008dd-176a-41fd-a695-b1eb0768f701 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:03:49.501895 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4008dd-176a-41fd-a695-b1eb0768f701 admin admin] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:03:49.502294 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4008dd-176a-41fd-a695-b1eb0768f701 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:03:49.502827 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4008dd-176a-41fd-a695-b1eb0768f701 admin admin] PATH_INFO: `/v3/projects` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:03:49.503733 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4008dd-176a-41fd-a695-b1eb0768f701 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:03:49.506176 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4008dd-176a-41fd-a695-b1eb0768f701 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:03:49.544838 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1380/2789] 10.222.0.15 () {60 vars in 1153 bytes} [Sun Oct 9 01:03:49 2022] POST /identity/v3/projects => generated 385 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 09 01:03:49.549883 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83ecb9a-86b4-43ff-b216-1e63aa9ff9c4 None None] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:03:49.566352 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83ecb9a-86b4-43ff-b216-1e63aa9ff9c4 None None] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:03:49.664083 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe0727e-2572-48e4-8918-87c839e2f5e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:03:49.665164 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe0727e-2572-48e4-8918-87c839e2f5e4 admin admin] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:03:49.665642 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe0727e-2572-48e4-8918-87c839e2f5e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:03:49.666118 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe0727e-2572-48e4-8918-87c839e2f5e4 admin admin] PATH_INFO: `/v3/users` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:03:49.667397 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe0727e-2572-48e4-8918-87c839e2f5e4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:03:49.670950 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe0727e-2572-48e4-8918-87c839e2f5e4 admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:03:49.704932 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1410/2790] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Oct 9 01:03:49 2022] POST /identity/v3/users => generated 299 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 09 01:03:49.710779 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4008dd-176a-41fd-a695-b1eb0768f701 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:03:49.724557 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4008dd-176a-41fd-a695-b1eb0768f701 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:03:49.730754 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1bc4a8-8fdc-4afc-927b-434c9b43fcb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:03:49.731434 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1bc4a8-8fdc-4afc-927b-434c9b43fcb3 admin admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:03:49.731711 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1bc4a8-8fdc-4afc-927b-434c9b43fcb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:03:49.731981 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1bc4a8-8fdc-4afc-927b-434c9b43fcb3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:03:49.732649 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1bc4a8-8fdc-4afc-927b-434c9b43fcb3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:03:49.734319 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1bc4a8-8fdc-4afc-927b-434c9b43fcb3 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:03:49.756436 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1381/2791] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Oct 9 01:03:49 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 09 01:03:49.763070 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe0727e-2572-48e4-8918-87c839e2f5e4 admin admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:03:49.787641 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe0727e-2572-48e4-8918-87c839e2f5e4 admin admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:03:49.795830 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f060f7ac-9264-4fbd-bdd5-ea4822787401 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:03:49.797127 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f060f7ac-9264-4fbd-bdd5-ea4822787401 admin admin] REQUEST_METHOD: `PUT` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:03:49.797556 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f060f7ac-9264-4fbd-bdd5-ea4822787401 admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:03:49.797976 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f060f7ac-9264-4fbd-bdd5-ea4822787401 admin admin] PATH_INFO: `/v3/projects/873e301649aa4425b635da3c5b20815b/users/6c93052a226e461b9353800c5b2172a2/roles/f69dddf26daf4dd79d4c962beb877af5` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:03:49.829922 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f060f7ac-9264-4fbd-bdd5-ea4822787401 admin admin] RBAC: Authorizing `identity:create_grant(project_id=873e301649aa4425b635da3c5b20815b, user_id=6c93052a226e461b9353800c5b2172a2, role_id=f69dddf26daf4dd79d4c962beb877af5)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:03:49.835132 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f060f7ac-9264-4fbd-bdd5-ea4822787401 admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:03:49.860409 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1411/2792] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Oct 9 01:03:49 2022] PUT /identity/v3/projects/873e301649aa4425b635da3c5b20815b/users/6c93052a226e461b9353800c5b2172a2/roles/f69dddf26daf4dd79d4c962beb877af5 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 01:03:49.866419 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1bc4a8-8fdc-4afc-927b-434c9b43fcb3 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:03:49.880158 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1bc4a8-8fdc-4afc-927b-434c9b43fcb3 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:03:49.995840 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd2635a-46ba-46a8-bdd5-840ebc0eef32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:03:49.996643 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd2635a-46ba-46a8-bdd5-840ebc0eef32 admin admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:03:49.996845 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd2635a-46ba-46a8-bdd5-840ebc0eef32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:03:49.997134 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd2635a-46ba-46a8-bdd5-840ebc0eef32 admin admin] PATH_INFO: `/v3/roles` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:03:49.997755 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd2635a-46ba-46a8-bdd5-840ebc0eef32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:03:49.999618 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd2635a-46ba-46a8-bdd5-840ebc0eef32 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:03:50.018751 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1382/2793] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Oct 9 01:03:49 2022] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 09 01:03:50.021974 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f060f7ac-9264-4fbd-bdd5-ea4822787401 admin admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:03:50.045820 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f060f7ac-9264-4fbd-bdd5-ea4822787401 admin admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:03:50.056067 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ae3635-42f6-42b7-96bd-bcf99525d710 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:03:50.057438 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ae3635-42f6-42b7-96bd-bcf99525d710 admin admin] REQUEST_METHOD: `PUT` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:03:50.058038 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ae3635-42f6-42b7-96bd-bcf99525d710 admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:03:50.058591 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ae3635-42f6-42b7-96bd-bcf99525d710 admin admin] PATH_INFO: `/v3/projects/873e301649aa4425b635da3c5b20815b/users/6c93052a226e461b9353800c5b2172a2/roles/f69dddf26daf4dd79d4c962beb877af5` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:03:50.061612 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ae3635-42f6-42b7-96bd-bcf99525d710 admin admin] RBAC: Authorizing `identity:create_grant(project_id=873e301649aa4425b635da3c5b20815b, user_id=6c93052a226e461b9353800c5b2172a2, role_id=f69dddf26daf4dd79d4c962beb877af5)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:03:50.066857 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ae3635-42f6-42b7-96bd-bcf99525d710 admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:03:50.087014 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1412/2794] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Oct 9 01:03:50 2022] PUT /identity/v3/projects/873e301649aa4425b635da3c5b20815b/users/6c93052a226e461b9353800c5b2172a2/roles/f69dddf26daf4dd79d4c962beb877af5 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 01:03:50.104716 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffaa6cc-6bac-4135-bc0e-3dd46e43d609 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:03:50.105140 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffaa6cc-6bac-4135-bc0e-3dd46e43d609 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:03:50.105530 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffaa6cc-6bac-4135-bc0e-3dd46e43d609 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:03:50.145059 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-0ffaa6cc-6bac-4135-bc0e-3dd46e43d609 None None] MFA Rules not processed for user `6c93052a226e461b9353800c5b2172a2`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 01:03:50.146705 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-0ffaa6cc-6bac-4135-bc0e-3dd46e43d609 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:03:50.253150 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1383/2795] 10.222.0.15 () {58 vars in 958 bytes} [Sun Oct 9 01:03:50 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 01:03:50.271892 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ae3635-42f6-42b7-96bd-bcf99525d710 admin admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:03:50.275337 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-08ae3635-42f6-42b7-96bd-bcf99525d710 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:03:50.386349 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ae3635-42f6-42b7-96bd-bcf99525d710 admin admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:03:50.392145 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df6b3ff-0d4a-460a-a002-e49f6b5b2e28 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff7cb78bcd91467abe5c2e2b48aedd1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f148d39ced534860abfbe8fc3f98ace4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:03:50.393693 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df6b3ff-0d4a-460a-a002-e49f6b5b2e28 service cinder] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:03:50.393693 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df6b3ff-0d4a-460a-a002-e49f6b5b2e28 service cinder] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:03:50.394148 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df6b3ff-0d4a-460a-a002-e49f6b5b2e28 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:03:50.490724 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 01:03:50.515365 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df6b3ff-0d4a-460a-a002-e49f6b5b2e28 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:03:50.518682 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df6b3ff-0d4a-460a-a002-e49f6b5b2e28 service cinder] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:03:50.535065 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1413/2796] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Oct 9 01:03:50 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 09 01:03:52.460186 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffaa6cc-6bac-4135-bc0e-3dd46e43d609 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:03:52.462578 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-0ffaa6cc-6bac-4135-bc0e-3dd46e43d609 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:03:52.481321 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 01:03:52.488249 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffaa6cc-6bac-4135-bc0e-3dd46e43d609 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:03:52.495246 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be382c64-2432-41fc-9368-70da04c1b827 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff7cb78bcd91467abe5c2e2b48aedd1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f148d39ced534860abfbe8fc3f98ace4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:03:52.496915 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be382c64-2432-41fc-9368-70da04c1b827 service cinder] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:03:52.497478 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be382c64-2432-41fc-9368-70da04c1b827 service cinder] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:03:52.497899 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be382c64-2432-41fc-9368-70da04c1b827 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:03:52.606547 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be382c64-2432-41fc-9368-70da04c1b827 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:03:52.620047 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be382c64-2432-41fc-9368-70da04c1b827 service cinder] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:03:52.647967 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1384/2797] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Oct 9 01:03:52 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 09 01:03:53.448830 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df6b3ff-0d4a-460a-a002-e49f6b5b2e28 service cinder] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:03:53.464619 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df6b3ff-0d4a-460a-a002-e49f6b5b2e28 service cinder] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:03:53.471324 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dc1f59-2750-437e-bb07-f1cb828c5026 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff7cb78bcd91467abe5c2e2b48aedd1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f148d39ced534860abfbe8fc3f98ace4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:03:53.472550 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dc1f59-2750-437e-bb07-f1cb828c5026 service cinder] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:03:53.473125 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dc1f59-2750-437e-bb07-f1cb828c5026 service cinder] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:03:53.473697 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dc1f59-2750-437e-bb07-f1cb828c5026 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:03:53.492698 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1dc1f59-2750-437e-bb07-f1cb828c5026 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:03:53.498654 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1dc1f59-2750-437e-bb07-f1cb828c5026 service cinder] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:03:53.515572 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1414/2798] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Oct 9 01:03:53 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 09 01:03:57.983570 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be382c64-2432-41fc-9368-70da04c1b827 service cinder] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:03:58.093594 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be382c64-2432-41fc-9368-70da04c1b827 service cinder] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:03:58.102349 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ef05aa-518e-4013-aae0-207c086deae6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:03:58.103548 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ef05aa-518e-4013-aae0-207c086deae6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:03:58.104085 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ef05aa-518e-4013-aae0-207c086deae6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:03:58.104550 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ef05aa-518e-4013-aae0-207c086deae6 admin admin] PATH_INFO: `/v3/users/b252aaff80ea498baaa1ad83e6c4fc1a` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:03:58.106848 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ef05aa-518e-4013-aae0-207c086deae6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b252aaff80ea498baaa1ad83e6c4fc1a)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:03:58.110877 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ef05aa-518e-4013-aae0-207c086deae6 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:03:58.199192 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-15ef05aa-518e-4013-aae0-207c086deae6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b252aaff80ea498baaa1ad83e6c4fc1a'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:03:58.210551 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-15ef05aa-518e-4013-aae0-207c086deae6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b252aaff80ea498baaa1ad83e6c4fc1a'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:03:58.211467 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-15ef05aa-518e-4013-aae0-207c086deae6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b252aaff80ea498baaa1ad83e6c4fc1a'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:03:58.214562 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-15ef05aa-518e-4013-aae0-207c086deae6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b252aaff80ea498baaa1ad83e6c4fc1a'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:03:58.234268 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-15ef05aa-518e-4013-aae0-207c086deae6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b252aaff80ea498baaa1ad83e6c4fc1a'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:03:58.279646 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1385/2799] 10.222.0.15 () {58 vars in 1224 bytes} [Sun Oct 9 01:03:57 2022] DELETE /identity/v3/users/b252aaff80ea498baaa1ad83e6c4fc1a => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 01:03:58.286741 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e886620c-e692-4ea9-84d2-f88d80f4981a None None] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:03:58.287769 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e886620c-e692-4ea9-84d2-f88d80f4981a None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:03:58.287937 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e886620c-e692-4ea9-84d2-f88d80f4981a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:03:58.321759 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.auth.core [None req-e886620c-e692-4ea9-84d2-f88d80f4981a None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 01:03:58.323822 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-e886620c-e692-4ea9-84d2-f88d80f4981a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:03:58.402168 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1415/2800] 10.222.0.15 () {58 vars in 958 bytes} [Sun Oct 9 01:03:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 01:03:58.415694 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ef05aa-518e-4013-aae0-207c086deae6 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:03:58.418119 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-15ef05aa-518e-4013-aae0-207c086deae6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:03:58.466082 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 01:03:58.523336 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ef05aa-518e-4013-aae0-207c086deae6 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:03:58.530485 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbccdc7-04b7-4ca0-90a3-9304a896f3c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4ef90d456d2483e8ddafbe2d4d4fb5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f148d39ced534860abfbe8fc3f98ace4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:03:58.531380 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbccdc7-04b7-4ca0-90a3-9304a896f3c5 service neutron] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:03:58.531653 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbccdc7-04b7-4ca0-90a3-9304a896f3c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:03:58.531981 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbccdc7-04b7-4ca0-90a3-9304a896f3c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:03:58.545925 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbccdc7-04b7-4ca0-90a3-9304a896f3c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:03:58.548978 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbccdc7-04b7-4ca0-90a3-9304a896f3c5 service neutron] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:03:58.567450 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1386/2801] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Oct 9 01:03:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 09 01:03:58.957991 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e886620c-e692-4ea9-84d2-f88d80f4981a None None] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:03:58.960308 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-e886620c-e692-4ea9-84d2-f88d80f4981a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:03:58.980471 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e886620c-e692-4ea9-84d2-f88d80f4981a None None] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:03:58.987409 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a719303-d6b4-43b1-80cf-f356237c7da1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:03:58.988817 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a719303-d6b4-43b1-80cf-f356237c7da1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:03:58.989191 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a719303-d6b4-43b1-80cf-f356237c7da1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:03:58.989577 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a719303-d6b4-43b1-80cf-f356237c7da1 admin admin] PATH_INFO: `/v3/projects/546d76bf6b4b48d8ada49caac24c4084` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:03:58.991506 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a719303-d6b4-43b1-80cf-f356237c7da1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=546d76bf6b4b48d8ada49caac24c4084)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:03:58.994557 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a719303-d6b4-43b1-80cf-f356237c7da1 admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:03:59.079511 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-0a719303-d6b4-43b1-80cf-f356237c7da1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '546d76bf6b4b48d8ada49caac24c4084', 'request_id': 'req-0a719303-d6b4-43b1-80cf-f356237c7da1'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:03:59.091063 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-0a719303-d6b4-43b1-80cf-f356237c7da1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '546d76bf6b4b48d8ada49caac24c4084', 'request_id': 'req-0a719303-d6b4-43b1-80cf-f356237c7da1'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:03:59.100715 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-0a719303-d6b4-43b1-80cf-f356237c7da1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '546d76bf6b4b48d8ada49caac24c4084', 'request_id': 'req-0a719303-d6b4-43b1-80cf-f356237c7da1'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:03:59.115050 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-0a719303-d6b4-43b1-80cf-f356237c7da1 admin admin] The token cache is being invalidate because project 546d76bf6b4b48d8ada49caac24c4084 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81525) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 09 01:03:59.115574 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-0a719303-d6b4-43b1-80cf-f356237c7da1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:03:59.116521 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-0a719303-d6b4-43b1-80cf-f356237c7da1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:03:59.118201 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1416/2802] 10.222.0.15 () {58 vars in 1233 bytes} [Sun Oct 9 01:03:58 2022] DELETE /identity/v3/projects/546d76bf6b4b48d8ada49caac24c4084 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 01:03:59.123600 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbccdc7-04b7-4ca0-90a3-9304a896f3c5 service neutron] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:03:59.141269 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbccdc7-04b7-4ca0-90a3-9304a896f3c5 service neutron] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:03:59.225902 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e09367-df09-42df-bedd-a84ea72bedb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:03:59.226516 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e09367-df09-42df-bedd-a84ea72bedb0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:03:59.226835 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e09367-df09-42df-bedd-a84ea72bedb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:03:59.227192 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e09367-df09-42df-bedd-a84ea72bedb0 admin admin] PATH_INFO: `/v3/users/d2f00aafe22240d8a12f441031500744` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:03:59.228588 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e09367-df09-42df-bedd-a84ea72bedb0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d2f00aafe22240d8a12f441031500744)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:03:59.230762 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e09367-df09-42df-bedd-a84ea72bedb0 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:03:59.303946 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-10e09367-df09-42df-bedd-a84ea72bedb0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd2f00aafe22240d8a12f441031500744'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:03:59.313739 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-10e09367-df09-42df-bedd-a84ea72bedb0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd2f00aafe22240d8a12f441031500744'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:03:59.314739 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-10e09367-df09-42df-bedd-a84ea72bedb0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd2f00aafe22240d8a12f441031500744'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:03:59.315555 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-10e09367-df09-42df-bedd-a84ea72bedb0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd2f00aafe22240d8a12f441031500744'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:03:59.325903 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-10e09367-df09-42df-bedd-a84ea72bedb0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd2f00aafe22240d8a12f441031500744'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:03:59.348359 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1387/2803] 10.222.0.15 () {58 vars in 1224 bytes} [Sun Oct 9 01:03:59 2022] DELETE /identity/v3/users/d2f00aafe22240d8a12f441031500744 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 01:03:59.770577 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a719303-d6b4-43b1-80cf-f356237c7da1 admin admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:03:59.773553 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-0a719303-d6b4-43b1-80cf-f356237c7da1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:03:59.793179 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a719303-d6b4-43b1-80cf-f356237c7da1 admin admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:03:59.913775 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 01:03:59.927920 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97eeed78-8f4f-498c-8a6a-44bc8551312d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:03:59.929151 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97eeed78-8f4f-498c-8a6a-44bc8551312d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:03:59.929585 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97eeed78-8f4f-498c-8a6a-44bc8551312d admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:03:59.930016 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97eeed78-8f4f-498c-8a6a-44bc8551312d admin admin] PATH_INFO: `/v3/projects/9aca8362908d444c847205c603e49f9a` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:03:59.932432 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97eeed78-8f4f-498c-8a6a-44bc8551312d admin admin] RBAC: Authorizing `identity:delete_project(project_id=9aca8362908d444c847205c603e49f9a)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:03:59.936666 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97eeed78-8f4f-498c-8a6a-44bc8551312d admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:04:00.001499 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-97eeed78-8f4f-498c-8a6a-44bc8551312d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9aca8362908d444c847205c603e49f9a', 'request_id': 'req-97eeed78-8f4f-498c-8a6a-44bc8551312d'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:04:00.012452 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-97eeed78-8f4f-498c-8a6a-44bc8551312d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9aca8362908d444c847205c603e49f9a', 'request_id': 'req-97eeed78-8f4f-498c-8a6a-44bc8551312d'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:04:00.021860 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-97eeed78-8f4f-498c-8a6a-44bc8551312d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9aca8362908d444c847205c603e49f9a', 'request_id': 'req-97eeed78-8f4f-498c-8a6a-44bc8551312d'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:04:00.053428 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-97eeed78-8f4f-498c-8a6a-44bc8551312d admin admin] The token cache is being invalidate because project 9aca8362908d444c847205c603e49f9a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81525) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 09 01:04:00.053784 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-97eeed78-8f4f-498c-8a6a-44bc8551312d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:04:00.054616 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-97eeed78-8f4f-498c-8a6a-44bc8551312d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:04:00.056251 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1417/2804] 10.222.0.15 () {58 vars in 1233 bytes} [Sun Oct 9 01:03:59 2022] DELETE /identity/v3/projects/9aca8362908d444c847205c603e49f9a => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 01:04:00.062464 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e09367-df09-42df-bedd-a84ea72bedb0 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:04:00.064057 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-10e09367-df09-42df-bedd-a84ea72bedb0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:04:00.138247 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 01:04:00.168502 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e09367-df09-42df-bedd-a84ea72bedb0 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:04:00.291428 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da90f57-776a-4009-b905-a64ee7493d18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:04:00.292090 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da90f57-776a-4009-b905-a64ee7493d18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:04:00.292365 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da90f57-776a-4009-b905-a64ee7493d18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:04:00.292649 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da90f57-776a-4009-b905-a64ee7493d18 admin admin] PATH_INFO: `/v3/users/6c93052a226e461b9353800c5b2172a2` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:04:00.293863 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da90f57-776a-4009-b905-a64ee7493d18 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6c93052a226e461b9353800c5b2172a2)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:04:00.295869 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da90f57-776a-4009-b905-a64ee7493d18 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:04:00.364369 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-1da90f57-776a-4009-b905-a64ee7493d18 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6c93052a226e461b9353800c5b2172a2'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:04:00.372782 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-1da90f57-776a-4009-b905-a64ee7493d18 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6c93052a226e461b9353800c5b2172a2'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:04:00.373796 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-1da90f57-776a-4009-b905-a64ee7493d18 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6c93052a226e461b9353800c5b2172a2'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:04:00.374715 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-1da90f57-776a-4009-b905-a64ee7493d18 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6c93052a226e461b9353800c5b2172a2'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:04:00.385529 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-1da90f57-776a-4009-b905-a64ee7493d18 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6c93052a226e461b9353800c5b2172a2'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:04:00.406721 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1388/2805] 10.222.0.15 () {58 vars in 1224 bytes} [Sun Oct 9 01:04:00 2022] DELETE /identity/v3/users/6c93052a226e461b9353800c5b2172a2 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 09 01:04:00.787835 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97eeed78-8f4f-498c-8a6a-44bc8551312d admin admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:04:00.790403 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-97eeed78-8f4f-498c-8a6a-44bc8551312d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:04:00.864736 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97eeed78-8f4f-498c-8a6a-44bc8551312d admin admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:04:00.958651 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c86316-16e8-410f-8420-48490519e5af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:04:00.960041 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c86316-16e8-410f-8420-48490519e5af admin admin] REQUEST_METHOD: `DELETE` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:04:00.967794 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c86316-16e8-410f-8420-48490519e5af admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:04:00.968579 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c86316-16e8-410f-8420-48490519e5af admin admin] PATH_INFO: `/v3/projects/873e301649aa4425b635da3c5b20815b` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:04:00.973850 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c86316-16e8-410f-8420-48490519e5af admin admin] RBAC: Authorizing `identity:delete_project(project_id=873e301649aa4425b635da3c5b20815b)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:04:00.981664 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c86316-16e8-410f-8420-48490519e5af admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:04:01.092091 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 01:04:01.120830 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-54c86316-16e8-410f-8420-48490519e5af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '873e301649aa4425b635da3c5b20815b', 'request_id': 'req-54c86316-16e8-410f-8420-48490519e5af'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:04:01.146724 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-54c86316-16e8-410f-8420-48490519e5af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '873e301649aa4425b635da3c5b20815b', 'request_id': 'req-54c86316-16e8-410f-8420-48490519e5af'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:04:01.174500 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-54c86316-16e8-410f-8420-48490519e5af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '873e301649aa4425b635da3c5b20815b', 'request_id': 'req-54c86316-16e8-410f-8420-48490519e5af'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:04:01.189205 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-54c86316-16e8-410f-8420-48490519e5af admin admin] The token cache is being invalidate because project 873e301649aa4425b635da3c5b20815b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81525) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 09 01:04:01.189515 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-54c86316-16e8-410f-8420-48490519e5af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:04:01.190291 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-54c86316-16e8-410f-8420-48490519e5af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:04:01.192226 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1418/2806] 10.222.0.15 () {58 vars in 1233 bytes} [Sun Oct 9 01:04:00 2022] DELETE /identity/v3/projects/873e301649aa4425b635da3c5b20815b => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 01:04:01.199498 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1845220c-5c0e-450d-9ea7-88b165a6d5c1 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:04:01.200860 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1845220c-5c0e-450d-9ea7-88b165a6d5c1 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:04:01.201320 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1845220c-5c0e-450d-9ea7-88b165a6d5c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:04:01.330227 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-1845220c-5c0e-450d-9ea7-88b165a6d5c1 None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 01:04:01.332425 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-1845220c-5c0e-450d-9ea7-88b165a6d5c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:04:01.471152 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 01:04:01.510325 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1389/2807] 10.222.0.15 () {58 vars in 958 bytes} [Sun Oct 9 01:04:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 01:04:01.599786 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ddbe43-ad70-4149-8c42-bb5a6ebe9475 None None] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:04:01.600192 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ddbe43-ad70-4149-8c42-bb5a6ebe9475 None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:04:01.600550 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ddbe43-ad70-4149-8c42-bb5a6ebe9475 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:04:01.624302 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.auth.core [None req-29ddbe43-ad70-4149-8c42-bb5a6ebe9475 None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 01:04:01.625606 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-29ddbe43-ad70-4149-8c42-bb5a6ebe9475 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:04:01.634263 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1419/2808] 10.222.0.15 () {58 vars in 958 bytes} [Sun Oct 9 01:04:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 01:04:01.639182 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1845220c-5c0e-450d-9ea7-88b165a6d5c1 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:04:01.651401 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1845220c-5c0e-450d-9ea7-88b165a6d5c1 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:04:01.656929 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040485f7-bf31-4613-9c72-a136796a67c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:04:01.657568 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040485f7-bf31-4613-9c72-a136796a67c4 admin admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:04:01.657838 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040485f7-bf31-4613-9c72-a136796a67c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:04:01.658093 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040485f7-bf31-4613-9c72-a136796a67c4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:04:01.658787 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040485f7-bf31-4613-9c72-a136796a67c4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 01:04:01.659093 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040485f7-bf31-4613-9c72-a136796a67c4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:04:01.660792 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040485f7-bf31-4613-9c72-a136796a67c4 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:04:01.674958 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1390/2809] 10.222.0.15 () {58 vars in 1153 bytes} [Sun Oct 9 01:04:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 09 01:04:01.679697 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ddbe43-ad70-4149-8c42-bb5a6ebe9475 None None] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:04:01.690510 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ddbe43-ad70-4149-8c42-bb5a6ebe9475 None None] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:04:01.695916 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44716fa4-9991-460d-81cc-620545001beb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:04:01.698612 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44716fa4-9991-460d-81cc-620545001beb admin admin] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:04:01.698612 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44716fa4-9991-460d-81cc-620545001beb admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:04:01.698612 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44716fa4-9991-460d-81cc-620545001beb admin admin] PATH_INFO: `/v3/projects` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:04:01.698612 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44716fa4-9991-460d-81cc-620545001beb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:04:01.700277 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44716fa4-9991-460d-81cc-620545001beb admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:04:01.755308 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1420/2810] 10.222.0.15 () {60 vars in 1153 bytes} [Sun Oct 9 01:04:01 2022] POST /identity/v3/projects => generated 383 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 09 01:04:01.760524 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040485f7-bf31-4613-9c72-a136796a67c4 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:04:01.774613 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040485f7-bf31-4613-9c72-a136796a67c4 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:04:01.917328 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4958780d-d1f9-492a-abcd-b3ecd32ec42a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:04:01.919882 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4958780d-d1f9-492a-abcd-b3ecd32ec42a admin admin] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:04:01.920289 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4958780d-d1f9-492a-abcd-b3ecd32ec42a admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:04:01.920568 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4958780d-d1f9-492a-abcd-b3ecd32ec42a admin admin] PATH_INFO: `/v3/users` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:04:01.921399 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4958780d-d1f9-492a-abcd-b3ecd32ec42a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:04:01.923862 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4958780d-d1f9-492a-abcd-b3ecd32ec42a admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:04:01.949920 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1391/2811] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Oct 9 01:04:01 2022] POST /identity/v3/users => generated 292 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 09 01:04:01.954401 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44716fa4-9991-460d-81cc-620545001beb admin admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:04:01.966962 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44716fa4-9991-460d-81cc-620545001beb admin admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:04:01.972749 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7da835-a26f-438c-a699-e3fdfd1b669f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:04:01.973810 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7da835-a26f-438c-a699-e3fdfd1b669f admin admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:04:01.974144 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7da835-a26f-438c-a699-e3fdfd1b669f admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:04:01.974512 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7da835-a26f-438c-a699-e3fdfd1b669f admin admin] PATH_INFO: `/v3/roles` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:04:01.975813 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7da835-a26f-438c-a699-e3fdfd1b669f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:04:01.978065 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7da835-a26f-438c-a699-e3fdfd1b669f admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:04:01.992966 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1421/2812] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Oct 9 01:04:01 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 09 01:04:02.001286 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4958780d-d1f9-492a-abcd-b3ecd32ec42a admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:04:02.025121 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4958780d-d1f9-492a-abcd-b3ecd32ec42a admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:04:02.035551 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197bf4d2-115e-4371-8113-6f267e5aa22e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:04:02.038260 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197bf4d2-115e-4371-8113-6f267e5aa22e admin admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:04:02.039154 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197bf4d2-115e-4371-8113-6f267e5aa22e admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:04:02.039510 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197bf4d2-115e-4371-8113-6f267e5aa22e admin admin] PATH_INFO: `/v3/roles` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:04:02.041008 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197bf4d2-115e-4371-8113-6f267e5aa22e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:04:02.048228 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197bf4d2-115e-4371-8113-6f267e5aa22e admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:04:02.071975 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1392/2813] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Oct 9 01:04:01 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 09 01:04:02.076539 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7da835-a26f-438c-a699-e3fdfd1b669f admin admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:04:02.088533 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7da835-a26f-438c-a699-e3fdfd1b669f admin admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:04:02.094964 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0f988d-af2f-4205-a6ad-c2afdb2a743e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:04:02.095805 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0f988d-af2f-4205-a6ad-c2afdb2a743e admin admin] REQUEST_METHOD: `PUT` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:04:02.096401 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0f988d-af2f-4205-a6ad-c2afdb2a743e admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:04:02.096797 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0f988d-af2f-4205-a6ad-c2afdb2a743e admin admin] PATH_INFO: `/v3/projects/6ce3c8c8cab74bfeb487cca936cc710a/users/5bfb90626c9c4a799f460089ffef2c46/roles/afb0a01183d9497795eaa4fa1a4046ae` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:04:02.121874 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0f988d-af2f-4205-a6ad-c2afdb2a743e admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ce3c8c8cab74bfeb487cca936cc710a, user_id=5bfb90626c9c4a799f460089ffef2c46, role_id=afb0a01183d9497795eaa4fa1a4046ae)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:04:02.128026 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0f988d-af2f-4205-a6ad-c2afdb2a743e admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:04:02.148671 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1422/2814] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Oct 9 01:04:02 2022] PUT /identity/v3/projects/6ce3c8c8cab74bfeb487cca936cc710a/users/5bfb90626c9c4a799f460089ffef2c46/roles/afb0a01183d9497795eaa4fa1a4046ae => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 01:04:02.167440 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bec932-509e-4ee2-9c87-a5797267df87 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:04:02.167915 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bec932-509e-4ee2-9c87-a5797267df87 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:04:02.168380 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bec932-509e-4ee2-9c87-a5797267df87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:04:02.211926 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-a6bec932-509e-4ee2-9c87-a5797267df87 None None] MFA Rules not processed for user `5bfb90626c9c4a799f460089ffef2c46`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 01:04:02.213170 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-a6bec932-509e-4ee2-9c87-a5797267df87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:04:02.314880 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1393/2815] 10.222.0.15 () {58 vars in 958 bytes} [Sun Oct 9 01:04:02 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 01:04:02.321283 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0f988d-af2f-4205-a6ad-c2afdb2a743e admin admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:04:02.443910 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0f988d-af2f-4205-a6ad-c2afdb2a743e admin admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:04:02.451473 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106637a4-237b-4704-a29c-a6425e5f582d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:04:02.452288 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106637a4-237b-4704-a29c-a6425e5f582d admin admin] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:04:02.452628 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106637a4-237b-4704-a29c-a6425e5f582d admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:04:02.452958 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106637a4-237b-4704-a29c-a6425e5f582d admin admin] PATH_INFO: `/v3/projects` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:04:02.453704 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106637a4-237b-4704-a29c-a6425e5f582d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:04:02.456010 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106637a4-237b-4704-a29c-a6425e5f582d admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:04:02.489993 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1423/2816] 10.222.0.15 () {60 vars in 1153 bytes} [Sun Oct 9 01:04:02 2022] POST /identity/v3/projects => generated 383 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 09 01:04:02.494957 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bec932-509e-4ee2-9c87-a5797267df87 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:04:02.507356 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bec932-509e-4ee2-9c87-a5797267df87 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:04:02.549155 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 01:04:02.577393 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1609826-79a4-491a-903d-aa79715e59c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:04:02.578610 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1609826-79a4-491a-903d-aa79715e59c7 admin admin] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:04:02.578610 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1609826-79a4-491a-903d-aa79715e59c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:04:02.578941 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1609826-79a4-491a-903d-aa79715e59c7 admin admin] PATH_INFO: `/v3/users` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:04:02.579793 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1609826-79a4-491a-903d-aa79715e59c7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:04:02.582118 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1609826-79a4-491a-903d-aa79715e59c7 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:04:02.622157 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1394/2817] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Oct 9 01:04:02 2022] POST /identity/v3/users => generated 292 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 09 01:04:02.626575 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106637a4-237b-4704-a29c-a6425e5f582d admin admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:04:02.636929 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106637a4-237b-4704-a29c-a6425e5f582d admin admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:04:02.638687 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0b908b-3a25-4dae-9f48-b3473e297f25 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:04:02.639081 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0b908b-3a25-4dae-9f48-b3473e297f25 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:04:02.639455 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0b908b-3a25-4dae-9f48-b3473e297f25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:04:02.643132 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc6b3cf-5bdb-4e6f-80d4-2c3b2e1b1ad7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:04:02.644018 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc6b3cf-5bdb-4e6f-80d4-2c3b2e1b1ad7 admin admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:04:02.644455 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc6b3cf-5bdb-4e6f-80d4-2c3b2e1b1ad7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:04:02.644925 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc6b3cf-5bdb-4e6f-80d4-2c3b2e1b1ad7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:04:02.645740 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc6b3cf-5bdb-4e6f-80d4-2c3b2e1b1ad7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:04:02.647634 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc6b3cf-5bdb-4e6f-80d4-2c3b2e1b1ad7 admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:04:02.663917 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1424/2818] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Oct 9 01:04:02 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 09 01:04:02.664517 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-ec0b908b-3a25-4dae-9f48-b3473e297f25 None None] MFA Rules not processed for user `f9cd4dfbcaa143c1a3f9c93b31129a22`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 01:04:02.666094 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-ec0b908b-3a25-4dae-9f48-b3473e297f25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:04:02.669517 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc6b3cf-5bdb-4e6f-80d4-2c3b2e1b1ad7 admin admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:04:02.686896 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc6b3cf-5bdb-4e6f-80d4-2c3b2e1b1ad7 admin admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:04:02.693713 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9aa8c79-9545-4614-aac6-cb10f99d2e4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:04:02.694715 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9aa8c79-9545-4614-aac6-cb10f99d2e4d admin admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:04:02.695156 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9aa8c79-9545-4614-aac6-cb10f99d2e4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:04:02.695689 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9aa8c79-9545-4614-aac6-cb10f99d2e4d admin admin] PATH_INFO: `/v3/roles` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:04:02.697416 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9aa8c79-9545-4614-aac6-cb10f99d2e4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:04:02.699381 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9aa8c79-9545-4614-aac6-cb10f99d2e4d admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:04:02.714856 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1425/2819] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Oct 9 01:04:02 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 09 01:04:02.721164 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9aa8c79-9545-4614-aac6-cb10f99d2e4d admin admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:04:02.733854 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9aa8c79-9545-4614-aac6-cb10f99d2e4d admin admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:04:02.741123 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cb1d98-a0fe-45a0-9a1c-65ca5a8b457a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:04:02.742404 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cb1d98-a0fe-45a0-9a1c-65ca5a8b457a admin admin] REQUEST_METHOD: `PUT` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:04:02.742791 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cb1d98-a0fe-45a0-9a1c-65ca5a8b457a admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:04:02.743105 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cb1d98-a0fe-45a0-9a1c-65ca5a8b457a admin admin] PATH_INFO: `/v3/projects/18a4db6f35314c5eadffbfd9c63a5243/users/eae4c482643f46f189ed3b381a37e195/roles/afb0a01183d9497795eaa4fa1a4046ae` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:04:02.764323 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1395/2820] 10.222.0.15 () {58 vars in 958 bytes} [Sun Oct 9 01:04:02 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 09 01:04:02.764708 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cb1d98-a0fe-45a0-9a1c-65ca5a8b457a admin admin] RBAC: Authorizing `identity:create_grant(project_id=18a4db6f35314c5eadffbfd9c63a5243, user_id=eae4c482643f46f189ed3b381a37e195, role_id=afb0a01183d9497795eaa4fa1a4046ae)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:04:02.767997 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cb1d98-a0fe-45a0-9a1c-65ca5a8b457a admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:04:02.781546 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 01:04:02.789622 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1426/2821] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Oct 9 01:04:02 2022] PUT /identity/v3/projects/18a4db6f35314c5eadffbfd9c63a5243/users/eae4c482643f46f189ed3b381a37e195/roles/afb0a01183d9497795eaa4fa1a4046ae => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 09 01:04:02.808577 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471204ad-34c9-412e-9562-3f0a5ecc0c27 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:04:02.809022 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471204ad-34c9-412e-9562-3f0a5ecc0c27 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:04:02.809403 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471204ad-34c9-412e-9562-3f0a5ecc0c27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:04:02.850026 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-471204ad-34c9-412e-9562-3f0a5ecc0c27 None None] MFA Rules not processed for user `eae4c482643f46f189ed3b381a37e195`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 01:04:02.851718 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-471204ad-34c9-412e-9562-3f0a5ecc0c27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:04:02.947992 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1396/2822] 10.222.0.15 () {58 vars in 958 bytes} [Sun Oct 9 01:04:02 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 09 01:04:02.953902 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cb1d98-a0fe-45a0-9a1c-65ca5a8b457a admin admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:04:03.044142 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cb1d98-a0fe-45a0-9a1c-65ca5a8b457a admin admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:04:03.050373 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee93efe-98fb-4132-b97c-168fcdce79b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:04:03.051152 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee93efe-98fb-4132-b97c-168fcdce79b9 admin admin] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:04:03.051650 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee93efe-98fb-4132-b97c-168fcdce79b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:04:03.052117 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee93efe-98fb-4132-b97c-168fcdce79b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:04:03.053248 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee93efe-98fb-4132-b97c-168fcdce79b9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:04:03.055633 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee93efe-98fb-4132-b97c-168fcdce79b9 admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:04:03.099327 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1427/2823] 10.222.0.15 () {60 vars in 1153 bytes} [Sun Oct 9 01:04:02 2022] POST /identity/v3/projects => generated 385 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 09 01:04:03.103595 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471204ad-34c9-412e-9562-3f0a5ecc0c27 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:04:03.124317 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471204ad-34c9-412e-9562-3f0a5ecc0c27 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:04:03.230276 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09375374-da4f-4cef-ae4d-6ac59f4079da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:04:03.230276 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09375374-da4f-4cef-ae4d-6ac59f4079da admin admin] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:04:03.230276 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09375374-da4f-4cef-ae4d-6ac59f4079da admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:04:03.231688 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09375374-da4f-4cef-ae4d-6ac59f4079da admin admin] PATH_INFO: `/v3/users` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:04:03.231830 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09375374-da4f-4cef-ae4d-6ac59f4079da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:04:03.234136 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09375374-da4f-4cef-ae4d-6ac59f4079da admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:04:03.250918 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 01:04:03.277323 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1397/2824] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Oct 9 01:04:03 2022] POST /identity/v3/users => generated 299 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 09 01:04:03.284134 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee93efe-98fb-4132-b97c-168fcdce79b9 admin admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:04:03.301466 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee93efe-98fb-4132-b97c-168fcdce79b9 admin admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:04:03.308303 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09b550d-ba4f-4c2f-895a-cea6a1b2e54e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:04:03.309407 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09b550d-ba4f-4c2f-895a-cea6a1b2e54e admin admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:04:03.309848 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09b550d-ba4f-4c2f-895a-cea6a1b2e54e admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:04:03.310271 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09b550d-ba4f-4c2f-895a-cea6a1b2e54e admin admin] PATH_INFO: `/v3/roles` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:04:03.311329 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09b550d-ba4f-4c2f-895a-cea6a1b2e54e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:04:03.313547 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09b550d-ba4f-4c2f-895a-cea6a1b2e54e admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:04:03.331164 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1428/2825] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Oct 9 01:04:03 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 09 01:04:03.336358 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09375374-da4f-4cef-ae4d-6ac59f4079da admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:04:03.354050 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09375374-da4f-4cef-ae4d-6ac59f4079da admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:04:03.360418 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8a2ada-2013-4551-8515-d4c670a93d7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:04:03.361417 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8a2ada-2013-4551-8515-d4c670a93d7e admin admin] REQUEST_METHOD: `PUT` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:04:03.361827 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8a2ada-2013-4551-8515-d4c670a93d7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:04:03.362238 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8a2ada-2013-4551-8515-d4c670a93d7e admin admin] PATH_INFO: `/v3/projects/5b2135a100074fb98df2227b7c70dda2/users/7dc4d39511ad45229386cdce99f4409a/roles/f69dddf26daf4dd79d4c962beb877af5` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:04:03.387910 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8a2ada-2013-4551-8515-d4c670a93d7e admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b2135a100074fb98df2227b7c70dda2, user_id=7dc4d39511ad45229386cdce99f4409a, role_id=f69dddf26daf4dd79d4c962beb877af5)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:04:03.392460 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8a2ada-2013-4551-8515-d4c670a93d7e admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:04:03.422864 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1398/2826] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Oct 9 01:04:03 2022] PUT /identity/v3/projects/5b2135a100074fb98df2227b7c70dda2/users/7dc4d39511ad45229386cdce99f4409a/roles/f69dddf26daf4dd79d4c962beb877af5 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 09 01:04:03.427985 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09b550d-ba4f-4c2f-895a-cea6a1b2e54e admin admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:04:03.446884 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09b550d-ba4f-4c2f-895a-cea6a1b2e54e admin admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:04:03.562776 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaeae89e-59cb-4309-9de2-a9c5b7c4c4fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:04:03.563497 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaeae89e-59cb-4309-9de2-a9c5b7c4c4fe admin admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:04:03.563811 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaeae89e-59cb-4309-9de2-a9c5b7c4c4fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:04:03.564076 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaeae89e-59cb-4309-9de2-a9c5b7c4c4fe admin admin] PATH_INFO: `/v3/roles` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:04:03.564744 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaeae89e-59cb-4309-9de2-a9c5b7c4c4fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:04:03.566389 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaeae89e-59cb-4309-9de2-a9c5b7c4c4fe admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:04:03.597255 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1429/2827] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Oct 9 01:04:03 2022] GET /identity/v3/roles => generated 1420 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 09 01:04:03.597777 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8a2ada-2013-4551-8515-d4c670a93d7e admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:04:03.607763 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8a2ada-2013-4551-8515-d4c670a93d7e admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:04:03.617961 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191e3c6a-b7dd-4e20-8320-98f45ba7af0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:04:03.619497 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191e3c6a-b7dd-4e20-8320-98f45ba7af0c admin admin] REQUEST_METHOD: `PUT` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:04:03.619994 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191e3c6a-b7dd-4e20-8320-98f45ba7af0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:04:03.620481 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191e3c6a-b7dd-4e20-8320-98f45ba7af0c admin admin] PATH_INFO: `/v3/projects/5b2135a100074fb98df2227b7c70dda2/users/7dc4d39511ad45229386cdce99f4409a/roles/f69dddf26daf4dd79d4c962beb877af5` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:04:03.624354 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191e3c6a-b7dd-4e20-8320-98f45ba7af0c admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b2135a100074fb98df2227b7c70dda2, user_id=7dc4d39511ad45229386cdce99f4409a, role_id=f69dddf26daf4dd79d4c962beb877af5)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:04:03.630529 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191e3c6a-b7dd-4e20-8320-98f45ba7af0c admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:04:03.651165 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1399/2828] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Oct 9 01:04:03 2022] PUT /identity/v3/projects/5b2135a100074fb98df2227b7c70dda2/users/7dc4d39511ad45229386cdce99f4409a/roles/f69dddf26daf4dd79d4c962beb877af5 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 09 01:04:03.665620 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3d16a2-f1da-4c42-b5d9-bcc4c937c2cc None None] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:04:03.665941 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3d16a2-f1da-4c42-b5d9-bcc4c937c2cc None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:04:03.666253 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3d16a2-f1da-4c42-b5d9-bcc4c937c2cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:04:03.713380 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.auth.core [None req-8b3d16a2-f1da-4c42-b5d9-bcc4c937c2cc None None] MFA Rules not processed for user `7dc4d39511ad45229386cdce99f4409a`. Rule list: `[]` (Enabled: `True`). {{(pid=81525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 01:04:03.717123 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-8b3d16a2-f1da-4c42-b5d9-bcc4c937c2cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:04:03.809960 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 01:04:03.834497 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1430/2829] 10.222.0.15 () {58 vars in 958 bytes} [Sun Oct 9 01:04:03 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 01:04:03.846540 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191e3c6a-b7dd-4e20-8320-98f45ba7af0c admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:04:03.849381 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-191e3c6a-b7dd-4e20-8320-98f45ba7af0c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:04:03.958384 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191e3c6a-b7dd-4e20-8320-98f45ba7af0c admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:04:03.963441 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3556b1f-c3c0-4308-b703-6067f16c245d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff7cb78bcd91467abe5c2e2b48aedd1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f148d39ced534860abfbe8fc3f98ace4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:04:03.964746 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3556b1f-c3c0-4308-b703-6067f16c245d service cinder] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:04:03.964746 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3556b1f-c3c0-4308-b703-6067f16c245d service cinder] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:04:03.965175 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3556b1f-c3c0-4308-b703-6067f16c245d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:04:04.078186 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3556b1f-c3c0-4308-b703-6067f16c245d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:04:04.081431 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3556b1f-c3c0-4308-b703-6067f16c245d service cinder] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:04:04.099095 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1400/2830] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Oct 9 01:04:03 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 09 01:04:05.901453 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3d16a2-f1da-4c42-b5d9-bcc4c937c2cc None None] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:04:05.903845 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-8b3d16a2-f1da-4c42-b5d9-bcc4c937c2cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:04:05.918503 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3d16a2-f1da-4c42-b5d9-bcc4c937c2cc None None] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:04:05.924211 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c5c286-b4bc-49fb-b713-8c7d250a3ac4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff7cb78bcd91467abe5c2e2b48aedd1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f148d39ced534860abfbe8fc3f98ace4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:04:05.925190 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c5c286-b4bc-49fb-b713-8c7d250a3ac4 service cinder] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:04:05.925789 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c5c286-b4bc-49fb-b713-8c7d250a3ac4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:04:05.926234 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c5c286-b4bc-49fb-b713-8c7d250a3ac4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:04:06.045195 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c5c286-b4bc-49fb-b713-8c7d250a3ac4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:04:06.048421 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c5c286-b4bc-49fb-b713-8c7d250a3ac4 service cinder] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:04:06.068292 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1431/2831] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Oct 9 01:04:05 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 09 01:04:06.911075 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3556b1f-c3c0-4308-b703-6067f16c245d service cinder] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:04:06.915220 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-f3556b1f-c3c0-4308-b703-6067f16c245d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:04:07.052114 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c5c286-b4bc-49fb-b713-8c7d250a3ac4 service cinder] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:04:07.063566 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 01:04:07.068761 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c5c286-b4bc-49fb-b713-8c7d250a3ac4 service cinder] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:04:07.075996 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e5712b-eb1f-4b3c-b47a-822eca2950ca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff7cb78bcd91467abe5c2e2b48aedd1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f148d39ced534860abfbe8fc3f98ace4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:04:07.077039 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e5712b-eb1f-4b3c-b47a-822eca2950ca service cinder] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:04:07.077529 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e5712b-eb1f-4b3c-b47a-822eca2950ca service cinder] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:04:07.078007 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e5712b-eb1f-4b3c-b47a-822eca2950ca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:04:07.087827 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3556b1f-c3c0-4308-b703-6067f16c245d service cinder] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:04:07.098308 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95fcbab-8cd5-4fd5-9546-6f1e2181da1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:04:07.100021 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95fcbab-8cd5-4fd5-9546-6f1e2181da1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:04:07.100021 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95fcbab-8cd5-4fd5-9546-6f1e2181da1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:04:07.100459 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e5712b-eb1f-4b3c-b47a-822eca2950ca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:04:07.100820 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95fcbab-8cd5-4fd5-9546-6f1e2181da1f admin admin] PATH_INFO: `/v3/users/caa8b6a94a1944318aa8987a2c6d2ca8` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:04:07.103984 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e5712b-eb1f-4b3c-b47a-822eca2950ca service cinder] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:04:07.104213 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95fcbab-8cd5-4fd5-9546-6f1e2181da1f admin admin] RBAC: Authorizing `identity:delete_user(user_id=caa8b6a94a1944318aa8987a2c6d2ca8)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:04:07.108025 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95fcbab-8cd5-4fd5-9546-6f1e2181da1f admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:04:07.125401 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1432/2832] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Oct 9 01:04:07 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 09 01:04:07.235998 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-c95fcbab-8cd5-4fd5-9546-6f1e2181da1f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'caa8b6a94a1944318aa8987a2c6d2ca8'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:04:07.254739 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-c95fcbab-8cd5-4fd5-9546-6f1e2181da1f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'caa8b6a94a1944318aa8987a2c6d2ca8'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:04:07.262945 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-c95fcbab-8cd5-4fd5-9546-6f1e2181da1f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'caa8b6a94a1944318aa8987a2c6d2ca8'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:04:07.263690 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-c95fcbab-8cd5-4fd5-9546-6f1e2181da1f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'caa8b6a94a1944318aa8987a2c6d2ca8'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:04:07.278634 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-c95fcbab-8cd5-4fd5-9546-6f1e2181da1f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'caa8b6a94a1944318aa8987a2c6d2ca8'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:04:07.325227 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1401/2833] 10.222.0.15 () {58 vars in 1224 bytes} [Sun Oct 9 01:04:06 2022] DELETE /identity/v3/users/caa8b6a94a1944318aa8987a2c6d2ca8 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 01:04:07.618150 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e5712b-eb1f-4b3c-b47a-822eca2950ca service cinder] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:04:07.633397 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e5712b-eb1f-4b3c-b47a-822eca2950ca service cinder] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:04:07.709990 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e738bb-ef40-4edf-842d-1f956b3dcf18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:04:07.710789 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e738bb-ef40-4edf-842d-1f956b3dcf18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:04:07.711064 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e738bb-ef40-4edf-842d-1f956b3dcf18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:04:07.711368 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e738bb-ef40-4edf-842d-1f956b3dcf18 admin admin] PATH_INFO: `/v3/projects/d71904851c0b43eb81791385487f19ef` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:04:07.712680 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e738bb-ef40-4edf-842d-1f956b3dcf18 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d71904851c0b43eb81791385487f19ef)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:04:07.714734 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e738bb-ef40-4edf-842d-1f956b3dcf18 admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:04:07.779030 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-51e738bb-ef40-4edf-842d-1f956b3dcf18 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd71904851c0b43eb81791385487f19ef', 'request_id': 'req-51e738bb-ef40-4edf-842d-1f956b3dcf18'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:04:07.789750 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-51e738bb-ef40-4edf-842d-1f956b3dcf18 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd71904851c0b43eb81791385487f19ef', 'request_id': 'req-51e738bb-ef40-4edf-842d-1f956b3dcf18'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:04:07.797481 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-51e738bb-ef40-4edf-842d-1f956b3dcf18 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd71904851c0b43eb81791385487f19ef', 'request_id': 'req-51e738bb-ef40-4edf-842d-1f956b3dcf18'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:04:07.813187 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-51e738bb-ef40-4edf-842d-1f956b3dcf18 admin admin] The token cache is being invalidate because project d71904851c0b43eb81791385487f19ef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81525) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 09 01:04:07.813187 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-51e738bb-ef40-4edf-842d-1f956b3dcf18 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:04:07.813993 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-51e738bb-ef40-4edf-842d-1f956b3dcf18 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:04:07.815962 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1433/2834] 10.222.0.15 () {58 vars in 1233 bytes} [Sun Oct 9 01:04:07 2022] DELETE /identity/v3/projects/d71904851c0b43eb81791385487f19ef => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 01:04:07.821099 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95fcbab-8cd5-4fd5-9546-6f1e2181da1f admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:04:07.823059 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-c95fcbab-8cd5-4fd5-9546-6f1e2181da1f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:04:07.837869 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95fcbab-8cd5-4fd5-9546-6f1e2181da1f admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:04:07.905603 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8972566a-b13a-43e5-97e5-83c5f792823d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:04:07.906286 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8972566a-b13a-43e5-97e5-83c5f792823d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:04:07.906555 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8972566a-b13a-43e5-97e5-83c5f792823d admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:04:07.906826 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8972566a-b13a-43e5-97e5-83c5f792823d admin admin] PATH_INFO: `/v3/users/87b0927538b84108b4031e363f638d99` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:04:07.908152 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8972566a-b13a-43e5-97e5-83c5f792823d admin admin] RBAC: Authorizing `identity:delete_user(user_id=87b0927538b84108b4031e363f638d99)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:04:07.910306 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8972566a-b13a-43e5-97e5-83c5f792823d admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:04:07.971097 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-8972566a-b13a-43e5-97e5-83c5f792823d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '87b0927538b84108b4031e363f638d99'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:04:07.980100 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-8972566a-b13a-43e5-97e5-83c5f792823d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '87b0927538b84108b4031e363f638d99'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:04:07.981100 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-8972566a-b13a-43e5-97e5-83c5f792823d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '87b0927538b84108b4031e363f638d99'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:04:07.981889 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-8972566a-b13a-43e5-97e5-83c5f792823d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '87b0927538b84108b4031e363f638d99'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:04:08.000795 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-8972566a-b13a-43e5-97e5-83c5f792823d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '87b0927538b84108b4031e363f638d99'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:04:08.015935 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 01:04:08.033815 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1402/2835] 10.222.0.15 () {58 vars in 1224 bytes} [Sun Oct 9 01:04:07 2022] DELETE /identity/v3/users/87b0927538b84108b4031e363f638d99 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 01:04:08.260090 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e738bb-ef40-4edf-842d-1f956b3dcf18 admin admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:04:08.262785 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-51e738bb-ef40-4edf-842d-1f956b3dcf18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:04:08.283405 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e738bb-ef40-4edf-842d-1f956b3dcf18 admin admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:04:08.296849 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 01:04:08.368803 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c3adcb-be00-4466-b43d-019211a96069 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:04:08.369876 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c3adcb-be00-4466-b43d-019211a96069 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:04:08.369876 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c3adcb-be00-4466-b43d-019211a96069 admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:04:08.370188 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c3adcb-be00-4466-b43d-019211a96069 admin admin] PATH_INFO: `/v3/projects/c4ec71ece5024ce788c79f9271f0aec4` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:04:08.371199 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c3adcb-be00-4466-b43d-019211a96069 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c4ec71ece5024ce788c79f9271f0aec4)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:04:08.373294 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c3adcb-be00-4466-b43d-019211a96069 admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:04:08.449445 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-55c3adcb-be00-4466-b43d-019211a96069 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c4ec71ece5024ce788c79f9271f0aec4', 'request_id': 'req-55c3adcb-be00-4466-b43d-019211a96069'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:04:08.463774 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-55c3adcb-be00-4466-b43d-019211a96069 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c4ec71ece5024ce788c79f9271f0aec4', 'request_id': 'req-55c3adcb-be00-4466-b43d-019211a96069'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:04:08.477634 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-55c3adcb-be00-4466-b43d-019211a96069 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c4ec71ece5024ce788c79f9271f0aec4', 'request_id': 'req-55c3adcb-be00-4466-b43d-019211a96069'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:04:08.512198 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-55c3adcb-be00-4466-b43d-019211a96069 admin admin] The token cache is being invalidate because project c4ec71ece5024ce788c79f9271f0aec4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81525) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 09 01:04:08.512638 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-55c3adcb-be00-4466-b43d-019211a96069 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:04:08.518786 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-55c3adcb-be00-4466-b43d-019211a96069 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:04:08.522239 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1434/2836] 10.222.0.15 () {58 vars in 1233 bytes} [Sun Oct 9 01:04:08 2022] DELETE /identity/v3/projects/c4ec71ece5024ce788c79f9271f0aec4 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 09 01:04:08.531186 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9ee6ab-db60-4941-83dd-eaab9953cd94 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:04:08.531616 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9ee6ab-db60-4941-83dd-eaab9953cd94 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:04:08.531950 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9ee6ab-db60-4941-83dd-eaab9953cd94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:04:08.558329 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-fd9ee6ab-db60-4941-83dd-eaab9953cd94 None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 01:04:08.559659 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-fd9ee6ab-db60-4941-83dd-eaab9953cd94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:04:08.652985 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1403/2837] 10.222.0.15 () {58 vars in 958 bytes} [Sun Oct 9 01:04:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 01:04:08.661919 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1df384-5c7f-4e17-b3aa-35c981d68dff None None] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:04:08.662467 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1df384-5c7f-4e17-b3aa-35c981d68dff None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:04:08.663020 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1df384-5c7f-4e17-b3aa-35c981d68dff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:04:08.693430 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.auth.core [None req-3f1df384-5c7f-4e17-b3aa-35c981d68dff None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 01:04:08.695604 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-3f1df384-5c7f-4e17-b3aa-35c981d68dff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:04:08.708130 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1435/2838] 10.222.0.15 () {58 vars in 958 bytes} [Sun Oct 9 01:04:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 09 01:04:08.712674 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9ee6ab-db60-4941-83dd-eaab9953cd94 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:04:08.733099 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9ee6ab-db60-4941-83dd-eaab9953cd94 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:04:08.752676 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dab328-9443-4b1e-9aee-5c377b150d87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:04:08.753814 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dab328-9443-4b1e-9aee-5c377b150d87 admin admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:04:08.754403 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dab328-9443-4b1e-9aee-5c377b150d87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:04:08.754928 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dab328-9443-4b1e-9aee-5c377b150d87 admin admin] PATH_INFO: `/v3/domains` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:04:08.760334 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33dab328-9443-4b1e-9aee-5c377b150d87 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 01:04:08.761321 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33dab328-9443-4b1e-9aee-5c377b150d87 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:04:08.765258 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33dab328-9443-4b1e-9aee-5c377b150d87 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:04:08.813994 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1404/2839] 10.222.0.15 () {58 vars in 1153 bytes} [Sun Oct 9 01:04:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 09 01:04:08.820829 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1df384-5c7f-4e17-b3aa-35c981d68dff None None] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:04:08.837478 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1df384-5c7f-4e17-b3aa-35c981d68dff None None] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:04:08.854406 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6602d6-791e-4960-8ba3-650bb911670c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:04:08.855664 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6602d6-791e-4960-8ba3-650bb911670c admin admin] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:04:08.856227 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6602d6-791e-4960-8ba3-650bb911670c admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:04:08.857177 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6602d6-791e-4960-8ba3-650bb911670c admin admin] PATH_INFO: `/v3/projects` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:04:08.858737 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6602d6-791e-4960-8ba3-650bb911670c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:04:08.863856 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6602d6-791e-4960-8ba3-650bb911670c admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:04:08.958989 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1436/2840] 10.222.0.15 () {60 vars in 1153 bytes} [Sun Oct 9 01:04:08 2022] POST /identity/v3/projects => generated 383 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 09 01:04:08.964171 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dab328-9443-4b1e-9aee-5c377b150d87 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:04:08.994003 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dab328-9443-4b1e-9aee-5c377b150d87 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:04:09.104855 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28796f85-ed17-4066-b6e0-eac471f46260 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:04:09.105590 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28796f85-ed17-4066-b6e0-eac471f46260 admin admin] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:04:09.105911 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28796f85-ed17-4066-b6e0-eac471f46260 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:04:09.106233 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28796f85-ed17-4066-b6e0-eac471f46260 admin admin] PATH_INFO: `/v3/users` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:04:09.107025 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28796f85-ed17-4066-b6e0-eac471f46260 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:04:09.109310 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28796f85-ed17-4066-b6e0-eac471f46260 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:04:09.139494 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1405/2841] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Oct 9 01:04:08 2022] POST /identity/v3/users => generated 292 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 09 01:04:09.145683 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6602d6-791e-4960-8ba3-650bb911670c admin admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:04:09.161032 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6602d6-791e-4960-8ba3-650bb911670c admin admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:04:09.167786 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41778ed-01c1-4a31-b002-7fdd41e130d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:04:09.168733 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41778ed-01c1-4a31-b002-7fdd41e130d7 admin admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:04:09.169098 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41778ed-01c1-4a31-b002-7fdd41e130d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:04:09.169455 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41778ed-01c1-4a31-b002-7fdd41e130d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:04:09.170279 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41778ed-01c1-4a31-b002-7fdd41e130d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:04:09.173076 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41778ed-01c1-4a31-b002-7fdd41e130d7 admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:04:09.189090 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1437/2842] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Oct 9 01:04:09 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 09 01:04:09.193505 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28796f85-ed17-4066-b6e0-eac471f46260 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:04:09.204142 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28796f85-ed17-4066-b6e0-eac471f46260 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:04:09.209329 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aec14d6-9b2e-4406-92c8-bab356007921 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:04:09.210003 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aec14d6-9b2e-4406-92c8-bab356007921 admin admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:04:09.210273 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aec14d6-9b2e-4406-92c8-bab356007921 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:04:09.210538 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aec14d6-9b2e-4406-92c8-bab356007921 admin admin] PATH_INFO: `/v3/roles` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:04:09.211212 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aec14d6-9b2e-4406-92c8-bab356007921 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:04:09.212896 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aec14d6-9b2e-4406-92c8-bab356007921 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:04:09.226144 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1406/2843] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Oct 9 01:04:09 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 09 01:04:09.232176 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41778ed-01c1-4a31-b002-7fdd41e130d7 admin admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:04:09.245116 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41778ed-01c1-4a31-b002-7fdd41e130d7 admin admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:04:09.253538 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c558160-ac5d-4370-8735-722f34876ea6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:04:09.254305 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c558160-ac5d-4370-8735-722f34876ea6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:04:09.254658 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c558160-ac5d-4370-8735-722f34876ea6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:04:09.255030 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c558160-ac5d-4370-8735-722f34876ea6 admin admin] PATH_INFO: `/v3/projects/2b3a2e16cf3047beabfb4022837e853b/users/a7e44d53a7714f56a3db84b33cd5b0b5/roles/afb0a01183d9497795eaa4fa1a4046ae` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:04:09.278401 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c558160-ac5d-4370-8735-722f34876ea6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b3a2e16cf3047beabfb4022837e853b, user_id=a7e44d53a7714f56a3db84b33cd5b0b5, role_id=afb0a01183d9497795eaa4fa1a4046ae)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:04:09.281215 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c558160-ac5d-4370-8735-722f34876ea6 admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:04:09.315047 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1438/2844] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Oct 9 01:04:09 2022] PUT /identity/v3/projects/2b3a2e16cf3047beabfb4022837e853b/users/a7e44d53a7714f56a3db84b33cd5b0b5/roles/afb0a01183d9497795eaa4fa1a4046ae => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 09 01:04:09.431302 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4a44ed-b601-4547-9c61-e8334d0a89de None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:04:09.431849 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4a44ed-b601-4547-9c61-e8334d0a89de None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:04:09.432331 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4a44ed-b601-4547-9c61-e8334d0a89de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:04:09.491839 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-ba4a44ed-b601-4547-9c61-e8334d0a89de None None] MFA Rules not processed for user `a7e44d53a7714f56a3db84b33cd5b0b5`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 01:04:09.494058 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-ba4a44ed-b601-4547-9c61-e8334d0a89de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:04:09.629910 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 01:04:09.673091 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1407/2845] 10.222.0.15 () {58 vars in 958 bytes} [Sun Oct 9 01:04:09 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 01:04:09.679742 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c558160-ac5d-4370-8735-722f34876ea6 admin admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:04:09.754613 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 01:04:09.783904 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c558160-ac5d-4370-8735-722f34876ea6 admin admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:04:09.789216 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0412240-e6a0-4a7f-971c-21dcff6a4190 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:04:09.789854 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0412240-e6a0-4a7f-971c-21dcff6a4190 admin admin] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:04:09.790129 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0412240-e6a0-4a7f-971c-21dcff6a4190 admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:04:09.790395 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0412240-e6a0-4a7f-971c-21dcff6a4190 admin admin] PATH_INFO: `/v3/projects` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:04:09.791048 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0412240-e6a0-4a7f-971c-21dcff6a4190 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:04:09.793052 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0412240-e6a0-4a7f-971c-21dcff6a4190 admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:04:09.839448 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1439/2846] 10.222.0.15 () {60 vars in 1153 bytes} [Sun Oct 9 01:04:09 2022] POST /identity/v3/projects => generated 383 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 09 01:04:09.844052 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4a44ed-b601-4547-9c61-e8334d0a89de None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:04:09.859966 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4a44ed-b601-4547-9c61-e8334d0a89de None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:04:09.965071 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e32cdf-1acf-4a1a-9aa5-18685bc03e09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:04:09.965834 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e32cdf-1acf-4a1a-9aa5-18685bc03e09 admin admin] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:04:09.966201 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e32cdf-1acf-4a1a-9aa5-18685bc03e09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:04:09.966643 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e32cdf-1acf-4a1a-9aa5-18685bc03e09 admin admin] PATH_INFO: `/v3/users` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:04:09.967622 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e32cdf-1acf-4a1a-9aa5-18685bc03e09 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:04:09.969746 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e32cdf-1acf-4a1a-9aa5-18685bc03e09 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:04:09.998902 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1408/2847] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Oct 9 01:04:09 2022] POST /identity/v3/users => generated 298 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 09 01:04:10.004890 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0412240-e6a0-4a7f-971c-21dcff6a4190 admin admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:04:10.021634 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0412240-e6a0-4a7f-971c-21dcff6a4190 admin admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:04:10.029168 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee2a890-5c17-49ba-a8e2-ecc924f62597 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:04:10.030040 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee2a890-5c17-49ba-a8e2-ecc924f62597 admin admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:04:10.030586 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee2a890-5c17-49ba-a8e2-ecc924f62597 admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:04:10.031035 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee2a890-5c17-49ba-a8e2-ecc924f62597 admin admin] PATH_INFO: `/v3/roles` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:04:10.032146 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee2a890-5c17-49ba-a8e2-ecc924f62597 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:04:10.034791 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee2a890-5c17-49ba-a8e2-ecc924f62597 admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:04:10.055307 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1440/2848] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Oct 9 01:04:10 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 09 01:04:10.060104 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e32cdf-1acf-4a1a-9aa5-18685bc03e09 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:04:10.075696 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e32cdf-1acf-4a1a-9aa5-18685bc03e09 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:04:10.083470 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56527b33-10b7-4f2a-82f2-c70388c01b96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:04:10.084859 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56527b33-10b7-4f2a-82f2-c70388c01b96 admin admin] REQUEST_METHOD: `PUT` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:04:10.085400 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56527b33-10b7-4f2a-82f2-c70388c01b96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:04:10.085760 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56527b33-10b7-4f2a-82f2-c70388c01b96 admin admin] PATH_INFO: `/v3/projects/0619ed2998b1483bbca3587dfec9951b/users/76fe8248483547748cefb15bfe3ded7f/roles/f69dddf26daf4dd79d4c962beb877af5` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:04:10.114623 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56527b33-10b7-4f2a-82f2-c70388c01b96 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0619ed2998b1483bbca3587dfec9951b, user_id=76fe8248483547748cefb15bfe3ded7f, role_id=f69dddf26daf4dd79d4c962beb877af5)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:04:10.118053 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56527b33-10b7-4f2a-82f2-c70388c01b96 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:04:10.140259 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1409/2849] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Oct 9 01:04:10 2022] PUT /identity/v3/projects/0619ed2998b1483bbca3587dfec9951b/users/76fe8248483547748cefb15bfe3ded7f/roles/f69dddf26daf4dd79d4c962beb877af5 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 01:04:10.145149 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee2a890-5c17-49ba-a8e2-ecc924f62597 admin admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:04:10.157621 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee2a890-5c17-49ba-a8e2-ecc924f62597 admin admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:04:10.260005 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272420d4-c319-4a27-8d06-1df85bb3d99e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:04:10.260510 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272420d4-c319-4a27-8d06-1df85bb3d99e admin admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:04:10.260956 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272420d4-c319-4a27-8d06-1df85bb3d99e admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:04:10.261289 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272420d4-c319-4a27-8d06-1df85bb3d99e admin admin] PATH_INFO: `/v3/roles` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:04:10.262031 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272420d4-c319-4a27-8d06-1df85bb3d99e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:04:10.264155 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272420d4-c319-4a27-8d06-1df85bb3d99e admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:04:10.287198 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1441/2850] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Oct 9 01:04:10 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 09 01:04:10.288771 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56527b33-10b7-4f2a-82f2-c70388c01b96 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:04:10.302199 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56527b33-10b7-4f2a-82f2-c70388c01b96 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:04:10.308658 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4f7726-17c7-4670-a037-c37886e5e2be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:04:10.309602 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4f7726-17c7-4670-a037-c37886e5e2be admin admin] REQUEST_METHOD: `PUT` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:04:10.309972 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4f7726-17c7-4670-a037-c37886e5e2be admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:04:10.310365 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4f7726-17c7-4670-a037-c37886e5e2be admin admin] PATH_INFO: `/v3/projects/0619ed2998b1483bbca3587dfec9951b/users/76fe8248483547748cefb15bfe3ded7f/roles/f69dddf26daf4dd79d4c962beb877af5` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:04:10.313072 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4f7726-17c7-4670-a037-c37886e5e2be admin admin] RBAC: Authorizing `identity:create_grant(project_id=0619ed2998b1483bbca3587dfec9951b, user_id=76fe8248483547748cefb15bfe3ded7f, role_id=f69dddf26daf4dd79d4c962beb877af5)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:04:10.316545 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4f7726-17c7-4670-a037-c37886e5e2be admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:04:10.335426 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1410/2851] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Oct 9 01:04:10 2022] PUT /identity/v3/projects/0619ed2998b1483bbca3587dfec9951b/users/76fe8248483547748cefb15bfe3ded7f/roles/f69dddf26daf4dd79d4c962beb877af5 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 01:04:10.348475 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2aafcc6-97e0-4e4c-ab07-904b977179a7 None None] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:04:10.348970 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2aafcc6-97e0-4e4c-ab07-904b977179a7 None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:04:10.349172 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2aafcc6-97e0-4e4c-ab07-904b977179a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:04:10.389664 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.auth.core [None req-f2aafcc6-97e0-4e4c-ab07-904b977179a7 None None] MFA Rules not processed for user `76fe8248483547748cefb15bfe3ded7f`. Rule list: `[]` (Enabled: `True`). {{(pid=81525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 01:04:10.391151 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-f2aafcc6-97e0-4e4c-ab07-904b977179a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:04:10.498656 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1442/2852] 10.222.0.15 () {58 vars in 958 bytes} [Sun Oct 9 01:04:10 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 01:04:10.516682 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4f7726-17c7-4670-a037-c37886e5e2be admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:04:10.519504 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-4f4f7726-17c7-4670-a037-c37886e5e2be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:04:10.597664 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4f7726-17c7-4670-a037-c37886e5e2be admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:04:10.602811 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495feaeb-ccdb-4561-9188-21a0efb589fe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff7cb78bcd91467abe5c2e2b48aedd1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f148d39ced534860abfbe8fc3f98ace4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:04:10.603534 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495feaeb-ccdb-4561-9188-21a0efb589fe service cinder] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:04:10.603934 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495feaeb-ccdb-4561-9188-21a0efb589fe service cinder] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:04:10.604307 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495feaeb-ccdb-4561-9188-21a0efb589fe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:04:10.692255 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 01:04:10.698754 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495feaeb-ccdb-4561-9188-21a0efb589fe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:04:10.702335 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495feaeb-ccdb-4561-9188-21a0efb589fe service cinder] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:04:10.724224 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1411/2853] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Oct 9 01:04:10 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 09 01:04:11.620472 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2aafcc6-97e0-4e4c-ab07-904b977179a7 None None] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:04:11.622076 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-f2aafcc6-97e0-4e4c-ab07-904b977179a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:04:11.679417 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 01:04:11.722615 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2aafcc6-97e0-4e4c-ab07-904b977179a7 None None] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:04:11.729432 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59e5d0d-e719-4f81-86e2-8456762fdab2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:04:11.730210 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59e5d0d-e719-4f81-86e2-8456762fdab2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:04:11.730540 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59e5d0d-e719-4f81-86e2-8456762fdab2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:04:11.730847 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59e5d0d-e719-4f81-86e2-8456762fdab2 admin admin] PATH_INFO: `/v3/users/5bfb90626c9c4a799f460089ffef2c46` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:04:11.732258 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59e5d0d-e719-4f81-86e2-8456762fdab2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5bfb90626c9c4a799f460089ffef2c46)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:04:11.734514 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59e5d0d-e719-4f81-86e2-8456762fdab2 admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:04:11.801891 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-c59e5d0d-e719-4f81-86e2-8456762fdab2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5bfb90626c9c4a799f460089ffef2c46'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:04:11.811021 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-c59e5d0d-e719-4f81-86e2-8456762fdab2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5bfb90626c9c4a799f460089ffef2c46'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:04:11.811982 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-c59e5d0d-e719-4f81-86e2-8456762fdab2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5bfb90626c9c4a799f460089ffef2c46'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:04:11.812853 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-c59e5d0d-e719-4f81-86e2-8456762fdab2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5bfb90626c9c4a799f460089ffef2c46'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:04:11.824265 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-c59e5d0d-e719-4f81-86e2-8456762fdab2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5bfb90626c9c4a799f460089ffef2c46'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:04:11.848675 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1443/2854] 10.222.0.15 () {58 vars in 1224 bytes} [Sun Oct 9 01:04:11 2022] DELETE /identity/v3/users/5bfb90626c9c4a799f460089ffef2c46 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 01:04:11.854576 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844728d1-518b-4099-b286-aab440033544 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:04:11.855415 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844728d1-518b-4099-b286-aab440033544 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:04:11.855415 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844728d1-518b-4099-b286-aab440033544 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:04:11.876912 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-844728d1-518b-4099-b286-aab440033544 None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 01:04:11.878218 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-844728d1-518b-4099-b286-aab440033544 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:04:11.949660 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1412/2855] 10.222.0.15 () {58 vars in 958 bytes} [Sun Oct 9 01:04:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 01:04:11.961803 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59e5d0d-e719-4f81-86e2-8456762fdab2 admin admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:04:11.963710 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-c59e5d0d-e719-4f81-86e2-8456762fdab2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:04:12.037796 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59e5d0d-e719-4f81-86e2-8456762fdab2 admin admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:04:12.042692 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a965bde9-494a-4500-8e2e-22699747650a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4ef90d456d2483e8ddafbe2d4d4fb5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f148d39ced534860abfbe8fc3f98ace4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:04:12.043597 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a965bde9-494a-4500-8e2e-22699747650a service neutron] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:04:12.044082 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a965bde9-494a-4500-8e2e-22699747650a service neutron] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:04:12.044558 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a965bde9-494a-4500-8e2e-22699747650a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:04:12.057693 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a965bde9-494a-4500-8e2e-22699747650a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:04:12.059946 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a965bde9-494a-4500-8e2e-22699747650a service neutron] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:04:12.078428 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1444/2856] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Oct 9 01:04:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 09 01:04:12.534991 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844728d1-518b-4099-b286-aab440033544 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:04:12.537161 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-844728d1-518b-4099-b286-aab440033544 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:04:12.559958 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844728d1-518b-4099-b286-aab440033544 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:04:12.570846 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d592133b-f283-414f-a3af-a252a39612f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:04:12.572100 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d592133b-f283-414f-a3af-a252a39612f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:04:12.572727 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d592133b-f283-414f-a3af-a252a39612f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:04:12.573307 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d592133b-f283-414f-a3af-a252a39612f6 admin admin] PATH_INFO: `/v3/projects/6ce3c8c8cab74bfeb487cca936cc710a` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:04:12.575365 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d592133b-f283-414f-a3af-a252a39612f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6ce3c8c8cab74bfeb487cca936cc710a)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:04:12.578393 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d592133b-f283-414f-a3af-a252a39612f6 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:04:12.649640 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-d592133b-f283-414f-a3af-a252a39612f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6ce3c8c8cab74bfeb487cca936cc710a', 'request_id': 'req-d592133b-f283-414f-a3af-a252a39612f6'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:04:12.659875 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-d592133b-f283-414f-a3af-a252a39612f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6ce3c8c8cab74bfeb487cca936cc710a', 'request_id': 'req-d592133b-f283-414f-a3af-a252a39612f6'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:04:12.669630 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-d592133b-f283-414f-a3af-a252a39612f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6ce3c8c8cab74bfeb487cca936cc710a', 'request_id': 'req-d592133b-f283-414f-a3af-a252a39612f6'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:04:12.686482 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-d592133b-f283-414f-a3af-a252a39612f6 admin admin] The token cache is being invalidate because project 6ce3c8c8cab74bfeb487cca936cc710a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81524) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 09 01:04:12.686949 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-d592133b-f283-414f-a3af-a252a39612f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:04:12.688070 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-d592133b-f283-414f-a3af-a252a39612f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:04:12.690533 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1413/2857] 10.222.0.15 () {58 vars in 1233 bytes} [Sun Oct 9 01:04:12 2022] DELETE /identity/v3/projects/6ce3c8c8cab74bfeb487cca936cc710a => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 09 01:04:12.697091 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a965bde9-494a-4500-8e2e-22699747650a service neutron] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:04:12.710537 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a965bde9-494a-4500-8e2e-22699747650a service neutron] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:04:12.804362 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 01:04:12.814971 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1333220-2898-40dc-8811-5dca0a7e4d83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:04:12.815845 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1333220-2898-40dc-8811-5dca0a7e4d83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:04:12.816662 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1333220-2898-40dc-8811-5dca0a7e4d83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:04:12.817219 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1333220-2898-40dc-8811-5dca0a7e4d83 admin admin] PATH_INFO: `/v3/users/eae4c482643f46f189ed3b381a37e195` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:04:12.819307 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1333220-2898-40dc-8811-5dca0a7e4d83 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eae4c482643f46f189ed3b381a37e195)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:04:12.824925 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1333220-2898-40dc-8811-5dca0a7e4d83 admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:04:12.895115 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-e1333220-2898-40dc-8811-5dca0a7e4d83 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eae4c482643f46f189ed3b381a37e195'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:04:12.906053 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-e1333220-2898-40dc-8811-5dca0a7e4d83 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eae4c482643f46f189ed3b381a37e195'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:04:12.907550 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-e1333220-2898-40dc-8811-5dca0a7e4d83 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eae4c482643f46f189ed3b381a37e195'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:04:12.908346 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-e1333220-2898-40dc-8811-5dca0a7e4d83 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eae4c482643f46f189ed3b381a37e195'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:04:12.927709 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-e1333220-2898-40dc-8811-5dca0a7e4d83 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eae4c482643f46f189ed3b381a37e195'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:04:12.958430 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1445/2858] 10.222.0.15 () {58 vars in 1224 bytes} [Sun Oct 9 01:04:12 2022] DELETE /identity/v3/users/eae4c482643f46f189ed3b381a37e195 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 01:04:13.404266 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d592133b-f283-414f-a3af-a252a39612f6 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:04:13.406298 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-d592133b-f283-414f-a3af-a252a39612f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:04:13.425808 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d592133b-f283-414f-a3af-a252a39612f6 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:04:13.546227 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bac487c-f60c-43f8-8ac8-a19fc87ed8ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:04:13.547053 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bac487c-f60c-43f8-8ac8-a19fc87ed8ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:04:13.547429 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bac487c-f60c-43f8-8ac8-a19fc87ed8ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:04:13.547831 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bac487c-f60c-43f8-8ac8-a19fc87ed8ae admin admin] PATH_INFO: `/v3/projects/18a4db6f35314c5eadffbfd9c63a5243` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:04:13.549172 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bac487c-f60c-43f8-8ac8-a19fc87ed8ae admin admin] RBAC: Authorizing `identity:delete_project(project_id=18a4db6f35314c5eadffbfd9c63a5243)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:04:13.552221 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bac487c-f60c-43f8-8ac8-a19fc87ed8ae admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:04:13.578336 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 01:04:13.615852 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-8bac487c-f60c-43f8-8ac8-a19fc87ed8ae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '18a4db6f35314c5eadffbfd9c63a5243', 'request_id': 'req-8bac487c-f60c-43f8-8ac8-a19fc87ed8ae'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:04:13.625966 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-8bac487c-f60c-43f8-8ac8-a19fc87ed8ae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '18a4db6f35314c5eadffbfd9c63a5243', 'request_id': 'req-8bac487c-f60c-43f8-8ac8-a19fc87ed8ae'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:04:13.634318 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-8bac487c-f60c-43f8-8ac8-a19fc87ed8ae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '18a4db6f35314c5eadffbfd9c63a5243', 'request_id': 'req-8bac487c-f60c-43f8-8ac8-a19fc87ed8ae'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:04:13.646823 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-8bac487c-f60c-43f8-8ac8-a19fc87ed8ae admin admin] The token cache is being invalidate because project 18a4db6f35314c5eadffbfd9c63a5243 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81524) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 09 01:04:13.647104 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-8bac487c-f60c-43f8-8ac8-a19fc87ed8ae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:04:13.647840 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-8bac487c-f60c-43f8-8ac8-a19fc87ed8ae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:04:13.649693 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1414/2859] 10.222.0.15 () {58 vars in 1233 bytes} [Sun Oct 9 01:04:13 2022] DELETE /identity/v3/projects/18a4db6f35314c5eadffbfd9c63a5243 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 01:04:13.655183 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1333220-2898-40dc-8811-5dca0a7e4d83 admin admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:04:13.657749 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-e1333220-2898-40dc-8811-5dca0a7e4d83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:04:13.678979 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1333220-2898-40dc-8811-5dca0a7e4d83 admin admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:04:13.774024 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af447bc-e855-4cb6-bc62-be7e6eb3822f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:04:13.775153 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af447bc-e855-4cb6-bc62-be7e6eb3822f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:04:13.775519 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af447bc-e855-4cb6-bc62-be7e6eb3822f admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:04:13.776050 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af447bc-e855-4cb6-bc62-be7e6eb3822f admin admin] PATH_INFO: `/v3/users/7dc4d39511ad45229386cdce99f4409a` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:04:13.777599 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af447bc-e855-4cb6-bc62-be7e6eb3822f admin admin] RBAC: Authorizing `identity:delete_user(user_id=7dc4d39511ad45229386cdce99f4409a)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:04:13.780272 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af447bc-e855-4cb6-bc62-be7e6eb3822f admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:04:13.873720 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-2af447bc-e855-4cb6-bc62-be7e6eb3822f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7dc4d39511ad45229386cdce99f4409a'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:04:13.886557 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-2af447bc-e855-4cb6-bc62-be7e6eb3822f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7dc4d39511ad45229386cdce99f4409a'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:04:13.887651 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-2af447bc-e855-4cb6-bc62-be7e6eb3822f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7dc4d39511ad45229386cdce99f4409a'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:04:13.888530 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-2af447bc-e855-4cb6-bc62-be7e6eb3822f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7dc4d39511ad45229386cdce99f4409a'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:04:13.902289 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-2af447bc-e855-4cb6-bc62-be7e6eb3822f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7dc4d39511ad45229386cdce99f4409a'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:04:13.919423 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 01:04:13.939225 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1446/2860] 10.222.0.15 () {58 vars in 1224 bytes} [Sun Oct 9 01:04:13 2022] DELETE /identity/v3/users/7dc4d39511ad45229386cdce99f4409a => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 01:04:14.423426 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bac487c-f60c-43f8-8ac8-a19fc87ed8ae admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:04:14.425682 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-8bac487c-f60c-43f8-8ac8-a19fc87ed8ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:04:14.497402 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bac487c-f60c-43f8-8ac8-a19fc87ed8ae admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:04:14.601811 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbcfbfa-8021-40ea-944e-0d841ce55a35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:04:14.602757 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbcfbfa-8021-40ea-944e-0d841ce55a35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:04:14.603289 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbcfbfa-8021-40ea-944e-0d841ce55a35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:04:14.603779 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbcfbfa-8021-40ea-944e-0d841ce55a35 admin admin] PATH_INFO: `/v3/projects/5b2135a100074fb98df2227b7c70dda2` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:04:14.605466 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbcfbfa-8021-40ea-944e-0d841ce55a35 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5b2135a100074fb98df2227b7c70dda2)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:04:14.608179 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbcfbfa-8021-40ea-944e-0d841ce55a35 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:04:14.710508 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-5cbcfbfa-8021-40ea-944e-0d841ce55a35 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5b2135a100074fb98df2227b7c70dda2', 'request_id': 'req-5cbcfbfa-8021-40ea-944e-0d841ce55a35'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:04:14.725113 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-5cbcfbfa-8021-40ea-944e-0d841ce55a35 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5b2135a100074fb98df2227b7c70dda2', 'request_id': 'req-5cbcfbfa-8021-40ea-944e-0d841ce55a35'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:04:14.736308 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-5cbcfbfa-8021-40ea-944e-0d841ce55a35 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5b2135a100074fb98df2227b7c70dda2', 'request_id': 'req-5cbcfbfa-8021-40ea-944e-0d841ce55a35'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:04:14.754612 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-5cbcfbfa-8021-40ea-944e-0d841ce55a35 admin admin] The token cache is being invalidate because project 5b2135a100074fb98df2227b7c70dda2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81524) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 09 01:04:14.755329 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-5cbcfbfa-8021-40ea-944e-0d841ce55a35 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:04:14.756369 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-5cbcfbfa-8021-40ea-944e-0d841ce55a35 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:04:14.759635 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1415/2861] 10.222.0.15 () {58 vars in 1233 bytes} [Sun Oct 9 01:04:14 2022] DELETE /identity/v3/projects/5b2135a100074fb98df2227b7c70dda2 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 09 01:04:14.767033 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cac68a-fd3f-4cf9-b531-29731caf617d None None] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:04:14.767607 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cac68a-fd3f-4cf9-b531-29731caf617d None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:04:14.768143 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cac68a-fd3f-4cf9-b531-29731caf617d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:04:14.802840 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.auth.core [None req-67cac68a-fd3f-4cf9-b531-29731caf617d None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 01:04:14.805621 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-67cac68a-fd3f-4cf9-b531-29731caf617d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:04:14.887896 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1447/2862] 10.222.0.15 () {58 vars in 958 bytes} [Sun Oct 9 01:04:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 09 01:04:14.896752 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5424b066-57d3-4a70-b679-dd65f189cb68 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:04:14.896980 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5424b066-57d3-4a70-b679-dd65f189cb68 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:04:14.897345 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5424b066-57d3-4a70-b679-dd65f189cb68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:04:14.928194 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-5424b066-57d3-4a70-b679-dd65f189cb68 None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 01:04:14.930334 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-5424b066-57d3-4a70-b679-dd65f189cb68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:04:14.942880 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1416/2863] 10.222.0.15 () {58 vars in 958 bytes} [Sun Oct 9 01:04:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 01:04:14.949543 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cac68a-fd3f-4cf9-b531-29731caf617d None None] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:04:14.961590 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cac68a-fd3f-4cf9-b531-29731caf617d None None] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:04:14.967287 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0f9428-7eff-4018-91a7-2b36cc8e1212 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:04:14.967969 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0f9428-7eff-4018-91a7-2b36cc8e1212 admin admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:04:14.968243 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0f9428-7eff-4018-91a7-2b36cc8e1212 admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:04:14.968510 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0f9428-7eff-4018-91a7-2b36cc8e1212 admin admin] PATH_INFO: `/v3/domains` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:04:14.969192 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0f9428-7eff-4018-91a7-2b36cc8e1212 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 01:04:14.969497 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0f9428-7eff-4018-91a7-2b36cc8e1212 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:04:14.971182 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0f9428-7eff-4018-91a7-2b36cc8e1212 admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:04:14.985305 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1448/2864] 10.222.0.15 () {58 vars in 1153 bytes} [Sun Oct 9 01:04:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 01:04:14.990662 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5424b066-57d3-4a70-b679-dd65f189cb68 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:04:15.004436 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5424b066-57d3-4a70-b679-dd65f189cb68 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:04:15.011718 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ab32b3-acc1-42af-b6d7-2b78c4f0a26f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:04:15.012626 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ab32b3-acc1-42af-b6d7-2b78c4f0a26f admin admin] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:04:15.012943 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ab32b3-acc1-42af-b6d7-2b78c4f0a26f admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:04:15.013233 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ab32b3-acc1-42af-b6d7-2b78c4f0a26f admin admin] PATH_INFO: `/v3/projects` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:04:15.014158 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ab32b3-acc1-42af-b6d7-2b78c4f0a26f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:04:15.017654 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ab32b3-acc1-42af-b6d7-2b78c4f0a26f admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:04:15.064476 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1417/2865] 10.222.0.15 () {60 vars in 1153 bytes} [Sun Oct 9 01:04:14 2022] POST /identity/v3/projects => generated 367 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 09 01:04:15.069224 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0f9428-7eff-4018-91a7-2b36cc8e1212 admin admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:04:15.081736 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0f9428-7eff-4018-91a7-2b36cc8e1212 admin admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:04:15.189789 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047841ef-54aa-42e7-9fa3-af17c49ce0c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:04:15.190738 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047841ef-54aa-42e7-9fa3-af17c49ce0c2 admin admin] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:04:15.191335 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047841ef-54aa-42e7-9fa3-af17c49ce0c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:04:15.191680 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047841ef-54aa-42e7-9fa3-af17c49ce0c2 admin admin] PATH_INFO: `/v3/users` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:04:15.192703 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047841ef-54aa-42e7-9fa3-af17c49ce0c2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:04:15.195847 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047841ef-54aa-42e7-9fa3-af17c49ce0c2 admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:04:15.231906 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1449/2866] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Oct 9 01:04:15 2022] POST /identity/v3/users => generated 284 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 09 01:04:15.238503 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ab32b3-acc1-42af-b6d7-2b78c4f0a26f admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:04:15.256983 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ab32b3-acc1-42af-b6d7-2b78c4f0a26f admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:04:15.264038 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381eeb25-d233-4ee1-ac3b-d6bb38eb5939 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:04:15.265032 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381eeb25-d233-4ee1-ac3b-d6bb38eb5939 admin admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:04:15.265325 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381eeb25-d233-4ee1-ac3b-d6bb38eb5939 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:04:15.265599 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381eeb25-d233-4ee1-ac3b-d6bb38eb5939 admin admin] PATH_INFO: `/v3/roles` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:04:15.266347 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381eeb25-d233-4ee1-ac3b-d6bb38eb5939 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:04:15.268322 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381eeb25-d233-4ee1-ac3b-d6bb38eb5939 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:04:15.271557 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 01:04:15.283003 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1418/2867] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Oct 9 01:04:15 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 09 01:04:15.289706 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047841ef-54aa-42e7-9fa3-af17c49ce0c2 admin admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:04:15.305454 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047841ef-54aa-42e7-9fa3-af17c49ce0c2 admin admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:04:15.311111 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b576cc-057f-47b2-8c7c-3e15cc6b17ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:04:15.311936 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b576cc-057f-47b2-8c7c-3e15cc6b17ca admin admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:04:15.312245 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b576cc-057f-47b2-8c7c-3e15cc6b17ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:04:15.312686 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b576cc-057f-47b2-8c7c-3e15cc6b17ca admin admin] PATH_INFO: `/v3/roles` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:04:15.313657 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b576cc-057f-47b2-8c7c-3e15cc6b17ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:04:15.315484 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b576cc-057f-47b2-8c7c-3e15cc6b17ca admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:04:15.327792 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1450/2868] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Oct 9 01:04:15 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 09 01:04:15.332666 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381eeb25-d233-4ee1-ac3b-d6bb38eb5939 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:04:15.343452 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381eeb25-d233-4ee1-ac3b-d6bb38eb5939 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:04:15.348405 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b883524a-abb7-4912-9a3f-3e615d523e87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:04:15.349162 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b883524a-abb7-4912-9a3f-3e615d523e87 admin admin] REQUEST_METHOD: `PUT` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:04:15.349434 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b883524a-abb7-4912-9a3f-3e615d523e87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:04:15.349700 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b883524a-abb7-4912-9a3f-3e615d523e87 admin admin] PATH_INFO: `/v3/projects/cdd4c13ca6564a3d96d90d7faa04f295/users/79cfc1e243824aeaa695d00828cb641f/roles/afb0a01183d9497795eaa4fa1a4046ae` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:04:15.368389 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b883524a-abb7-4912-9a3f-3e615d523e87 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cdd4c13ca6564a3d96d90d7faa04f295, user_id=79cfc1e243824aeaa695d00828cb641f, role_id=afb0a01183d9497795eaa4fa1a4046ae)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:04:15.371057 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b883524a-abb7-4912-9a3f-3e615d523e87 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:04:15.387368 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1419/2869] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Oct 9 01:04:15 2022] PUT /identity/v3/projects/cdd4c13ca6564a3d96d90d7faa04f295/users/79cfc1e243824aeaa695d00828cb641f/roles/afb0a01183d9497795eaa4fa1a4046ae => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 09 01:04:15.399632 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3787d22-b60e-4a88-8485-f0014668686d None None] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:04:15.399962 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3787d22-b60e-4a88-8485-f0014668686d None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:04:15.400268 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3787d22-b60e-4a88-8485-f0014668686d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:04:15.433889 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.auth.core [None req-b3787d22-b60e-4a88-8485-f0014668686d None None] MFA Rules not processed for user `79cfc1e243824aeaa695d00828cb641f`. Rule list: `[]` (Enabled: `True`). {{(pid=81525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 01:04:15.435182 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-b3787d22-b60e-4a88-8485-f0014668686d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:04:15.494522 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 01:04:15.522920 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1451/2870] 10.222.0.15 () {58 vars in 958 bytes} [Sun Oct 9 01:04:15 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 01:04:15.537253 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b883524a-abb7-4912-9a3f-3e615d523e87 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:04:15.540010 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-b883524a-abb7-4912-9a3f-3e615d523e87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:04:15.618717 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b883524a-abb7-4912-9a3f-3e615d523e87 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:04:15.623674 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c909c3-9c78-4689-921e-751ab8ba7f3b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd88a9f3d154c4cf98369972a0561b2b5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f148d39ced534860abfbe8fc3f98ace4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:04:15.624699 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c909c3-9c78-4689-921e-751ab8ba7f3b service glance] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:04:15.625152 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c909c3-9c78-4689-921e-751ab8ba7f3b service glance] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:04:15.625619 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c909c3-9c78-4689-921e-751ab8ba7f3b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:04:15.644014 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c909c3-9c78-4689-921e-751ab8ba7f3b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:04:15.646793 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c909c3-9c78-4689-921e-751ab8ba7f3b service glance] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:04:15.660227 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1420/2871] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Oct 9 01:04:15 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 09 01:04:15.935432 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3787d22-b60e-4a88-8485-f0014668686d None None] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:04:15.940456 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-b3787d22-b60e-4a88-8485-f0014668686d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:04:16.092789 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3787d22-b60e-4a88-8485-f0014668686d None None] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:04:16.097732 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d30daa-547e-4caf-ae1b-e767f52f8a32 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff7cb78bcd91467abe5c2e2b48aedd1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f148d39ced534860abfbe8fc3f98ace4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:04:16.098340 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d30daa-547e-4caf-ae1b-e767f52f8a32 service cinder] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:04:16.098618 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d30daa-547e-4caf-ae1b-e767f52f8a32 service cinder] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:04:16.098951 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d30daa-547e-4caf-ae1b-e767f52f8a32 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:04:16.101066 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-e7d30daa-547e-4caf-ae1b-e767f52f8a32 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:04:16.219886 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d30daa-547e-4caf-ae1b-e767f52f8a32 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:04:16.222470 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d30daa-547e-4caf-ae1b-e767f52f8a32 service cinder] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:04:16.241844 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1452/2872] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Oct 9 01:04:15 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 09 01:04:16.972346 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c909c3-9c78-4689-921e-751ab8ba7f3b service glance] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:04:16.974868 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-00c909c3-9c78-4689-921e-751ab8ba7f3b service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:04:17.116248 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c909c3-9c78-4689-921e-751ab8ba7f3b service glance] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:04:17.121485 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2368da-fa3c-4f7b-b550-1d28e33c01de service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64be9d44437e4247a72334b9bab3cdd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f148d39ced534860abfbe8fc3f98ace4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:04:17.122103 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2368da-fa3c-4f7b-b550-1d28e33c01de service placement] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:04:17.122376 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2368da-fa3c-4f7b-b550-1d28e33c01de service placement] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:04:17.122637 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2368da-fa3c-4f7b-b550-1d28e33c01de service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:04:17.124397 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-2b2368da-fa3c-4f7b-b550-1d28e33c01de service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:04:17.137872 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2368da-fa3c-4f7b-b550-1d28e33c01de service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:04:17.139551 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2368da-fa3c-4f7b-b550-1d28e33c01de service placement] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:04:17.151530 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1421/2873] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Oct 9 01:04:16 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 09 01:04:19.956092 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac09f4ae-b392-47c4-879a-2837bc10d2cf None None] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:04:19.956995 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac09f4ae-b392-47c4-879a-2837bc10d2cf None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:04:19.956995 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac09f4ae-b392-47c4-879a-2837bc10d2cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:04:19.996827 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.auth.core [None req-ac09f4ae-b392-47c4-879a-2837bc10d2cf None None] MFA Rules not processed for user `3a6cfef106c84f759ce0874be77f7380`. Rule list: `[]` (Enabled: `True`). {{(pid=81525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 01:04:19.998146 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-ac09f4ae-b392-47c4-879a-2837bc10d2cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:04:20.106375 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1453/2874] 10.222.0.15 () {58 vars in 1009 bytes} [Sun Oct 9 01:04:19 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 01:04:20.140591 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2368da-fa3c-4f7b-b550-1d28e33c01de service placement] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:04:20.143159 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-2b2368da-fa3c-4f7b-b550-1d28e33c01de service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:04:20.220716 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 01:04:20.248266 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2368da-fa3c-4f7b-b550-1d28e33c01de service placement] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:04:20.255666 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366fbf72-e4d0-4f02-aa74-6d6f47bcafb1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4c467943b8f4d31a2f067ca6ed3b25c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f148d39ced534860abfbe8fc3f98ace4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:04:20.256393 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366fbf72-e4d0-4f02-aa74-6d6f47bcafb1 service swift] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:04:20.256887 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366fbf72-e4d0-4f02-aa74-6d6f47bcafb1 service swift] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:04:20.257125 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366fbf72-e4d0-4f02-aa74-6d6f47bcafb1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:04:20.268253 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366fbf72-e4d0-4f02-aa74-6d6f47bcafb1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:04:20.270054 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366fbf72-e4d0-4f02-aa74-6d6f47bcafb1 service swift] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:04:20.281504 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1422/2875] 10.222.0.15 () {60 vars in 1384 bytes} [Sun Oct 9 01:04:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 09 01:04:21.695298 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac09f4ae-b392-47c4-879a-2837bc10d2cf None None] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:04:21.697048 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-ac09f4ae-b392-47c4-879a-2837bc10d2cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:04:21.746724 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=100 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 01:04:21.814164 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac09f4ae-b392-47c4-879a-2837bc10d2cf None None] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:04:21.821158 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275705bd-d99b-4c33-b004-bb74dec09e42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:04:21.822240 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275705bd-d99b-4c33-b004-bb74dec09e42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:04:21.822727 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275705bd-d99b-4c33-b004-bb74dec09e42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:04:21.823207 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275705bd-d99b-4c33-b004-bb74dec09e42 admin admin] PATH_INFO: `/v3/users/a7e44d53a7714f56a3db84b33cd5b0b5` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:04:21.826063 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275705bd-d99b-4c33-b004-bb74dec09e42 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a7e44d53a7714f56a3db84b33cd5b0b5)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:04:21.829919 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275705bd-d99b-4c33-b004-bb74dec09e42 admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:04:21.920579 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-275705bd-d99b-4c33-b004-bb74dec09e42 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a7e44d53a7714f56a3db84b33cd5b0b5'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:04:21.940898 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-275705bd-d99b-4c33-b004-bb74dec09e42 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a7e44d53a7714f56a3db84b33cd5b0b5'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:04:21.942704 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-275705bd-d99b-4c33-b004-bb74dec09e42 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a7e44d53a7714f56a3db84b33cd5b0b5'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:04:21.943784 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-275705bd-d99b-4c33-b004-bb74dec09e42 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a7e44d53a7714f56a3db84b33cd5b0b5'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:04:21.959557 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-275705bd-d99b-4c33-b004-bb74dec09e42 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a7e44d53a7714f56a3db84b33cd5b0b5'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:04:22.006825 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1454/2876] 10.222.0.15 () {58 vars in 1224 bytes} [Sun Oct 9 01:04:21 2022] DELETE /identity/v3/users/a7e44d53a7714f56a3db84b33cd5b0b5 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 01:04:22.010392 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfb4b2c-9856-4322-a7ef-37ca24f21a9c None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:04:22.011516 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfb4b2c-9856-4322-a7ef-37ca24f21a9c None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:04:22.012614 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfb4b2c-9856-4322-a7ef-37ca24f21a9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:04:22.048559 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-2cfb4b2c-9856-4322-a7ef-37ca24f21a9c None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 01:04:22.050641 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-2cfb4b2c-9856-4322-a7ef-37ca24f21a9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:04:22.165826 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1423/2877] 10.222.0.15 () {58 vars in 958 bytes} [Sun Oct 9 01:04:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 09 01:04:22.183309 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275705bd-d99b-4c33-b004-bb74dec09e42 admin admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:04:22.185183 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-275705bd-d99b-4c33-b004-bb74dec09e42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:04:22.292941 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275705bd-d99b-4c33-b004-bb74dec09e42 admin admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:04:22.298532 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6f42fa-b7fc-459e-85bb-7d5795801d74 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4ef90d456d2483e8ddafbe2d4d4fb5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f148d39ced534860abfbe8fc3f98ace4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:04:22.299818 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6f42fa-b7fc-459e-85bb-7d5795801d74 service neutron] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:04:22.300387 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6f42fa-b7fc-459e-85bb-7d5795801d74 service neutron] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:04:22.300940 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6f42fa-b7fc-459e-85bb-7d5795801d74 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:04:22.316754 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6f42fa-b7fc-459e-85bb-7d5795801d74 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:04:22.318443 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6f42fa-b7fc-459e-85bb-7d5795801d74 service neutron] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:04:22.336138 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1455/2878] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Oct 9 01:04:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 09 01:04:22.738931 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfb4b2c-9856-4322-a7ef-37ca24f21a9c None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:04:22.742513 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-2cfb4b2c-9856-4322-a7ef-37ca24f21a9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:04:22.764215 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfb4b2c-9856-4322-a7ef-37ca24f21a9c None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:04:22.776772 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de63540-34b8-44dd-abae-153ca3f90bb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:04:22.777735 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de63540-34b8-44dd-abae-153ca3f90bb3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:04:22.778200 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de63540-34b8-44dd-abae-153ca3f90bb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:04:22.778703 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de63540-34b8-44dd-abae-153ca3f90bb3 admin admin] PATH_INFO: `/v3/projects/2b3a2e16cf3047beabfb4022837e853b` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:04:22.780471 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de63540-34b8-44dd-abae-153ca3f90bb3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2b3a2e16cf3047beabfb4022837e853b)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:04:22.783234 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de63540-34b8-44dd-abae-153ca3f90bb3 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:04:22.863057 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-4de63540-34b8-44dd-abae-153ca3f90bb3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2b3a2e16cf3047beabfb4022837e853b', 'request_id': 'req-4de63540-34b8-44dd-abae-153ca3f90bb3'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:04:22.889701 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-4de63540-34b8-44dd-abae-153ca3f90bb3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2b3a2e16cf3047beabfb4022837e853b', 'request_id': 'req-4de63540-34b8-44dd-abae-153ca3f90bb3'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:04:22.898703 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-4de63540-34b8-44dd-abae-153ca3f90bb3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2b3a2e16cf3047beabfb4022837e853b', 'request_id': 'req-4de63540-34b8-44dd-abae-153ca3f90bb3'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:04:22.913200 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-4de63540-34b8-44dd-abae-153ca3f90bb3 admin admin] The token cache is being invalidate because project 2b3a2e16cf3047beabfb4022837e853b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81524) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 09 01:04:22.913482 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-4de63540-34b8-44dd-abae-153ca3f90bb3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:04:22.914712 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-4de63540-34b8-44dd-abae-153ca3f90bb3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:04:22.917328 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1424/2879] 10.222.0.15 () {58 vars in 1233 bytes} [Sun Oct 9 01:04:22 2022] DELETE /identity/v3/projects/2b3a2e16cf3047beabfb4022837e853b => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 01:04:22.922834 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6f42fa-b7fc-459e-85bb-7d5795801d74 service neutron] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:04:22.936656 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6f42fa-b7fc-459e-85bb-7d5795801d74 service neutron] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:04:22.984485 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 01:04:23.031047 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1652adf7-c97e-4a08-a538-98d1a577ac49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:04:23.031871 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1652adf7-c97e-4a08-a538-98d1a577ac49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:04:23.032218 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1652adf7-c97e-4a08-a538-98d1a577ac49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:04:23.032688 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1652adf7-c97e-4a08-a538-98d1a577ac49 admin admin] PATH_INFO: `/v3/users/76fe8248483547748cefb15bfe3ded7f` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:04:23.034498 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1652adf7-c97e-4a08-a538-98d1a577ac49 admin admin] RBAC: Authorizing `identity:delete_user(user_id=76fe8248483547748cefb15bfe3ded7f)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:04:23.037446 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1652adf7-c97e-4a08-a538-98d1a577ac49 admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:04:23.107736 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-1652adf7-c97e-4a08-a538-98d1a577ac49 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '76fe8248483547748cefb15bfe3ded7f'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:04:23.117741 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-1652adf7-c97e-4a08-a538-98d1a577ac49 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '76fe8248483547748cefb15bfe3ded7f'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:04:23.118543 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-1652adf7-c97e-4a08-a538-98d1a577ac49 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '76fe8248483547748cefb15bfe3ded7f'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:04:23.119216 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-1652adf7-c97e-4a08-a538-98d1a577ac49 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '76fe8248483547748cefb15bfe3ded7f'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:04:23.130048 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-1652adf7-c97e-4a08-a538-98d1a577ac49 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '76fe8248483547748cefb15bfe3ded7f'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:04:23.168097 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1456/2880] 10.222.0.15 () {58 vars in 1224 bytes} [Sun Oct 9 01:04:22 2022] DELETE /identity/v3/users/76fe8248483547748cefb15bfe3ded7f => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 09 01:04:23.635328 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de63540-34b8-44dd-abae-153ca3f90bb3 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:04:23.636173 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-4de63540-34b8-44dd-abae-153ca3f90bb3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:04:23.664369 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de63540-34b8-44dd-abae-153ca3f90bb3 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:04:23.790738 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def04352-10a8-41c0-8b29-ddecbdc8ec14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:04:23.791553 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def04352-10a8-41c0-8b29-ddecbdc8ec14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:04:23.791896 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def04352-10a8-41c0-8b29-ddecbdc8ec14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:04:23.792377 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def04352-10a8-41c0-8b29-ddecbdc8ec14 admin admin] PATH_INFO: `/v3/projects/0619ed2998b1483bbca3587dfec9951b` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:04:23.793988 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def04352-10a8-41c0-8b29-ddecbdc8ec14 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0619ed2998b1483bbca3587dfec9951b)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:04:23.796067 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def04352-10a8-41c0-8b29-ddecbdc8ec14 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:04:23.798113 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 01:04:23.880325 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-def04352-10a8-41c0-8b29-ddecbdc8ec14 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0619ed2998b1483bbca3587dfec9951b', 'request_id': 'req-def04352-10a8-41c0-8b29-ddecbdc8ec14'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:04:23.902015 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-def04352-10a8-41c0-8b29-ddecbdc8ec14 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0619ed2998b1483bbca3587dfec9951b', 'request_id': 'req-def04352-10a8-41c0-8b29-ddecbdc8ec14'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:04:23.922014 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-def04352-10a8-41c0-8b29-ddecbdc8ec14 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0619ed2998b1483bbca3587dfec9951b', 'request_id': 'req-def04352-10a8-41c0-8b29-ddecbdc8ec14'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:04:23.942720 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-def04352-10a8-41c0-8b29-ddecbdc8ec14 admin admin] The token cache is being invalidate because project 0619ed2998b1483bbca3587dfec9951b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81524) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 09 01:04:23.943220 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-def04352-10a8-41c0-8b29-ddecbdc8ec14 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:04:23.944317 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-def04352-10a8-41c0-8b29-ddecbdc8ec14 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:04:23.946664 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1425/2881] 10.222.0.15 () {58 vars in 1233 bytes} [Sun Oct 9 01:04:23 2022] DELETE /identity/v3/projects/0619ed2998b1483bbca3587dfec9951b => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 01:04:23.955902 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111b07fc-b4da-4ce2-a836-af80e2498b38 None None] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:04:23.956720 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111b07fc-b4da-4ce2-a836-af80e2498b38 None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:04:23.956720 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111b07fc-b4da-4ce2-a836-af80e2498b38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:04:24.013260 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.auth.core [None req-111b07fc-b4da-4ce2-a836-af80e2498b38 None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 01:04:24.015000 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-111b07fc-b4da-4ce2-a836-af80e2498b38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:04:24.114683 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1457/2882] 10.222.0.15 () {58 vars in 958 bytes} [Sun Oct 9 01:04:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 01:04:24.129630 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac6aebb-6150-43b1-a5d4-dcf4fdfa662c None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:04:24.130284 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac6aebb-6150-43b1-a5d4-dcf4fdfa662c None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:04:24.131010 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac6aebb-6150-43b1-a5d4-dcf4fdfa662c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:04:24.176878 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-9ac6aebb-6150-43b1-a5d4-dcf4fdfa662c None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 01:04:24.179596 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-9ac6aebb-6150-43b1-a5d4-dcf4fdfa662c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:04:24.194522 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1426/2883] 10.222.0.15 () {58 vars in 958 bytes} [Sun Oct 9 01:04:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 09 01:04:24.205402 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111b07fc-b4da-4ce2-a836-af80e2498b38 None None] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:04:24.228645 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111b07fc-b4da-4ce2-a836-af80e2498b38 None None] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:04:24.241435 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28017b0a-579a-47bc-8836-3ad63cfc4457 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:04:24.242525 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28017b0a-579a-47bc-8836-3ad63cfc4457 admin admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:04:24.243017 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28017b0a-579a-47bc-8836-3ad63cfc4457 admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:04:24.243545 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28017b0a-579a-47bc-8836-3ad63cfc4457 admin admin] PATH_INFO: `/v3/domains` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:04:24.246788 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28017b0a-579a-47bc-8836-3ad63cfc4457 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 01:04:24.246788 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28017b0a-579a-47bc-8836-3ad63cfc4457 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:04:24.250733 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28017b0a-579a-47bc-8836-3ad63cfc4457 admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:04:24.283807 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1458/2884] 10.222.0.15 () {58 vars in 1153 bytes} [Sun Oct 9 01:04:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 01:04:24.289979 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac6aebb-6150-43b1-a5d4-dcf4fdfa662c None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:04:24.302191 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac6aebb-6150-43b1-a5d4-dcf4fdfa662c None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:04:24.307524 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f9f504-8ece-4771-a687-9048953ca2b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:04:24.308185 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f9f504-8ece-4771-a687-9048953ca2b6 admin admin] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:04:24.308481 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f9f504-8ece-4771-a687-9048953ca2b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:04:24.308730 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f9f504-8ece-4771-a687-9048953ca2b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:04:24.309416 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f9f504-8ece-4771-a687-9048953ca2b6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:04:24.311826 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f9f504-8ece-4771-a687-9048953ca2b6 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:04:24.351319 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1427/2885] 10.222.0.15 () {60 vars in 1153 bytes} [Sun Oct 9 01:04:24 2022] POST /identity/v3/projects => generated 383 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 09 01:04:24.355060 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28017b0a-579a-47bc-8836-3ad63cfc4457 admin admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:04:24.371879 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28017b0a-579a-47bc-8836-3ad63cfc4457 admin admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:04:24.426417 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 01:04:24.483018 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0b8ee0-02ad-4641-b203-c986ec7b3f84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:04:24.484090 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0b8ee0-02ad-4641-b203-c986ec7b3f84 admin admin] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:04:24.484539 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0b8ee0-02ad-4641-b203-c986ec7b3f84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:04:24.485114 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0b8ee0-02ad-4641-b203-c986ec7b3f84 admin admin] PATH_INFO: `/v3/users` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:04:24.487760 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0b8ee0-02ad-4641-b203-c986ec7b3f84 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:04:24.491977 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0b8ee0-02ad-4641-b203-c986ec7b3f84 admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:04:24.530967 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1459/2886] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Oct 9 01:04:24 2022] POST /identity/v3/users => generated 292 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 09 01:04:24.537469 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f9f504-8ece-4771-a687-9048953ca2b6 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:04:24.554238 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f9f504-8ece-4771-a687-9048953ca2b6 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:04:24.563076 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434f01f5-1e03-4b7c-8c9e-576e953eb0dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:04:24.564216 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434f01f5-1e03-4b7c-8c9e-576e953eb0dd admin admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:04:24.564717 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434f01f5-1e03-4b7c-8c9e-576e953eb0dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:04:24.565251 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434f01f5-1e03-4b7c-8c9e-576e953eb0dd admin admin] PATH_INFO: `/v3/roles` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:04:24.566101 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434f01f5-1e03-4b7c-8c9e-576e953eb0dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:04:24.568635 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434f01f5-1e03-4b7c-8c9e-576e953eb0dd admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:04:24.587116 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1428/2887] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Oct 9 01:04:24 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 09 01:04:24.588696 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0b8ee0-02ad-4641-b203-c986ec7b3f84 admin admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:04:24.601988 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0b8ee0-02ad-4641-b203-c986ec7b3f84 admin admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:04:24.609893 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35557a7-f8f8-4529-a662-763aea872acf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:04:24.611528 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35557a7-f8f8-4529-a662-763aea872acf admin admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:04:24.612345 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35557a7-f8f8-4529-a662-763aea872acf admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:04:24.612832 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35557a7-f8f8-4529-a662-763aea872acf admin admin] PATH_INFO: `/v3/roles` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:04:24.614084 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35557a7-f8f8-4529-a662-763aea872acf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:04:24.616989 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35557a7-f8f8-4529-a662-763aea872acf admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:04:24.634652 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1460/2888] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Oct 9 01:04:24 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 09 01:04:24.639556 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434f01f5-1e03-4b7c-8c9e-576e953eb0dd admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:04:24.652786 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434f01f5-1e03-4b7c-8c9e-576e953eb0dd admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:04:24.658980 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c750ec1d-5b63-48fe-a123-c38ebedd28e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:04:24.659918 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c750ec1d-5b63-48fe-a123-c38ebedd28e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:04:24.660230 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c750ec1d-5b63-48fe-a123-c38ebedd28e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:04:24.660581 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c750ec1d-5b63-48fe-a123-c38ebedd28e8 admin admin] PATH_INFO: `/v3/projects/0c32983a208f47f6a0e197cb00419257/users/acba60fcd29048b29bada2fc88410386/roles/afb0a01183d9497795eaa4fa1a4046ae` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:04:24.683110 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c750ec1d-5b63-48fe-a123-c38ebedd28e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c32983a208f47f6a0e197cb00419257, user_id=acba60fcd29048b29bada2fc88410386, role_id=afb0a01183d9497795eaa4fa1a4046ae)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:04:24.685924 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c750ec1d-5b63-48fe-a123-c38ebedd28e8 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:04:24.710089 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1429/2889] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Oct 9 01:04:24 2022] PUT /identity/v3/projects/0c32983a208f47f6a0e197cb00419257/users/acba60fcd29048b29bada2fc88410386/roles/afb0a01183d9497795eaa4fa1a4046ae => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 09 01:04:24.723749 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac02319a-11ed-459e-a4d8-19c698311578 None None] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:04:24.724036 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac02319a-11ed-459e-a4d8-19c698311578 None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:04:24.724569 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac02319a-11ed-459e-a4d8-19c698311578 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:04:24.766945 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.auth.core [None req-ac02319a-11ed-459e-a4d8-19c698311578 None None] MFA Rules not processed for user `acba60fcd29048b29bada2fc88410386`. Rule list: `[]` (Enabled: `True`). {{(pid=81525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 01:04:24.768674 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-ac02319a-11ed-459e-a4d8-19c698311578 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:04:24.867344 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1461/2890] 10.222.0.15 () {58 vars in 958 bytes} [Sun Oct 9 01:04:24 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 01:04:24.901066 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c750ec1d-5b63-48fe-a123-c38ebedd28e8 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:04:24.905136 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-c750ec1d-5b63-48fe-a123-c38ebedd28e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:04:24.977356 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c750ec1d-5b63-48fe-a123-c38ebedd28e8 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:04:24.988675 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f082fb6-013b-465e-a48c-3796c0aae604 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff7cb78bcd91467abe5c2e2b48aedd1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f148d39ced534860abfbe8fc3f98ace4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:04:24.989360 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f082fb6-013b-465e-a48c-3796c0aae604 service cinder] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:04:24.989904 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f082fb6-013b-465e-a48c-3796c0aae604 service cinder] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:04:24.989904 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f082fb6-013b-465e-a48c-3796c0aae604 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:04:25.007084 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f082fb6-013b-465e-a48c-3796c0aae604 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:04:25.008624 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f082fb6-013b-465e-a48c-3796c0aae604 service cinder] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:04:25.021573 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1430/2891] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Oct 9 01:04:24 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 09 01:04:27.979114 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac02319a-11ed-459e-a4d8-19c698311578 None None] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:04:28.103590 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac02319a-11ed-459e-a4d8-19c698311578 None None] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:04:28.109818 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fecbed-e99a-441a-b85e-6ec9a2557b8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:04:28.110372 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fecbed-e99a-441a-b85e-6ec9a2557b8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:04:28.110666 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fecbed-e99a-441a-b85e-6ec9a2557b8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:04:28.110938 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fecbed-e99a-441a-b85e-6ec9a2557b8d admin admin] PATH_INFO: `/v3/users/acba60fcd29048b29bada2fc88410386` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:04:28.112987 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fecbed-e99a-441a-b85e-6ec9a2557b8d admin admin] RBAC: Authorizing `identity:delete_user(user_id=acba60fcd29048b29bada2fc88410386)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:04:28.115151 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fecbed-e99a-441a-b85e-6ec9a2557b8d admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:04:28.191291 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-b1fecbed-e99a-441a-b85e-6ec9a2557b8d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'acba60fcd29048b29bada2fc88410386'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:04:28.193220 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 01:04:28.206270 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-b1fecbed-e99a-441a-b85e-6ec9a2557b8d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'acba60fcd29048b29bada2fc88410386'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:04:28.207102 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-b1fecbed-e99a-441a-b85e-6ec9a2557b8d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'acba60fcd29048b29bada2fc88410386'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:04:28.208257 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-b1fecbed-e99a-441a-b85e-6ec9a2557b8d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'acba60fcd29048b29bada2fc88410386'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:04:28.222882 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-b1fecbed-e99a-441a-b85e-6ec9a2557b8d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'acba60fcd29048b29bada2fc88410386'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:04:28.259479 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1462/2892] 10.222.0.15 () {58 vars in 1224 bytes} [Sun Oct 9 01:04:27 2022] DELETE /identity/v3/users/acba60fcd29048b29bada2fc88410386 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 01:04:28.265082 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431424be-438d-4120-ae5d-fe25bb312fc2 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:04:28.265930 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431424be-438d-4120-ae5d-fe25bb312fc2 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:04:28.266352 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431424be-438d-4120-ae5d-fe25bb312fc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:04:28.296010 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-431424be-438d-4120-ae5d-fe25bb312fc2 None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 01:04:28.297328 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-431424be-438d-4120-ae5d-fe25bb312fc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:04:28.345687 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 01:04:28.448017 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1431/2893] 10.222.0.15 () {58 vars in 958 bytes} [Sun Oct 9 01:04:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 01:04:28.464905 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fecbed-e99a-441a-b85e-6ec9a2557b8d admin admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:04:28.467011 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-b1fecbed-e99a-441a-b85e-6ec9a2557b8d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:04:28.584651 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fecbed-e99a-441a-b85e-6ec9a2557b8d admin admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:04:28.591656 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a602dc76-9e93-4b74-8c37-4743a23ee1ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4ef90d456d2483e8ddafbe2d4d4fb5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f148d39ced534860abfbe8fc3f98ace4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:04:28.592665 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a602dc76-9e93-4b74-8c37-4743a23ee1ee service neutron] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:04:28.593112 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a602dc76-9e93-4b74-8c37-4743a23ee1ee service neutron] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:04:28.593576 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a602dc76-9e93-4b74-8c37-4743a23ee1ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:04:28.608827 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a602dc76-9e93-4b74-8c37-4743a23ee1ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:04:28.610647 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a602dc76-9e93-4b74-8c37-4743a23ee1ee service neutron] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:04:28.629655 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1463/2894] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Oct 9 01:04:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 09 01:04:29.088182 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431424be-438d-4120-ae5d-fe25bb312fc2 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:04:29.090463 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-431424be-438d-4120-ae5d-fe25bb312fc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:04:29.124577 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431424be-438d-4120-ae5d-fe25bb312fc2 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:04:29.141246 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2109416-6d89-4804-97f4-417f0f7630df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:04:29.142458 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2109416-6d89-4804-97f4-417f0f7630df admin admin] REQUEST_METHOD: `DELETE` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:04:29.143183 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2109416-6d89-4804-97f4-417f0f7630df admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:04:29.143692 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2109416-6d89-4804-97f4-417f0f7630df admin admin] PATH_INFO: `/v3/projects/0c32983a208f47f6a0e197cb00419257` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:04:29.145938 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2109416-6d89-4804-97f4-417f0f7630df admin admin] RBAC: Authorizing `identity:delete_project(project_id=0c32983a208f47f6a0e197cb00419257)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:04:29.149680 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2109416-6d89-4804-97f4-417f0f7630df admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:04:29.271304 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-d2109416-6d89-4804-97f4-417f0f7630df admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0c32983a208f47f6a0e197cb00419257', 'request_id': 'req-d2109416-6d89-4804-97f4-417f0f7630df'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:04:29.290095 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-d2109416-6d89-4804-97f4-417f0f7630df admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0c32983a208f47f6a0e197cb00419257', 'request_id': 'req-d2109416-6d89-4804-97f4-417f0f7630df'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:04:29.303820 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-d2109416-6d89-4804-97f4-417f0f7630df admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0c32983a208f47f6a0e197cb00419257', 'request_id': 'req-d2109416-6d89-4804-97f4-417f0f7630df'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:04:29.328371 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-d2109416-6d89-4804-97f4-417f0f7630df admin admin] The token cache is being invalidate because project 0c32983a208f47f6a0e197cb00419257 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81524) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 09 01:04:29.328886 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-d2109416-6d89-4804-97f4-417f0f7630df admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:04:29.330034 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-d2109416-6d89-4804-97f4-417f0f7630df admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:04:29.333148 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1432/2895] 10.222.0.15 () {58 vars in 1233 bytes} [Sun Oct 9 01:04:29 2022] DELETE /identity/v3/projects/0c32983a208f47f6a0e197cb00419257 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 01:04:38.621431 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=38,keystone:INSERT=1,keystone:DELETE=3 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 01:04:39.321747 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=41,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 01:04:43.496042 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0657d4-3907-4cbc-a15e-064eaef126ed None None] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:04:43.496603 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0657d4-3907-4cbc-a15e-064eaef126ed None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:04:43.497002 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0657d4-3907-4cbc-a15e-064eaef126ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:04:43.522807 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.auth.core [None req-ea0657d4-3907-4cbc-a15e-064eaef126ed None None] MFA Rules not processed for user `3a6cfef106c84f759ce0874be77f7380`. Rule list: `[]` (Enabled: `True`). {{(pid=81525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 01:04:43.524171 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-ea0657d4-3907-4cbc-a15e-064eaef126ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:04:43.596036 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1464/2896] 10.222.0.15 () {58 vars in 967 bytes} [Sun Oct 9 01:04:43 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 01:04:43.613057 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2109416-6d89-4804-97f4-417f0f7630df admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:04:43.615121 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-d2109416-6d89-4804-97f4-417f0f7630df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:04:43.711695 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2109416-6d89-4804-97f4-417f0f7630df admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:04:43.718447 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ae8819-b20e-4d19-b761-c1ea94511160 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c4c467943b8f4d31a2f067ca6ed3b25c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f148d39ced534860abfbe8fc3f98ace4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:04:43.719105 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ae8819-b20e-4d19-b761-c1ea94511160 service swift] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:04:43.719428 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ae8819-b20e-4d19-b761-c1ea94511160 service swift] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:04:43.719737 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ae8819-b20e-4d19-b761-c1ea94511160 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:04:43.731581 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ae8819-b20e-4d19-b761-c1ea94511160 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:04:43.733331 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ae8819-b20e-4d19-b761-c1ea94511160 service swift] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:04:43.744652 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1433/2897] 10.222.0.15 () {60 vars in 1384 bytes} [Sun Oct 9 01:04:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 09 01:04:45.822142 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0657d4-3907-4cbc-a15e-064eaef126ed None None] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:04:45.824580 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-ea0657d4-3907-4cbc-a15e-064eaef126ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:04:45.918308 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0657d4-3907-4cbc-a15e-064eaef126ed None None] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:04:45.923559 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212c83cd-a4a8-4dab-8f60-21bb3c1fd784 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:04:45.924228 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212c83cd-a4a8-4dab-8f60-21bb3c1fd784 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:04:45.924506 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212c83cd-a4a8-4dab-8f60-21bb3c1fd784 admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:04:45.924774 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212c83cd-a4a8-4dab-8f60-21bb3c1fd784 admin admin] PATH_INFO: `/v3/users/f9cd4dfbcaa143c1a3f9c93b31129a22` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:04:45.926076 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212c83cd-a4a8-4dab-8f60-21bb3c1fd784 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f9cd4dfbcaa143c1a3f9c93b31129a22)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:04:45.928105 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212c83cd-a4a8-4dab-8f60-21bb3c1fd784 admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:04:45.999809 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-212c83cd-a4a8-4dab-8f60-21bb3c1fd784 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f9cd4dfbcaa143c1a3f9c93b31129a22'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:04:46.010928 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-212c83cd-a4a8-4dab-8f60-21bb3c1fd784 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f9cd4dfbcaa143c1a3f9c93b31129a22'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:04:46.012713 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-212c83cd-a4a8-4dab-8f60-21bb3c1fd784 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f9cd4dfbcaa143c1a3f9c93b31129a22'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:04:46.013763 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-212c83cd-a4a8-4dab-8f60-21bb3c1fd784 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f9cd4dfbcaa143c1a3f9c93b31129a22'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:04:46.025782 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-212c83cd-a4a8-4dab-8f60-21bb3c1fd784 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f9cd4dfbcaa143c1a3f9c93b31129a22'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:04:46.047962 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1465/2898] 10.222.0.15 () {58 vars in 1224 bytes} [Sun Oct 9 01:04:45 2022] DELETE /identity/v3/users/f9cd4dfbcaa143c1a3f9c93b31129a22 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 09 01:04:46.260234 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ae8819-b20e-4d19-b761-c1ea94511160 service swift] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:04:46.281588 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ae8819-b20e-4d19-b761-c1ea94511160 service swift] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:04:46.367962 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5440ac1f-9a0e-46e8-bfab-5943baaa00ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:04:46.368829 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5440ac1f-9a0e-46e8-bfab-5943baaa00ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:04:46.369050 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5440ac1f-9a0e-46e8-bfab-5943baaa00ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:04:46.369277 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5440ac1f-9a0e-46e8-bfab-5943baaa00ff admin admin] PATH_INFO: `/v3/projects/bd654d4996f64022b9460f3b3076ee6d` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:04:46.370682 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5440ac1f-9a0e-46e8-bfab-5943baaa00ff admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd654d4996f64022b9460f3b3076ee6d)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:04:46.373640 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5440ac1f-9a0e-46e8-bfab-5943baaa00ff admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:04:46.432118 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-5440ac1f-9a0e-46e8-bfab-5943baaa00ff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd654d4996f64022b9460f3b3076ee6d', 'request_id': 'req-5440ac1f-9a0e-46e8-bfab-5943baaa00ff'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:04:46.445555 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-5440ac1f-9a0e-46e8-bfab-5943baaa00ff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd654d4996f64022b9460f3b3076ee6d', 'request_id': 'req-5440ac1f-9a0e-46e8-bfab-5943baaa00ff'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:04:46.454140 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-5440ac1f-9a0e-46e8-bfab-5943baaa00ff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd654d4996f64022b9460f3b3076ee6d', 'request_id': 'req-5440ac1f-9a0e-46e8-bfab-5943baaa00ff'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:04:46.465770 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-5440ac1f-9a0e-46e8-bfab-5943baaa00ff admin admin] The token cache is being invalidate because project bd654d4996f64022b9460f3b3076ee6d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81524) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 09 01:04:46.466062 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-5440ac1f-9a0e-46e8-bfab-5943baaa00ff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:04:46.466765 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-5440ac1f-9a0e-46e8-bfab-5943baaa00ff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:04:46.468316 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1434/2899] 10.222.0.15 () {58 vars in 1233 bytes} [Sun Oct 9 01:04:46 2022] DELETE /identity/v3/projects/bd654d4996f64022b9460f3b3076ee6d => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 01:04:46.474910 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a112b41a-72bf-42b8-ac98-05abae6ca253 None None] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:04:46.475190 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a112b41a-72bf-42b8-ac98-05abae6ca253 None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:04:46.475553 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a112b41a-72bf-42b8-ac98-05abae6ca253 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:04:46.498086 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.auth.core [None req-a112b41a-72bf-42b8-ac98-05abae6ca253 None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 01:04:46.499432 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-a112b41a-72bf-42b8-ac98-05abae6ca253 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:04:46.522244 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 01:04:46.569684 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1466/2900] 10.222.0.15 () {58 vars in 958 bytes} [Sun Oct 9 01:04:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 01:04:46.578049 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234aaa2e-bd2e-4784-8a8c-514e32365058 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:04:46.578395 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234aaa2e-bd2e-4784-8a8c-514e32365058 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:04:46.578581 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234aaa2e-bd2e-4784-8a8c-514e32365058 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:04:46.599497 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-234aaa2e-bd2e-4784-8a8c-514e32365058 None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 01:04:46.600736 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-234aaa2e-bd2e-4784-8a8c-514e32365058 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:04:46.609005 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1435/2901] 10.222.0.15 () {58 vars in 958 bytes} [Sun Oct 9 01:04:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 01:04:46.614261 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a112b41a-72bf-42b8-ac98-05abae6ca253 None None] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:04:46.624815 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a112b41a-72bf-42b8-ac98-05abae6ca253 None None] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:04:46.630942 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c598eb6-82ad-47b4-8b3a-1d803e8c0086 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:04:46.632050 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c598eb6-82ad-47b4-8b3a-1d803e8c0086 admin admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:04:46.632538 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c598eb6-82ad-47b4-8b3a-1d803e8c0086 admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:04:46.633007 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c598eb6-82ad-47b4-8b3a-1d803e8c0086 admin admin] PATH_INFO: `/v3/domains` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:04:46.634236 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c598eb6-82ad-47b4-8b3a-1d803e8c0086 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 01:04:46.634727 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c598eb6-82ad-47b4-8b3a-1d803e8c0086 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:04:46.637694 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c598eb6-82ad-47b4-8b3a-1d803e8c0086 admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:04:46.659874 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1467/2902] 10.222.0.15 () {58 vars in 1153 bytes} [Sun Oct 9 01:04:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 01:04:46.664831 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234aaa2e-bd2e-4784-8a8c-514e32365058 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:04:46.675828 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234aaa2e-bd2e-4784-8a8c-514e32365058 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:04:46.681633 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519e72ac-b0a6-46dc-b7b8-3fe2d9aafc29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:04:46.682262 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519e72ac-b0a6-46dc-b7b8-3fe2d9aafc29 admin admin] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:04:46.682535 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519e72ac-b0a6-46dc-b7b8-3fe2d9aafc29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:04:46.682812 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519e72ac-b0a6-46dc-b7b8-3fe2d9aafc29 admin admin] PATH_INFO: `/v3/projects` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:04:46.683676 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519e72ac-b0a6-46dc-b7b8-3fe2d9aafc29 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:04:46.685637 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519e72ac-b0a6-46dc-b7b8-3fe2d9aafc29 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:04:46.698457 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 01:04:46.720917 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1436/2903] 10.222.0.15 () {60 vars in 1153 bytes} [Sun Oct 9 01:04:46 2022] POST /identity/v3/projects => generated 373 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 09 01:04:46.725493 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c598eb6-82ad-47b4-8b3a-1d803e8c0086 admin admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:04:46.736640 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c598eb6-82ad-47b4-8b3a-1d803e8c0086 admin admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:04:46.814938 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916c2797-ff76-4f08-a12b-f6d40282cfe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:04:46.815532 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916c2797-ff76-4f08-a12b-f6d40282cfe4 admin admin] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:04:46.815822 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916c2797-ff76-4f08-a12b-f6d40282cfe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:04:46.816082 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916c2797-ff76-4f08-a12b-f6d40282cfe4 admin admin] PATH_INFO: `/v3/users` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:04:46.816808 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916c2797-ff76-4f08-a12b-f6d40282cfe4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:04:46.818809 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916c2797-ff76-4f08-a12b-f6d40282cfe4 admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:04:46.845559 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1468/2904] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Oct 9 01:04:46 2022] POST /identity/v3/users => generated 287 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 09 01:04:46.850720 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519e72ac-b0a6-46dc-b7b8-3fe2d9aafc29 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:04:46.864127 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519e72ac-b0a6-46dc-b7b8-3fe2d9aafc29 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:04:46.870197 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5774846-0cc8-4ad0-8d01-6a53405bf6a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:04:46.870829 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5774846-0cc8-4ad0-8d01-6a53405bf6a8 admin admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:04:46.871106 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5774846-0cc8-4ad0-8d01-6a53405bf6a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:04:46.871420 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5774846-0cc8-4ad0-8d01-6a53405bf6a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:04:46.872098 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5774846-0cc8-4ad0-8d01-6a53405bf6a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:04:46.873808 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5774846-0cc8-4ad0-8d01-6a53405bf6a8 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:04:46.894030 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1437/2905] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Oct 9 01:04:46 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 09 01:04:46.895495 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916c2797-ff76-4f08-a12b-f6d40282cfe4 admin admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:04:46.912413 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916c2797-ff76-4f08-a12b-f6d40282cfe4 admin admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:04:46.920942 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8f1bd0-59cc-4c2c-af00-176f5d8168d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:04:46.921883 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8f1bd0-59cc-4c2c-af00-176f5d8168d9 admin admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:04:46.922282 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8f1bd0-59cc-4c2c-af00-176f5d8168d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:04:46.922703 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8f1bd0-59cc-4c2c-af00-176f5d8168d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:04:46.923913 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8f1bd0-59cc-4c2c-af00-176f5d8168d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:04:46.926746 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8f1bd0-59cc-4c2c-af00-176f5d8168d9 admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:04:46.940676 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1469/2906] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Oct 9 01:04:46 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 09 01:04:46.945941 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5774846-0cc8-4ad0-8d01-6a53405bf6a8 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:04:46.958809 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5774846-0cc8-4ad0-8d01-6a53405bf6a8 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:04:46.964516 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32dd4e6f-0a54-46ff-a5b9-f69dc7aabc37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:04:46.965309 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dd4e6f-0a54-46ff-a5b9-f69dc7aabc37 admin admin] REQUEST_METHOD: `PUT` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:04:46.965582 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dd4e6f-0a54-46ff-a5b9-f69dc7aabc37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:04:46.965847 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dd4e6f-0a54-46ff-a5b9-f69dc7aabc37 admin admin] PATH_INFO: `/v3/projects/c374adaf91c54c1598b44f64ab5f49de/users/ca3e1e1c8f864bb2a44042db296b9ddd/roles/afb0a01183d9497795eaa4fa1a4046ae` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:04:46.985498 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32dd4e6f-0a54-46ff-a5b9-f69dc7aabc37 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c374adaf91c54c1598b44f64ab5f49de, user_id=ca3e1e1c8f864bb2a44042db296b9ddd, role_id=afb0a01183d9497795eaa4fa1a4046ae)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:04:46.988682 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32dd4e6f-0a54-46ff-a5b9-f69dc7aabc37 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:04:47.008030 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1438/2907] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Oct 9 01:04:46 2022] PUT /identity/v3/projects/c374adaf91c54c1598b44f64ab5f49de/users/ca3e1e1c8f864bb2a44042db296b9ddd/roles/afb0a01183d9497795eaa4fa1a4046ae => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 01:04:47.013655 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fe3f07-51c9-4bd9-b46d-7cf70a65c410 None None] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:04:47.014066 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fe3f07-51c9-4bd9-b46d-7cf70a65c410 None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:04:47.014434 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fe3f07-51c9-4bd9-b46d-7cf70a65c410 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:04:47.037459 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.auth.core [None req-35fe3f07-51c9-4bd9-b46d-7cf70a65c410 None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 01:04:47.039429 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-35fe3f07-51c9-4bd9-b46d-7cf70a65c410 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:04:47.113057 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1470/2908] 10.222.0.15 () {58 vars in 958 bytes} [Sun Oct 9 01:04:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 01:04:47.123927 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32dd4e6f-0a54-46ff-a5b9-f69dc7aabc37 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:04:47.126488 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-32dd4e6f-0a54-46ff-a5b9-f69dc7aabc37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:04:47.191573 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32dd4e6f-0a54-46ff-a5b9-f69dc7aabc37 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:04:47.195637 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6658f16c-2210-4c22-a6e9-b905cd09a0a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4ef90d456d2483e8ddafbe2d4d4fb5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f148d39ced534860abfbe8fc3f98ace4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:04:47.196357 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6658f16c-2210-4c22-a6e9-b905cd09a0a1 service neutron] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:04:47.196700 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6658f16c-2210-4c22-a6e9-b905cd09a0a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:04:47.196969 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6658f16c-2210-4c22-a6e9-b905cd09a0a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:04:47.207207 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6658f16c-2210-4c22-a6e9-b905cd09a0a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:04:47.208694 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6658f16c-2210-4c22-a6e9-b905cd09a0a1 service neutron] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:04:47.219453 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1439/2909] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Oct 9 01:04:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 09 01:04:48.092068 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fe3f07-51c9-4bd9-b46d-7cf70a65c410 None None] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:04:48.094560 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-35fe3f07-51c9-4bd9-b46d-7cf70a65c410 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:04:48.110460 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fe3f07-51c9-4bd9-b46d-7cf70a65c410 None None] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:04:48.119605 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b659a4-9ee7-42ce-b50d-36d2af9b8300 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:04:48.120695 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b659a4-9ee7-42ce-b50d-36d2af9b8300 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:04:48.121112 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b659a4-9ee7-42ce-b50d-36d2af9b8300 admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:04:48.121837 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b659a4-9ee7-42ce-b50d-36d2af9b8300 admin admin] PATH_INFO: `/v3/users/79cfc1e243824aeaa695d00828cb641f` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:04:48.124139 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b659a4-9ee7-42ce-b50d-36d2af9b8300 admin admin] RBAC: Authorizing `identity:delete_user(user_id=79cfc1e243824aeaa695d00828cb641f)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:04:48.127952 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b659a4-9ee7-42ce-b50d-36d2af9b8300 admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:04:48.185356 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=93,keystone:INSERT=3,keystone:DELETE=4 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 01:04:48.218049 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-c8b659a4-9ee7-42ce-b50d-36d2af9b8300 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '79cfc1e243824aeaa695d00828cb641f'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:04:48.228030 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-c8b659a4-9ee7-42ce-b50d-36d2af9b8300 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '79cfc1e243824aeaa695d00828cb641f'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:04:48.228801 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-c8b659a4-9ee7-42ce-b50d-36d2af9b8300 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '79cfc1e243824aeaa695d00828cb641f'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:04:48.229409 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-c8b659a4-9ee7-42ce-b50d-36d2af9b8300 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '79cfc1e243824aeaa695d00828cb641f'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:04:48.241641 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-c8b659a4-9ee7-42ce-b50d-36d2af9b8300 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '79cfc1e243824aeaa695d00828cb641f'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:04:48.284149 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1471/2910] 10.222.0.15 () {58 vars in 1224 bytes} [Sun Oct 9 01:04:48 2022] DELETE /identity/v3/users/79cfc1e243824aeaa695d00828cb641f => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 01:04:48.285902 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c43b34-969f-49e5-b0b6-4306a38ad341 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:04:48.287054 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c43b34-969f-49e5-b0b6-4306a38ad341 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:04:48.287054 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c43b34-969f-49e5-b0b6-4306a38ad341 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:04:48.321697 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-f0c43b34-969f-49e5-b0b6-4306a38ad341 None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 01:04:48.324702 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-f0c43b34-969f-49e5-b0b6-4306a38ad341 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:04:48.449536 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1440/2911] 10.222.0.15 () {58 vars in 958 bytes} [Sun Oct 9 01:04:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 01:04:48.457688 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b659a4-9ee7-42ce-b50d-36d2af9b8300 admin admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:04:48.461342 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-c8b659a4-9ee7-42ce-b50d-36d2af9b8300 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:04:48.571525 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b659a4-9ee7-42ce-b50d-36d2af9b8300 admin admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:04:48.575942 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25c1511-c538-4f7a-953b-4782caa8bec8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4ef90d456d2483e8ddafbe2d4d4fb5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f148d39ced534860abfbe8fc3f98ace4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:04:48.576354 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25c1511-c538-4f7a-953b-4782caa8bec8 service neutron] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:04:48.576685 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25c1511-c538-4f7a-953b-4782caa8bec8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:04:48.577653 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25c1511-c538-4f7a-953b-4782caa8bec8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:04:48.588151 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25c1511-c538-4f7a-953b-4782caa8bec8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:04:48.589627 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25c1511-c538-4f7a-953b-4782caa8bec8 service neutron] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:04:48.613647 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1472/2912] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Oct 9 01:04:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 09 01:04:49.352831 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c43b34-969f-49e5-b0b6-4306a38ad341 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:04:49.355868 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-f0c43b34-969f-49e5-b0b6-4306a38ad341 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:04:49.404736 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c43b34-969f-49e5-b0b6-4306a38ad341 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:04:49.417071 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f87b619-b744-4c0d-bab2-2177111c5a02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:04:49.418716 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f87b619-b744-4c0d-bab2-2177111c5a02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:04:49.419488 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f87b619-b744-4c0d-bab2-2177111c5a02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:04:49.420246 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f87b619-b744-4c0d-bab2-2177111c5a02 admin admin] PATH_INFO: `/v3/projects/cdd4c13ca6564a3d96d90d7faa04f295` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:04:49.423033 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f87b619-b744-4c0d-bab2-2177111c5a02 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cdd4c13ca6564a3d96d90d7faa04f295)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:04:49.426991 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f87b619-b744-4c0d-bab2-2177111c5a02 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:04:49.510190 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-6f87b619-b744-4c0d-bab2-2177111c5a02 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cdd4c13ca6564a3d96d90d7faa04f295', 'request_id': 'req-6f87b619-b744-4c0d-bab2-2177111c5a02'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:04:49.517780 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 01:04:49.526620 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-6f87b619-b744-4c0d-bab2-2177111c5a02 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cdd4c13ca6564a3d96d90d7faa04f295', 'request_id': 'req-6f87b619-b744-4c0d-bab2-2177111c5a02'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:04:49.536859 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-6f87b619-b744-4c0d-bab2-2177111c5a02 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cdd4c13ca6564a3d96d90d7faa04f295', 'request_id': 'req-6f87b619-b744-4c0d-bab2-2177111c5a02'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:04:49.553809 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-6f87b619-b744-4c0d-bab2-2177111c5a02 admin admin] The token cache is being invalidate because project cdd4c13ca6564a3d96d90d7faa04f295 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81524) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 09 01:04:49.554158 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-6f87b619-b744-4c0d-bab2-2177111c5a02 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:04:49.555165 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-6f87b619-b744-4c0d-bab2-2177111c5a02 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:04:49.558825 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1441/2913] 10.222.0.15 () {58 vars in 1233 bytes} [Sun Oct 9 01:04:49 2022] DELETE /identity/v3/projects/cdd4c13ca6564a3d96d90d7faa04f295 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 09 01:04:49.562483 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3684d85c-d6d1-4aea-936d-53d6be12ee30 None None] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:04:49.563836 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3684d85c-d6d1-4aea-936d-53d6be12ee30 None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:04:49.564417 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3684d85c-d6d1-4aea-936d-53d6be12ee30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:04:49.597587 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.auth.core [None req-3684d85c-d6d1-4aea-936d-53d6be12ee30 None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 01:04:49.599486 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-3684d85c-d6d1-4aea-936d-53d6be12ee30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:04:49.719858 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1473/2914] 10.222.0.15 () {58 vars in 958 bytes} [Sun Oct 9 01:04:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 01:04:49.729106 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5529cf-1680-47a4-a5c4-3bb7c1ab6ad3 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:04:49.729530 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5529cf-1680-47a4-a5c4-3bb7c1ab6ad3 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:04:49.729962 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5529cf-1680-47a4-a5c4-3bb7c1ab6ad3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:04:49.769421 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-af5529cf-1680-47a4-a5c4-3bb7c1ab6ad3 None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 01:04:49.772081 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-af5529cf-1680-47a4-a5c4-3bb7c1ab6ad3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:04:49.788652 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1442/2915] 10.222.0.15 () {58 vars in 958 bytes} [Sun Oct 9 01:04:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 01:04:49.793669 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3684d85c-d6d1-4aea-936d-53d6be12ee30 None None] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:04:49.811744 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3684d85c-d6d1-4aea-936d-53d6be12ee30 None None] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:04:49.820119 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e939bc5-9f43-4811-b859-c116e2cded87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:04:49.821066 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e939bc5-9f43-4811-b859-c116e2cded87 admin admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:04:49.821496 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e939bc5-9f43-4811-b859-c116e2cded87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:04:49.821894 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e939bc5-9f43-4811-b859-c116e2cded87 admin admin] PATH_INFO: `/v3/domains` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:04:49.822923 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e939bc5-9f43-4811-b859-c116e2cded87 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 09 01:04:49.825629 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e939bc5-9f43-4811-b859-c116e2cded87 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:04:49.826182 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e939bc5-9f43-4811-b859-c116e2cded87 admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:04:49.847842 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1474/2916] 10.222.0.15 () {58 vars in 1153 bytes} [Sun Oct 9 01:04:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 09 01:04:49.853188 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5529cf-1680-47a4-a5c4-3bb7c1ab6ad3 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:04:49.865523 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5529cf-1680-47a4-a5c4-3bb7c1ab6ad3 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:04:49.872285 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2acc6b0-73d3-400a-ac71-7775cb5370a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:04:49.873136 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2acc6b0-73d3-400a-ac71-7775cb5370a6 admin admin] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:04:49.873578 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2acc6b0-73d3-400a-ac71-7775cb5370a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:04:49.873922 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2acc6b0-73d3-400a-ac71-7775cb5370a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:04:49.874593 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2acc6b0-73d3-400a-ac71-7775cb5370a6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:04:49.876921 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2acc6b0-73d3-400a-ac71-7775cb5370a6 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:04:49.919316 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1443/2917] 10.222.0.15 () {60 vars in 1153 bytes} [Sun Oct 9 01:04:49 2022] POST /identity/v3/projects => generated 373 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 09 01:04:49.922255 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e939bc5-9f43-4811-b859-c116e2cded87 admin admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:04:49.935469 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e939bc5-9f43-4811-b859-c116e2cded87 admin admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:04:49.983891 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:DELETE=6,keystone:SELECT=93,keystone:INSERT=1 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 01:04:50.041930 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714d9d21-d4f2-49ca-861b-66ec4f2cba5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:04:50.043097 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714d9d21-d4f2-49ca-861b-66ec4f2cba5b admin admin] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:04:50.043696 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714d9d21-d4f2-49ca-861b-66ec4f2cba5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:04:50.044254 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714d9d21-d4f2-49ca-861b-66ec4f2cba5b admin admin] PATH_INFO: `/v3/users` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:04:50.045499 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714d9d21-d4f2-49ca-861b-66ec4f2cba5b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:04:50.049319 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714d9d21-d4f2-49ca-861b-66ec4f2cba5b admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:04:50.084160 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1475/2918] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Oct 9 01:04:49 2022] POST /identity/v3/users => generated 287 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 09 01:04:50.090353 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2acc6b0-73d3-400a-ac71-7775cb5370a6 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:04:50.105983 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2acc6b0-73d3-400a-ac71-7775cb5370a6 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:04:50.113862 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20feeab8-eee2-4c7e-b6ac-366f67fdb78f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:04:50.114906 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20feeab8-eee2-4c7e-b6ac-366f67fdb78f admin admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:04:50.115776 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20feeab8-eee2-4c7e-b6ac-366f67fdb78f admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:04:50.116267 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20feeab8-eee2-4c7e-b6ac-366f67fdb78f admin admin] PATH_INFO: `/v3/roles` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:04:50.117338 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20feeab8-eee2-4c7e-b6ac-366f67fdb78f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:04:50.120238 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20feeab8-eee2-4c7e-b6ac-366f67fdb78f admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:04:50.137564 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1444/2919] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Oct 9 01:04:50 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 09 01:04:50.143842 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714d9d21-d4f2-49ca-861b-66ec4f2cba5b admin admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:04:50.157436 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714d9d21-d4f2-49ca-861b-66ec4f2cba5b admin admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:04:50.163380 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6498fc5b-ca43-471b-bb5d-9dff5fdc3228 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:04:50.164032 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6498fc5b-ca43-471b-bb5d-9dff5fdc3228 admin admin] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:04:50.164310 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6498fc5b-ca43-471b-bb5d-9dff5fdc3228 admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:04:50.164578 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6498fc5b-ca43-471b-bb5d-9dff5fdc3228 admin admin] PATH_INFO: `/v3/roles` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:04:50.165267 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6498fc5b-ca43-471b-bb5d-9dff5fdc3228 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:04:50.166987 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6498fc5b-ca43-471b-bb5d-9dff5fdc3228 admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:04:50.178855 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1476/2920] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Oct 9 01:04:50 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 09 01:04:50.183137 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20feeab8-eee2-4c7e-b6ac-366f67fdb78f admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:04:50.194447 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20feeab8-eee2-4c7e-b6ac-366f67fdb78f admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:04:50.200031 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f692f68d-2018-4ae4-922f-e69338ea8b29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:04:50.201469 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f692f68d-2018-4ae4-922f-e69338ea8b29 admin admin] REQUEST_METHOD: `PUT` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:04:50.201469 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f692f68d-2018-4ae4-922f-e69338ea8b29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:04:50.201797 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f692f68d-2018-4ae4-922f-e69338ea8b29 admin admin] PATH_INFO: `/v3/projects/b5f0c5262efa473e817807898232efe8/users/b9e151e415954e5eaab6ab9162ccb16c/roles/afb0a01183d9497795eaa4fa1a4046ae` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:04:50.224136 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f692f68d-2018-4ae4-922f-e69338ea8b29 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5f0c5262efa473e817807898232efe8, user_id=b9e151e415954e5eaab6ab9162ccb16c, role_id=afb0a01183d9497795eaa4fa1a4046ae)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:04:50.227441 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f692f68d-2018-4ae4-922f-e69338ea8b29 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:04:50.258238 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1445/2921] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Oct 9 01:04:50 2022] PUT /identity/v3/projects/b5f0c5262efa473e817807898232efe8/users/b9e151e415954e5eaab6ab9162ccb16c/roles/afb0a01183d9497795eaa4fa1a4046ae => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 01:04:50.260796 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41219d2e-6a7e-41a8-b956-4e07c9354389 None None] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:04:50.261297 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41219d2e-6a7e-41a8-b956-4e07c9354389 None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:04:50.261796 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41219d2e-6a7e-41a8-b956-4e07c9354389 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:04:50.317516 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.auth.core [None req-41219d2e-6a7e-41a8-b956-4e07c9354389 None None] MFA Rules not processed for user `b9e151e415954e5eaab6ab9162ccb16c`. Rule list: `[]` (Enabled: `True`). {{(pid=81525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 01:04:50.320818 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-41219d2e-6a7e-41a8-b956-4e07c9354389 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:04:50.508654 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1477/2922] 10.222.0.15 () {58 vars in 958 bytes} [Sun Oct 9 01:04:50 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 09 01:04:50.509600 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f692f68d-2018-4ae4-922f-e69338ea8b29 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:04:50.511791 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-f692f68d-2018-4ae4-922f-e69338ea8b29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:04:50.671159 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f692f68d-2018-4ae4-922f-e69338ea8b29 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:04:50.675710 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fd636b-b581-42e9-9712-8fb62b307e2b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ff7cb78bcd91467abe5c2e2b48aedd1b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f148d39ced534860abfbe8fc3f98ace4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:04:50.676391 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fd636b-b581-42e9-9712-8fb62b307e2b service cinder] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:04:50.676666 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fd636b-b581-42e9-9712-8fb62b307e2b service cinder] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:04:50.676937 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fd636b-b581-42e9-9712-8fb62b307e2b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:04:50.687541 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fd636b-b581-42e9-9712-8fb62b307e2b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:04:50.689044 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fd636b-b581-42e9-9712-8fb62b307e2b service cinder] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:04:50.700241 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1446/2923] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Oct 9 01:04:50 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 09 01:04:52.578626 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e99a05e-5fee-4ba8-8bd2-27a2673827c5 None None] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:04:52.579250 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e99a05e-5fee-4ba8-8bd2-27a2673827c5 None None] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:04:52.579770 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e99a05e-5fee-4ba8-8bd2-27a2673827c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:04:52.631580 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.auth.core [None req-2e99a05e-5fee-4ba8-8bd2-27a2673827c5 None None] MFA Rules not processed for user `ca3e1e1c8f864bb2a44042db296b9ddd`. Rule list: `[]` (Enabled: `True`). {{(pid=81525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 01:04:52.633663 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-2e99a05e-5fee-4ba8-8bd2-27a2673827c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:04:52.739706 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1478/2924] 10.222.0.15 () {58 vars in 958 bytes} [Sun Oct 9 01:04:52 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 01:04:52.745270 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fd636b-b581-42e9-9712-8fb62b307e2b service cinder] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:04:52.747416 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-30fd636b-b581-42e9-9712-8fb62b307e2b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:04:52.840426 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fd636b-b581-42e9-9712-8fb62b307e2b service cinder] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:04:52.847864 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cd23da-3687-49f8-a285-ebabe5abfede admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:04:52.848506 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cd23da-3687-49f8-a285-ebabe5abfede admin admin] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:04:52.848781 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cd23da-3687-49f8-a285-ebabe5abfede admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:04:52.849052 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cd23da-3687-49f8-a285-ebabe5abfede admin admin] PATH_INFO: `/v3/projects` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:04:52.849914 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cd23da-3687-49f8-a285-ebabe5abfede admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:04:52.853489 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cd23da-3687-49f8-a285-ebabe5abfede admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:04:52.864329 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 01:04:52.905019 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1447/2925] 10.222.0.15 () {60 vars in 1153 bytes} [Sun Oct 9 01:04:52 2022] POST /identity/v3/projects => generated 369 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 09 01:04:52.909407 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e99a05e-5fee-4ba8-8bd2-27a2673827c5 None None] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:04:52.923663 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e99a05e-5fee-4ba8-8bd2-27a2673827c5 None None] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:04:52.961147 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 01:04:53.014623 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0c916b-9c6a-4b62-b7fd-03a3f0022009 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:04:53.015441 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0c916b-9c6a-4b62-b7fd-03a3f0022009 admin admin] REQUEST_METHOD: `POST` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:04:53.015816 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0c916b-9c6a-4b62-b7fd-03a3f0022009 admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:04:53.016191 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0c916b-9c6a-4b62-b7fd-03a3f0022009 admin admin] PATH_INFO: `/v3/users` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:04:53.017094 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0c916b-9c6a-4b62-b7fd-03a3f0022009 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:04:53.019867 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0c916b-9c6a-4b62-b7fd-03a3f0022009 admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:04:53.062516 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1479/2926] 10.222.0.15 () {60 vars in 1144 bytes} [Sun Oct 9 01:04:52 2022] POST /identity/v3/users => generated 291 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 09 01:04:53.064987 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cd23da-3687-49f8-a285-ebabe5abfede admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:04:53.081926 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cd23da-3687-49f8-a285-ebabe5abfede admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:04:53.091432 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae6684a-ffa4-485b-951c-1de10479f2c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:04:53.092290 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae6684a-ffa4-485b-951c-1de10479f2c1 admin admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:04:53.092628 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae6684a-ffa4-485b-951c-1de10479f2c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:04:53.092943 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae6684a-ffa4-485b-951c-1de10479f2c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:04:53.093697 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae6684a-ffa4-485b-951c-1de10479f2c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:04:53.095549 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae6684a-ffa4-485b-951c-1de10479f2c1 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:04:53.115668 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1448/2927] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Oct 9 01:04:53 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 09 01:04:53.121010 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0c916b-9c6a-4b62-b7fd-03a3f0022009 admin admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:04:53.132621 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0c916b-9c6a-4b62-b7fd-03a3f0022009 admin admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:04:53.138585 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35946fea-3fce-4b73-a727-79b99d29b34f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:04:53.139577 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35946fea-3fce-4b73-a727-79b99d29b34f admin admin] REQUEST_METHOD: `PUT` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:04:53.139918 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35946fea-3fce-4b73-a727-79b99d29b34f admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:04:53.140231 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35946fea-3fce-4b73-a727-79b99d29b34f admin admin] PATH_INFO: `/v3/projects/ba40b5b5e53a4b9aa79120e9b40e497f/users/656c0768b6cd40efaeeccb2d0695595e/roles/f69dddf26daf4dd79d4c962beb877af5` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:04:53.159363 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35946fea-3fce-4b73-a727-79b99d29b34f admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba40b5b5e53a4b9aa79120e9b40e497f, user_id=656c0768b6cd40efaeeccb2d0695595e, role_id=f69dddf26daf4dd79d4c962beb877af5)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:04:53.162409 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35946fea-3fce-4b73-a727-79b99d29b34f admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:04:53.188640 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1480/2928] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Oct 9 01:04:53 2022] PUT /identity/v3/projects/ba40b5b5e53a4b9aa79120e9b40e497f/users/656c0768b6cd40efaeeccb2d0695595e/roles/f69dddf26daf4dd79d4c962beb877af5 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 09 01:04:53.193896 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae6684a-ffa4-485b-951c-1de10479f2c1 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:04:53.210616 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae6684a-ffa4-485b-951c-1de10479f2c1 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:04:53.310542 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adec73a0-a8e6-4ad0-943e-fc691630c459 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:04:53.311844 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adec73a0-a8e6-4ad0-943e-fc691630c459 admin admin] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:04:53.312444 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adec73a0-a8e6-4ad0-943e-fc691630c459 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:04:53.312895 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adec73a0-a8e6-4ad0-943e-fc691630c459 admin admin] PATH_INFO: `/v3/roles` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:04:53.314161 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adec73a0-a8e6-4ad0-943e-fc691630c459 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:04:53.317323 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adec73a0-a8e6-4ad0-943e-fc691630c459 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:04:53.338727 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1449/2929] 10.222.0.15 () {58 vars in 1122 bytes} [Sun Oct 9 01:04:53 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 09 01:04:53.344157 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35946fea-3fce-4b73-a727-79b99d29b34f admin admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:04:53.363110 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35946fea-3fce-4b73-a727-79b99d29b34f admin admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:04:53.372462 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1d50d8-624f-4151-953f-9a6e1fe2181b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:04:53.374114 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1d50d8-624f-4151-953f-9a6e1fe2181b admin admin] REQUEST_METHOD: `PUT` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:04:53.374579 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1d50d8-624f-4151-953f-9a6e1fe2181b admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:04:53.375046 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1d50d8-624f-4151-953f-9a6e1fe2181b admin admin] PATH_INFO: `/v3/projects/ba40b5b5e53a4b9aa79120e9b40e497f/users/656c0768b6cd40efaeeccb2d0695595e/roles/f69dddf26daf4dd79d4c962beb877af5` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:04:53.380128 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1d50d8-624f-4151-953f-9a6e1fe2181b admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba40b5b5e53a4b9aa79120e9b40e497f, user_id=656c0768b6cd40efaeeccb2d0695595e, role_id=f69dddf26daf4dd79d4c962beb877af5)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:04:53.383858 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1d50d8-624f-4151-953f-9a6e1fe2181b admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:04:53.399934 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1481/2930] 10.222.0.15 () {60 vars in 1483 bytes} [Sun Oct 9 01:04:53 2022] PUT /identity/v3/projects/ba40b5b5e53a4b9aa79120e9b40e497f/users/656c0768b6cd40efaeeccb2d0695595e/roles/f69dddf26daf4dd79d4c962beb877af5 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 01:04:59.222053 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5295fefc-db62-426d-a960-8b12aab4c97c None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:04:59.222666 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5295fefc-db62-426d-a960-8b12aab4c97c None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:04:59.222821 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5295fefc-db62-426d-a960-8b12aab4c97c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:04:59.282687 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-5295fefc-db62-426d-a960-8b12aab4c97c None None] MFA Rules not processed for user `656c0768b6cd40efaeeccb2d0695595e`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 01:04:59.285843 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-5295fefc-db62-426d-a960-8b12aab4c97c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:04:59.426999 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1450/2931] 10.222.0.15 () {58 vars in 958 bytes} [Sun Oct 9 01:04:59 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 01:04:59.461080 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1d50d8-624f-4151-953f-9a6e1fe2181b admin admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:04:59.463774 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-fa1d50d8-624f-4151-953f-9a6e1fe2181b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:04:59.687288 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1d50d8-624f-4151-953f-9a6e1fe2181b admin admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:04:59.697564 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37ffa6b-1129-4faf-9135-e51b044580af service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ac83d57fba841e0a666710732249c49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f148d39ced534860abfbe8fc3f98ace4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:04:59.699032 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37ffa6b-1129-4faf-9135-e51b044580af service nova] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:04:59.699743 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37ffa6b-1129-4faf-9135-e51b044580af service nova] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:04:59.702315 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37ffa6b-1129-4faf-9135-e51b044580af service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:04:59.863124 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37ffa6b-1129-4faf-9135-e51b044580af service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:04:59.868176 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37ffa6b-1129-4faf-9135-e51b044580af service nova] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:04:59.874119 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 01:04:59.887535 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1482/2932] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Oct 9 01:04:59 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 09 01:05:01.261443 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278dad0e-fc79-4226-bd5b-ce9021fba848 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:05:01.261992 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278dad0e-fc79-4226-bd5b-ce9021fba848 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:05:01.261992 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278dad0e-fc79-4226-bd5b-ce9021fba848 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:05:01.285566 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-278dad0e-fc79-4226-bd5b-ce9021fba848 None None] MFA Rules not processed for user `ca3e1e1c8f864bb2a44042db296b9ddd`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 01:05:01.286878 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-278dad0e-fc79-4226-bd5b-ce9021fba848 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:05:01.296988 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1451/2933] 10.222.0.15 () {58 vars in 958 bytes} [Sun Oct 9 01:05:01 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 01:05:03.709604 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37ffa6b-1129-4faf-9135-e51b044580af service nova] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:05:03.817374 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37ffa6b-1129-4faf-9135-e51b044580af service nova] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:05:03.827239 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ce5ee3-8f48-409f-aecb-2d2a5e75f87c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:05:03.828381 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ce5ee3-8f48-409f-aecb-2d2a5e75f87c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:05:03.828877 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ce5ee3-8f48-409f-aecb-2d2a5e75f87c admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:05:03.829365 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ce5ee3-8f48-409f-aecb-2d2a5e75f87c admin admin] PATH_INFO: `/v3/users/b9e151e415954e5eaab6ab9162ccb16c` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:05:03.831774 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ce5ee3-8f48-409f-aecb-2d2a5e75f87c admin admin] RBAC: Authorizing `identity:delete_user(user_id=b9e151e415954e5eaab6ab9162ccb16c)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:05:03.836449 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ce5ee3-8f48-409f-aecb-2d2a5e75f87c admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:05:03.935287 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-d4ce5ee3-8f48-409f-aecb-2d2a5e75f87c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b9e151e415954e5eaab6ab9162ccb16c'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:05:03.947886 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-d4ce5ee3-8f48-409f-aecb-2d2a5e75f87c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b9e151e415954e5eaab6ab9162ccb16c'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:05:03.948682 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-d4ce5ee3-8f48-409f-aecb-2d2a5e75f87c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b9e151e415954e5eaab6ab9162ccb16c'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:05:03.949374 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-d4ce5ee3-8f48-409f-aecb-2d2a5e75f87c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b9e151e415954e5eaab6ab9162ccb16c'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:05:03.962796 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-d4ce5ee3-8f48-409f-aecb-2d2a5e75f87c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b9e151e415954e5eaab6ab9162ccb16c'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:05:04.003650 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1483/2934] 10.222.0.15 () {58 vars in 1224 bytes} [Sun Oct 9 01:05:03 2022] DELETE /identity/v3/users/b9e151e415954e5eaab6ab9162ccb16c => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 01:05:04.013063 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf0a5b4-c334-4947-a1cd-fe567bccd841 None None] REQUEST_METHOD: `POST` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:05:04.013063 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf0a5b4-c334-4947-a1cd-fe567bccd841 None None] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:05:04.013063 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf0a5b4-c334-4947-a1cd-fe567bccd841 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:05:04.035453 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.auth.core [None req-bdf0a5b4-c334-4947-a1cd-fe567bccd841 None None] MFA Rules not processed for user `99441f7488cd4b83be4affd132b7c074`. Rule list: `[]` (Enabled: `True`). {{(pid=81524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 09 01:05:04.036900 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-bdf0a5b4-c334-4947-a1cd-fe567bccd841 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:05:04.135352 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 01:05:04.179371 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1452/2935] 10.222.0.15 () {58 vars in 958 bytes} [Sun Oct 9 01:05:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 09 01:05:04.192752 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ce5ee3-8f48-409f-aecb-2d2a5e75f87c admin admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:05:04.194548 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-d4ce5ee3-8f48-409f-aecb-2d2a5e75f87c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:05:04.298467 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ce5ee3-8f48-409f-aecb-2d2a5e75f87c admin admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:05:04.302885 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0692b3bb-f524-48ca-b35b-ca7cd35418f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4ef90d456d2483e8ddafbe2d4d4fb5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f148d39ced534860abfbe8fc3f98ace4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:05:04.303587 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0692b3bb-f524-48ca-b35b-ca7cd35418f6 service neutron] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:05:04.303861 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0692b3bb-f524-48ca-b35b-ca7cd35418f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:05:04.304131 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0692b3bb-f524-48ca-b35b-ca7cd35418f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:05:04.317147 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0692b3bb-f524-48ca-b35b-ca7cd35418f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:05:04.319836 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0692b3bb-f524-48ca-b35b-ca7cd35418f6 service neutron] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:05:04.338310 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1484/2936] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Oct 9 01:05:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 09 01:05:04.770264 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf0a5b4-c334-4947-a1cd-fe567bccd841 None None] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:05:04.772033 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-bdf0a5b4-c334-4947-a1cd-fe567bccd841 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:05:04.790162 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf0a5b4-c334-4947-a1cd-fe567bccd841 None None] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:05:04.795308 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd77833-5572-447d-aaa0-748d7246cc31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:05:04.795962 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd77833-5572-447d-aaa0-748d7246cc31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:05:04.796253 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd77833-5572-447d-aaa0-748d7246cc31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:05:04.796515 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd77833-5572-447d-aaa0-748d7246cc31 admin admin] PATH_INFO: `/v3/projects/b5f0c5262efa473e817807898232efe8` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:05:04.797798 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd77833-5572-447d-aaa0-748d7246cc31 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b5f0c5262efa473e817807898232efe8)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:05:04.801264 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd77833-5572-447d-aaa0-748d7246cc31 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:05:04.864487 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-8bd77833-5572-447d-aaa0-748d7246cc31 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b5f0c5262efa473e817807898232efe8', 'request_id': 'req-8bd77833-5572-447d-aaa0-748d7246cc31'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:05:04.877597 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-8bd77833-5572-447d-aaa0-748d7246cc31 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b5f0c5262efa473e817807898232efe8', 'request_id': 'req-8bd77833-5572-447d-aaa0-748d7246cc31'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:05:04.890413 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-8bd77833-5572-447d-aaa0-748d7246cc31 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b5f0c5262efa473e817807898232efe8', 'request_id': 'req-8bd77833-5572-447d-aaa0-748d7246cc31'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:05:04.909821 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-8bd77833-5572-447d-aaa0-748d7246cc31 admin admin] The token cache is being invalidate because project b5f0c5262efa473e817807898232efe8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81524) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 09 01:05:04.910258 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-8bd77833-5572-447d-aaa0-748d7246cc31 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:05:04.911408 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-8bd77833-5572-447d-aaa0-748d7246cc31 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:05:04.913994 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1453/2937] 10.222.0.15 () {58 vars in 1233 bytes} [Sun Oct 9 01:05:04 2022] DELETE /identity/v3/projects/b5f0c5262efa473e817807898232efe8 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 09 01:05:14.330883 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=79,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 01:05:14.903800 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=31,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 01:05:25.833620 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0692b3bb-f524-48ca-b35b-ca7cd35418f6 service neutron] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:05:25.843313 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0692b3bb-f524-48ca-b35b-ca7cd35418f6 service neutron] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:05:25.904356 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab59a1c-59b3-4e2d-ba81-eea1a2f02ce9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4ef90d456d2483e8ddafbe2d4d4fb5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f148d39ced534860abfbe8fc3f98ace4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:05:25.905121 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab59a1c-59b3-4e2d-ba81-eea1a2f02ce9 service neutron] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:05:25.905496 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab59a1c-59b3-4e2d-ba81-eea1a2f02ce9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:05:25.905956 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab59a1c-59b3-4e2d-ba81-eea1a2f02ce9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:05:25.908078 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-8ab59a1c-59b3-4e2d-ba81-eea1a2f02ce9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:05:25.986017 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab59a1c-59b3-4e2d-ba81-eea1a2f02ce9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:05:25.987618 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab59a1c-59b3-4e2d-ba81-eea1a2f02ce9 service neutron] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:05:25.998776 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1485/2938] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Oct 9 01:05:25 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 09 01:05:35.994239 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=50 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 01:07:15.009167 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd77833-5572-447d-aaa0-748d7246cc31 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:07:15.010930 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-8bd77833-5572-447d-aaa0-748d7246cc31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:07:15.028296 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd77833-5572-447d-aaa0-748d7246cc31 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:07:15.033713 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0389eacb-5d23-4e46-b921-320c74c4416d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4ef90d456d2483e8ddafbe2d4d4fb5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f148d39ced534860abfbe8fc3f98ace4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:07:15.034375 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0389eacb-5d23-4e46-b921-320c74c4416d service neutron] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:07:15.034652 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0389eacb-5d23-4e46-b921-320c74c4416d service neutron] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:07:15.034925 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0389eacb-5d23-4e46-b921-320c74c4416d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:07:15.037336 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-0389eacb-5d23-4e46-b921-320c74c4416d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:07:15.049293 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0389eacb-5d23-4e46-b921-320c74c4416d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:07:15.050853 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0389eacb-5d23-4e46-b921-320c74c4416d service neutron] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:07:15.065982 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1454/2939] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Oct 9 01:07:15 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 09 01:07:19.525223 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab59a1c-59b3-4e2d-ba81-eea1a2f02ce9 service neutron] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:07:19.526953 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-8ab59a1c-59b3-4e2d-ba81-eea1a2f02ce9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:07:19.539606 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab59a1c-59b3-4e2d-ba81-eea1a2f02ce9 service neutron] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:07:19.543844 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b1554d-b0aa-4110-8899-a181f2afdc68 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4ef90d456d2483e8ddafbe2d4d4fb5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f148d39ced534860abfbe8fc3f98ace4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:07:19.544504 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b1554d-b0aa-4110-8899-a181f2afdc68 service neutron] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:07:19.544779 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b1554d-b0aa-4110-8899-a181f2afdc68 service neutron] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:07:19.545050 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b1554d-b0aa-4110-8899-a181f2afdc68 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:07:19.546963 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-45b1554d-b0aa-4110-8899-a181f2afdc68 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:07:19.628118 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b1554d-b0aa-4110-8899-a181f2afdc68 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:07:19.629760 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b1554d-b0aa-4110-8899-a181f2afdc68 service neutron] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:07:19.642563 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1486/2940] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Oct 9 01:07:19 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 09 01:07:20.865652 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0389eacb-5d23-4e46-b921-320c74c4416d service neutron] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:07:20.876144 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0389eacb-5d23-4e46-b921-320c74c4416d service neutron] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:07:20.880727 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e92d21-0e43-4b1a-9818-5c9f0fe2c3e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4ef90d456d2483e8ddafbe2d4d4fb5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f148d39ced534860abfbe8fc3f98ace4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:07:20.881509 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e92d21-0e43-4b1a-9818-5c9f0fe2c3e6 service neutron] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:07:20.881886 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e92d21-0e43-4b1a-9818-5c9f0fe2c3e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:07:20.882294 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e92d21-0e43-4b1a-9818-5c9f0fe2c3e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:07:20.884579 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-22e92d21-0e43-4b1a-9818-5c9f0fe2c3e6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:07:20.900486 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e92d21-0e43-4b1a-9818-5c9f0fe2c3e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:07:20.901970 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e92d21-0e43-4b1a-9818-5c9f0fe2c3e6 service neutron] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:07:20.915719 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1455/2941] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Oct 9 01:07:20 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 09 01:07:29.636902 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=34 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 01:07:30.909067 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=12 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 01:07:33.539913 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b1554d-b0aa-4110-8899-a181f2afdc68 service neutron] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:07:33.551382 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b1554d-b0aa-4110-8899-a181f2afdc68 service neutron] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:07:33.557179 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee01198d-d602-44c9-b77a-1d8d509d7403 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4ef90d456d2483e8ddafbe2d4d4fb5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f148d39ced534860abfbe8fc3f98ace4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:07:33.558179 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee01198d-d602-44c9-b77a-1d8d509d7403 service neutron] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:07:33.558745 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee01198d-d602-44c9-b77a-1d8d509d7403 service neutron] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:07:33.559184 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee01198d-d602-44c9-b77a-1d8d509d7403 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:07:33.561966 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-ee01198d-d602-44c9-b77a-1d8d509d7403 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:07:33.578523 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee01198d-d602-44c9-b77a-1d8d509d7403 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:07:33.580612 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee01198d-d602-44c9-b77a-1d8d509d7403 service neutron] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:07:33.593564 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1487/2942] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Oct 9 01:07:33 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 09 01:07:33.717491 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e92d21-0e43-4b1a-9818-5c9f0fe2c3e6 service neutron] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:07:33.727488 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e92d21-0e43-4b1a-9818-5c9f0fe2c3e6 service neutron] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:07:33.732479 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef2945d-5ef5-4325-a2fe-3f2b7c454ff6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4ef90d456d2483e8ddafbe2d4d4fb5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f148d39ced534860abfbe8fc3f98ace4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:07:33.733265 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef2945d-5ef5-4325-a2fe-3f2b7c454ff6 service neutron] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:07:33.733647 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef2945d-5ef5-4325-a2fe-3f2b7c454ff6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:07:33.734030 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef2945d-5ef5-4325-a2fe-3f2b7c454ff6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:07:33.736984 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-6ef2945d-5ef5-4325-a2fe-3f2b7c454ff6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:07:33.756028 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef2945d-5ef5-4325-a2fe-3f2b7c454ff6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:07:33.759038 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef2945d-5ef5-4325-a2fe-3f2b7c454ff6 service neutron] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:07:33.776975 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1456/2943] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Oct 9 01:07:33 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 09 01:07:33.849951 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee01198d-d602-44c9-b77a-1d8d509d7403 service neutron] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:07:33.851665 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-ee01198d-d602-44c9-b77a-1d8d509d7403 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:07:33.940545 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee01198d-d602-44c9-b77a-1d8d509d7403 service neutron] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:07:33.946251 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560bb9db-3dab-4921-b0e1-4648b5da6cae service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64be9d44437e4247a72334b9bab3cdd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f148d39ced534860abfbe8fc3f98ace4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:07:33.946816 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560bb9db-3dab-4921-b0e1-4648b5da6cae service placement] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:07:33.947098 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560bb9db-3dab-4921-b0e1-4648b5da6cae service placement] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:07:33.947412 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560bb9db-3dab-4921-b0e1-4648b5da6cae service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:07:33.949375 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-560bb9db-3dab-4921-b0e1-4648b5da6cae service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:07:33.962364 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560bb9db-3dab-4921-b0e1-4648b5da6cae service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:07:33.964248 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560bb9db-3dab-4921-b0e1-4648b5da6cae service placement] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:07:33.976813 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1488/2944] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Oct 9 01:07:33 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 09 01:07:35.841450 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef2945d-5ef5-4325-a2fe-3f2b7c454ff6 service neutron] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:07:35.844127 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-6ef2945d-5ef5-4325-a2fe-3f2b7c454ff6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:07:35.866357 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef2945d-5ef5-4325-a2fe-3f2b7c454ff6 service neutron] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:07:35.876221 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484c63f6-a86c-477d-8f7e-67bcd1139687 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ac83d57fba841e0a666710732249c49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f148d39ced534860abfbe8fc3f98ace4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:07:35.877056 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484c63f6-a86c-477d-8f7e-67bcd1139687 service nova] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:07:35.877517 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484c63f6-a86c-477d-8f7e-67bcd1139687 service nova] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:07:35.877981 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484c63f6-a86c-477d-8f7e-67bcd1139687 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:07:35.880800 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-484c63f6-a86c-477d-8f7e-67bcd1139687 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:07:35.899042 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484c63f6-a86c-477d-8f7e-67bcd1139687 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:07:35.901480 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484c63f6-a86c-477d-8f7e-67bcd1139687 service nova] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:07:35.920576 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1457/2945] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Oct 9 01:07:35 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 09 01:07:43.971303 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=38 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 01:07:45.912017 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=12 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 01:08:56.804379 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560bb9db-3dab-4921-b0e1-4648b5da6cae service placement] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:08:56.808799 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-560bb9db-3dab-4921-b0e1-4648b5da6cae service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:08:56.841308 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560bb9db-3dab-4921-b0e1-4648b5da6cae service placement] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:08:56.851289 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b947cd4-205e-4fd2-9e34-1c6d6892e128 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4ac83d57fba841e0a666710732249c49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f148d39ced534860abfbe8fc3f98ace4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:08:56.853306 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b947cd4-205e-4fd2-9e34-1c6d6892e128 service nova] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:08:56.853306 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b947cd4-205e-4fd2-9e34-1c6d6892e128 service nova] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:08:56.853674 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b947cd4-205e-4fd2-9e34-1c6d6892e128 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:08:56.858661 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-9b947cd4-205e-4fd2-9e34-1c6d6892e128 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:08:56.883094 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b947cd4-205e-4fd2-9e34-1c6d6892e128 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:08:56.885375 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b947cd4-205e-4fd2-9e34-1c6d6892e128 service nova] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:08:56.915356 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1489/2946] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Oct 9 01:08:56 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 09 01:09:04.921078 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484c63f6-a86c-477d-8f7e-67bcd1139687 service nova] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:09:04.934384 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484c63f6-a86c-477d-8f7e-67bcd1139687 service nova] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:09:04.940054 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9914af5-be95-4d54-9ff6-05cb4d7b80dc service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64be9d44437e4247a72334b9bab3cdd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f148d39ced534860abfbe8fc3f98ace4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:09:04.941220 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9914af5-be95-4d54-9ff6-05cb4d7b80dc service placement] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:09:04.941518 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9914af5-be95-4d54-9ff6-05cb4d7b80dc service placement] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:09:04.941791 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9914af5-be95-4d54-9ff6-05cb4d7b80dc service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:09:04.943843 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-c9914af5-be95-4d54-9ff6-05cb4d7b80dc service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:09:04.958079 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9914af5-be95-4d54-9ff6-05cb4d7b80dc service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:09:04.960181 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9914af5-be95-4d54-9ff6-05cb4d7b80dc service placement] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:09:04.973173 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1458/2947] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Oct 9 01:09:04 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 09 01:09:06.896529 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=6 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 01:09:09.029277 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b947cd4-205e-4fd2-9e34-1c6d6892e128 service nova] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:09:09.045104 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b947cd4-205e-4fd2-9e34-1c6d6892e128 service nova] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:09:09.054412 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2125a7-e722-40e7-bed1-7189f197e08f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64be9d44437e4247a72334b9bab3cdd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f148d39ced534860abfbe8fc3f98ace4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:09:09.055442 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2125a7-e722-40e7-bed1-7189f197e08f service placement] REQUEST_METHOD: `GET` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:09:09.055907 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2125a7-e722-40e7-bed1-7189f197e08f service placement] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:09:09.056366 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2125a7-e722-40e7-bed1-7189f197e08f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:09:09.059493 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-ee2125a7-e722-40e7-bed1-7189f197e08f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:09:09.080955 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2125a7-e722-40e7-bed1-7189f197e08f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:09:09.083861 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2125a7-e722-40e7-bed1-7189f197e08f service placement] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:09:09.103216 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1490/2948] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Oct 9 01:09:09 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 09 01:09:09.144290 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9914af5-be95-4d54-9ff6-05cb4d7b80dc service placement] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:09:09.147485 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-c9914af5-be95-4d54-9ff6-05cb4d7b80dc service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:09:09.235007 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9914af5-be95-4d54-9ff6-05cb4d7b80dc service placement] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:09:09.241607 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb396fdf-071e-4f7a-aed6-26ee6597f824 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:09:09.242353 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb396fdf-071e-4f7a-aed6-26ee6597f824 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:09:09.242688 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb396fdf-071e-4f7a-aed6-26ee6597f824 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:09:09.243135 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb396fdf-071e-4f7a-aed6-26ee6597f824 admin admin] PATH_INFO: `/v3/users/ca3e1e1c8f864bb2a44042db296b9ddd` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:09:09.244756 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb396fdf-071e-4f7a-aed6-26ee6597f824 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ca3e1e1c8f864bb2a44042db296b9ddd)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:09:09.247096 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb396fdf-071e-4f7a-aed6-26ee6597f824 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:09:09.317484 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-cb396fdf-071e-4f7a-aed6-26ee6597f824 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ca3e1e1c8f864bb2a44042db296b9ddd'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:09:09.331218 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-cb396fdf-071e-4f7a-aed6-26ee6597f824 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ca3e1e1c8f864bb2a44042db296b9ddd'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:09:09.332418 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-cb396fdf-071e-4f7a-aed6-26ee6597f824 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ca3e1e1c8f864bb2a44042db296b9ddd'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:09:09.333390 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-cb396fdf-071e-4f7a-aed6-26ee6597f824 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ca3e1e1c8f864bb2a44042db296b9ddd'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:09:09.345363 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-cb396fdf-071e-4f7a-aed6-26ee6597f824 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ca3e1e1c8f864bb2a44042db296b9ddd'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:09:09.369639 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1459/2949] 10.222.0.15 () {58 vars in 1224 bytes} [Sun Oct 9 01:09:09 2022] DELETE /identity/v3/users/ca3e1e1c8f864bb2a44042db296b9ddd => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 01:09:09.594960 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2125a7-e722-40e7-bed1-7189f197e08f service placement] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:09:09.614733 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2125a7-e722-40e7-bed1-7189f197e08f service placement] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:09:09.706547 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14863144-4b5a-47cc-a030-8dd642eb14e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:09:09.707534 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14863144-4b5a-47cc-a030-8dd642eb14e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:09:09.707879 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14863144-4b5a-47cc-a030-8dd642eb14e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:09:09.708341 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14863144-4b5a-47cc-a030-8dd642eb14e4 admin admin] PATH_INFO: `/v3/projects/c374adaf91c54c1598b44f64ab5f49de` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:09:09.709950 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14863144-4b5a-47cc-a030-8dd642eb14e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c374adaf91c54c1598b44f64ab5f49de)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:09:09.712537 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14863144-4b5a-47cc-a030-8dd642eb14e4 admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:09:09.778442 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-14863144-4b5a-47cc-a030-8dd642eb14e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c374adaf91c54c1598b44f64ab5f49de', 'request_id': 'req-14863144-4b5a-47cc-a030-8dd642eb14e4'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:09:09.788605 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-14863144-4b5a-47cc-a030-8dd642eb14e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c374adaf91c54c1598b44f64ab5f49de', 'request_id': 'req-14863144-4b5a-47cc-a030-8dd642eb14e4'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:09:09.796671 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-14863144-4b5a-47cc-a030-8dd642eb14e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c374adaf91c54c1598b44f64ab5f49de', 'request_id': 'req-14863144-4b5a-47cc-a030-8dd642eb14e4'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:09:09.809247 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-14863144-4b5a-47cc-a030-8dd642eb14e4 admin admin] The token cache is being invalidate because project c374adaf91c54c1598b44f64ab5f49de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81525) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 09 01:09:09.809518 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-14863144-4b5a-47cc-a030-8dd642eb14e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:09:09.810219 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-14863144-4b5a-47cc-a030-8dd642eb14e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:09:09.811944 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1491/2950] 10.222.0.15 () {58 vars in 1233 bytes} [Sun Oct 9 01:09:09 2022] DELETE /identity/v3/projects/c374adaf91c54c1598b44f64ab5f49de => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 01:09:09.816817 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb396fdf-071e-4f7a-aed6-26ee6597f824 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:09:09.818421 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-cb396fdf-071e-4f7a-aed6-26ee6597f824 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:09:09.833085 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb396fdf-071e-4f7a-aed6-26ee6597f824 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:09:09.908425 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41f0baf-cded-48b3-b7af-1393f435cd06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:09:09.909356 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41f0baf-cded-48b3-b7af-1393f435cd06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:09:09.909695 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41f0baf-cded-48b3-b7af-1393f435cd06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:09:09.909972 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41f0baf-cded-48b3-b7af-1393f435cd06 admin admin] PATH_INFO: `/v3/users/656c0768b6cd40efaeeccb2d0695595e` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:09:09.911489 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41f0baf-cded-48b3-b7af-1393f435cd06 admin admin] RBAC: Authorizing `identity:delete_user(user_id=656c0768b6cd40efaeeccb2d0695595e)` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:09:09.913429 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41f0baf-cded-48b3-b7af-1393f435cd06 admin admin] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:09:09.920647 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 01:09:09.981419 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-e41f0baf-cded-48b3-b7af-1393f435cd06 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '656c0768b6cd40efaeeccb2d0695595e'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:09:09.991461 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-e41f0baf-cded-48b3-b7af-1393f435cd06 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '656c0768b6cd40efaeeccb2d0695595e'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:09:09.992334 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-e41f0baf-cded-48b3-b7af-1393f435cd06 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '656c0768b6cd40efaeeccb2d0695595e'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:09:09.993060 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-e41f0baf-cded-48b3-b7af-1393f435cd06 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '656c0768b6cd40efaeeccb2d0695595e'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:09:10.005854 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.notifications [None req-e41f0baf-cded-48b3-b7af-1393f435cd06 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '656c0768b6cd40efaeeccb2d0695595e'} {{(pid=81524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:09:10.029693 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1460/2951] 10.222.0.15 () {58 vars in 1224 bytes} [Sun Oct 9 01:09:09 2022] DELETE /identity/v3/users/656c0768b6cd40efaeeccb2d0695595e => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 01:09:10.235705 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14863144-4b5a-47cc-a030-8dd642eb14e4 admin admin] Authenticating user token {{(pid=81525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:09:10.237901 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.fernet_utils [None req-14863144-4b5a-47cc-a030-8dd642eb14e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:09:10.258716 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14863144-4b5a-47cc-a030-8dd642eb14e4 admin admin] Validating token access rules against request {{(pid=81525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:09:10.337096 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec7f3c3-c4f5-4cf7-90dc-205c81be0d77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99441f7488cd4b83be4affd132b7c074', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4024dc4bc9484e24953f0b564215ab2a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:09:10.338196 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec7f3c3-c4f5-4cf7-90dc-205c81be0d77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:09:10.338572 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec7f3c3-c4f5-4cf7-90dc-205c81be0d77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:09:10.338967 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec7f3c3-c4f5-4cf7-90dc-205c81be0d77 admin admin] PATH_INFO: `/v3/projects/ba40b5b5e53a4b9aa79120e9b40e497f` {{(pid=81525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:09:10.340709 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec7f3c3-c4f5-4cf7-90dc-205c81be0d77 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ba40b5b5e53a4b9aa79120e9b40e497f)` {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:09:10.343544 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec7f3c3-c4f5-4cf7-90dc-205c81be0d77 admin admin] RBAC: Authorization granted {{(pid=81525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:09:10.369270 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 01:09:10.408746 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-8ec7f3c3-c4f5-4cf7-90dc-205c81be0d77 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba40b5b5e53a4b9aa79120e9b40e497f', 'request_id': 'req-8ec7f3c3-c4f5-4cf7-90dc-205c81be0d77'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:09:10.418897 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-8ec7f3c3-c4f5-4cf7-90dc-205c81be0d77 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba40b5b5e53a4b9aa79120e9b40e497f', 'request_id': 'req-8ec7f3c3-c4f5-4cf7-90dc-205c81be0d77'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:09:10.426786 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-8ec7f3c3-c4f5-4cf7-90dc-205c81be0d77 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba40b5b5e53a4b9aa79120e9b40e497f', 'request_id': 'req-8ec7f3c3-c4f5-4cf7-90dc-205c81be0d77'} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:09:10.447890 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-8ec7f3c3-c4f5-4cf7-90dc-205c81be0d77 admin admin] The token cache is being invalidate because project ba40b5b5e53a4b9aa79120e9b40e497f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81525) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 09 01:09:10.448335 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-8ec7f3c3-c4f5-4cf7-90dc-205c81be0d77 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:09:10.449351 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG keystone.notifications [None req-8ec7f3c3-c4f5-4cf7-90dc-205c81be0d77 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 09 01:09:10.451273 dv-cinder-master-3-smb devstack@keystone.service[81525]: [pid: 81525|app: 0|req: 1492/2952] 10.222.0.15 () {58 vars in 1233 bytes} [Sun Oct 9 01:09:10 2022] DELETE /identity/v3/projects/ba40b5b5e53a4b9aa79120e9b40e497f => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 09 01:09:20.025499 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=23,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 01:09:20.436821 dv-cinder-master-3-smb devstack@keystone.service[81525]: DEBUG dbcounter [-] [81525] Writing DB stats keystone:SELECT=16,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 09 01:10:12.260413 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41f0baf-cded-48b3-b7af-1393f435cd06 admin admin] Authenticating user token {{(pid=81524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 09 01:10:12.262065 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-e41f0baf-cded-48b3-b7af-1393f435cd06 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:10:12.348375 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41f0baf-cded-48b3-b7af-1393f435cd06 admin admin] Validating token access rules against request {{(pid=81524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 09 01:10:12.428502 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9185a92-892c-4b4e-ace8-61b7eb6d0d28 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '64be9d44437e4247a72334b9bab3cdd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f148d39ced534860abfbe8fc3f98ace4', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 09 01:10:12.428502 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9185a92-892c-4b4e-ace8-61b7eb6d0d28 service placement] REQUEST_METHOD: `GET` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 09 01:10:12.428502 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9185a92-892c-4b4e-ace8-61b7eb6d0d28 service placement] SCRIPT_NAME: `/identity` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 09 01:10:12.428502 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9185a92-892c-4b4e-ace8-61b7eb6d0d28 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 09 01:10:12.430542 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.fernet_utils [None req-e9185a92-892c-4b4e-ace8-61b7eb6d0d28 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 09 01:10:12.444962 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9185a92-892c-4b4e-ace8-61b7eb6d0d28 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 09 01:10:12.446784 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9185a92-892c-4b4e-ace8-61b7eb6d0d28 service placement] RBAC: Authorization granted {{(pid=81524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 09 01:10:12.463686 dv-cinder-master-3-smb devstack@keystone.service[81524]: [pid: 81524|app: 0|req: 1461/2953] 10.222.0.15 () {60 vars in 1365 bytes} [Sun Oct 9 01:10:12 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 09 01:10:22.454329 dv-cinder-master-3-smb devstack@keystone.service[81524]: DEBUG dbcounter [-] [81524] Writing DB stats keystone:SELECT=58 {{(pid=81524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}